-- Logs begin at Fri 2022-07-15 18:38:10 UTC, end at Fri 2022-07-15 19:53:22 UTC. -- Jul 15 19:14:48.219577 dv-cinder-799871-34-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 15 19:14:48.230719 dv-cinder-799871-34-smb devstack@keystone.service[80350]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 15 19:14:48.231978 dv-cinder-799871-34-smb devstack@keystone.service[80350]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Jul 15 19:14:48 2022] *** Jul 15 19:14:48.231978 dv-cinder-799871-34-smb devstack@keystone.service[80350]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 15 19:14:48.231978 dv-cinder-799871-34-smb devstack@keystone.service[80350]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 15 19:14:48.231978 dv-cinder-799871-34-smb devstack@keystone.service[80350]: nodename: dv-cinder-799871-34-smb Jul 15 19:14:48.231978 dv-cinder-799871-34-smb devstack@keystone.service[80350]: machine: x86_64 Jul 15 19:14:48.231978 dv-cinder-799871-34-smb devstack@keystone.service[80350]: clock source: unix Jul 15 19:14:48.231978 dv-cinder-799871-34-smb devstack@keystone.service[80350]: pcre jit disabled Jul 15 19:14:48.231978 dv-cinder-799871-34-smb devstack@keystone.service[80350]: detected number of CPU cores: 4 Jul 15 19:14:48.231978 dv-cinder-799871-34-smb devstack@keystone.service[80350]: current working directory: / Jul 15 19:14:48.231978 dv-cinder-799871-34-smb devstack@keystone.service[80350]: detected binary path: /usr/bin/uwsgi-core Jul 15 19:14:48.231978 dv-cinder-799871-34-smb devstack@keystone.service[80350]: your processes number limit is 47680 Jul 15 19:14:48.231978 dv-cinder-799871-34-smb devstack@keystone.service[80350]: your memory page size is 4096 bytes Jul 15 19:14:48.231978 dv-cinder-799871-34-smb devstack@keystone.service[80350]: detected max file descriptor number: 2048 Jul 15 19:14:48.231978 dv-cinder-799871-34-smb devstack@keystone.service[80350]: lock engine: pthread robust mutexes Jul 15 19:14:48.232893 dv-cinder-799871-34-smb devstack@keystone.service[80350]: thunder lock: enabled Jul 15 19:14:48.232893 dv-cinder-799871-34-smb devstack@keystone.service[80350]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 15 19:14:48.232893 dv-cinder-799871-34-smb devstack@keystone.service[80350]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 15 19:14:48.274070 dv-cinder-799871-34-smb devstack@keystone.service[80350]: Python main interpreter initialized at 0x55b072fe29c0 Jul 15 19:14:48.274070 dv-cinder-799871-34-smb devstack@keystone.service[80350]: python threads support enabled Jul 15 19:14:48.274070 dv-cinder-799871-34-smb devstack@keystone.service[80350]: your server socket listen backlog is limited to 100 connections Jul 15 19:14:48.274070 dv-cinder-799871-34-smb devstack@keystone.service[80350]: your mercy for graceful operations on workers is 90 seconds Jul 15 19:14:48.274457 dv-cinder-799871-34-smb devstack@keystone.service[80350]: mapped 403077 bytes (393 KB) for 2 cores Jul 15 19:14:48.274533 dv-cinder-799871-34-smb devstack@keystone.service[80350]: *** Operational MODE: preforking *** Jul 15 19:14:48.274797 dv-cinder-799871-34-smb devstack@keystone.service[80350]: *** uWSGI is running in multiple interpreter mode *** Jul 15 19:14:48.274797 dv-cinder-799871-34-smb devstack@keystone.service[80350]: spawned uWSGI master process (pid: 80350) Jul 15 19:14:48.275021 dv-cinder-799871-34-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 15 19:14:48.276114 dv-cinder-799871-34-smb devstack@keystone.service[80350]: spawned uWSGI worker 1 (pid: 80361, cores: 1) Jul 15 19:14:48.276114 dv-cinder-799871-34-smb devstack@keystone.service[80350]: spawned uWSGI worker 2 (pid: 80362, cores: 1) Jul 15 19:14:48.276114 dv-cinder-799871-34-smb devstack@keystone.service[80350]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 15 19:14:53.751605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 19:14:53.751605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: from cryptography.utils import int_from_bytes Jul 15 19:14:53.752419 dv-cinder-799871-34-smb devstack@keystone.service[80362]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 19:14:53.752419 dv-cinder-799871-34-smb devstack@keystone.service[80362]: from cryptography.utils import int_from_bytes Jul 15 19:14:53.755094 dv-cinder-799871-34-smb devstack@keystone.service[80361]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 19:14:53.755094 dv-cinder-799871-34-smb devstack@keystone.service[80361]: from cryptography.utils import int_from_bytes Jul 15 19:14:53.755680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 15 19:14:53.755680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: from cryptography.utils import int_from_bytes Jul 15 19:14:53.801604 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 19:14:53.801838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 19:14:53.802125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] command line args: [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 19:14:53.802479 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 19:14:53.802662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ================================================================================ {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 19:14:53.802950 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] admin_token = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.803199 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] config_dir = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.803388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.803571 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] config_source = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.803751 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] debug = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.803951 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.804249 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 15 19:14:53.804341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.804407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 15 19:14:53.804478 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.804618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] command line args: [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 15 19:14:53.804729 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.804862 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 15 19:14:53.804982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.805084 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ================================================================================ {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 15 19:14:53.805190 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.805288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] admin_token = **** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.805387 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_config_append = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.805491 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] config_dir = [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.805596 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.805696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.805798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_dir = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.805897 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] config_source = [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.805990 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_file = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.806099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] debug = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.806234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.806371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.806477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.806600 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.806686 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.806788 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.806862 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.806937 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.807060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.807148 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.807226 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.807348 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] list_limit = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.807429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.807549 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] log_config_append = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.807623 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.807748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.807748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] log_dir = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.807932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.808006 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] log_file = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.808118 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.808198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.808322 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.808398 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.808511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.808692 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.808884 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.808969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.809138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.809224 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.809353 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.809478 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.809675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.809761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.809858 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] publish_errors = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.809948 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.810089 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.810289 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.810366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.810443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.810518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.810591 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.810720 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.810844 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.810978 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.811097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.811230 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] standard_threads = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.811318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.811457 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.811575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.811686 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.811862 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.812038 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] use_journal = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.812129 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.40/identity {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.812209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] use_json = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.812282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] publish_errors = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.812356 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] use_stderr = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.812437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.812533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] use_syslog = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.812660 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.812781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.812901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.813013 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.813205 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.813327 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.813447 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.813560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.813678 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] standard_threads = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.813797 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.813922 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.813922 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.814149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.814273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.814388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.814500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] use_journal = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.814625 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.814739 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] use_json = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.814739 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] use_stderr = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.814996 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.815116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] use_syslog = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.815232 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.815353 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 15 19:14:53.815473 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.815593 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.815706 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.815818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.815936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.816057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.816177 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.816292 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.816411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.816524 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.816635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.816759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.816880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.817000 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.817625 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.817743 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.817921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.818121 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.818329 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.818329 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.818600 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.818722 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.818852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.818852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.819080 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.819199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.819313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.819431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.819550 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.819743 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.819859 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.819978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.820103 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.820223 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.820336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.820461 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.820581 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.820581 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.820792 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.820792 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.821009 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.821123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.821235 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.821382 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.821496 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.821615 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.821739 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.821739 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.821956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.821956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.822179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.822292 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.822411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.822525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.822647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.822816 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.822933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.823045 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.823170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.823285 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.823397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.823514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.823653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.823758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.823862 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.823964 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.824061 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.824156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.824251 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.824344 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.824447 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.824544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.824648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.824750 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.824852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.824948 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.825051 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.825147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.825147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.825332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.825427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.825527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.825636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.825746 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.825860 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.825973 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.826092 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.826206 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.826316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.826427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.826541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.826655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.826784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.826901 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.827014 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.827131 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.827248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.827368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.827488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.827602 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.827707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.827817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.827921 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.828043 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.828164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.828285 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.828399 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.828510 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.828613 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.828726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.828848 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.828963 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.829066 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.829179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.829300 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.829414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.829527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.829640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.829750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.829865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.829984 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.830098 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.830211 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.830324 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.830446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.830636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.830636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.830923 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.831038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.831164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.831281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.831403 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.831518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.831638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.831758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.831872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.831986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.832115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.832238 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.832364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.832479 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.832596 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.832717 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.833395 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.833521 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.833664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.833748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.833867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.834105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.834224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.834468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.834600 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.834717 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.834852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.834990 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.835121 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.835237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.835360 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.835476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.835589 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.835703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.835907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.836024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.836141 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.836255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.836394 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.836518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.836632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.836753 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.836869 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.836983 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.837097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.837211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.837325 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.837447 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.837562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.837677 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.837790 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.837903 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.838025 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.838148 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.838264 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.838376 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.838489 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.838601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.838715 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.838903 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.839021 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.839135 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.839249 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.839369 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.839484 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.839606 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.839728 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.839843 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.external = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.839956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.840070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.840184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.840308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.840425 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.840540 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.840651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.840765 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.password = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.840878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.841027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] auth.token = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.841153 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] auth.external = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.841153 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.841387 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.841387 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.841603 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.841719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.841840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.841963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.842080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] auth.password = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.842194 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.842310 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] auth.token = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.842425 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.842539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.842661 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.842792 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.842909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.843038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.843154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.843270 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.843392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.843510 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.843624 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.843739 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.843862 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.843978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.844100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.844223 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] credential.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.844338 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.844453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.844574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.844690 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.844813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.844929 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.845043 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.845164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.845280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.845404 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.845602 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.845728 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.845845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.845959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.846073 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.846196 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.846323 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.846439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.846554 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.846669 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.846854 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.846974 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.847098 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.847214 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.847335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.847457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.847572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.847687 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.847810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.847925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.848040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.848154 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] federation.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.848269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.848417 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.848585 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.848763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.848942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.848942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.849309 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.849443 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.849563 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.849678 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.849801 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.849919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.850033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.850157 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.850273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.850389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.850504 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.850625 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.850742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.850890 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.851008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.851124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.851239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.851355 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.851470 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.851593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.851710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.851816 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.851930 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.852045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.852160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.852287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.852403 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.852519 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.852519 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.852735 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.852850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.852977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.853092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.853207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.853321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.853435 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.853549 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.853672 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.853672 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.853888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.854004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.854118 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.854232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.854357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.854479 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.854593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.854707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.854832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.854946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.855075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.855192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.855307 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.855421 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.855541 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.855656 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.855778 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.855900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.856016 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.856131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.856245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.856359 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.856482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.856597 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.856712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.856827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.856942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.857056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.857179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.857295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.857409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.857524 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.857638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.857753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.857875 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.857991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.858107 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.858222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.858336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.858451 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.858691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.858869 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.858987 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.859102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.859218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.859332 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.859459 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.859576 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.859691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.859805 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.859919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.860034 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.860157 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.860274 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.860389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.860504 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.860618 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.860741 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.860857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.860978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.861094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.861208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.861324 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.861449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.861565 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.861680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.861795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.861909 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.862024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.862147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.862263 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.862378 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.862492 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.862606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.862721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.862864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.862987 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.863102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.863216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.863330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.863446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.863568 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.863684 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.863799 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.863913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.864057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.864180 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.864303 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.864403 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.864518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.864632 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.864746 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.864866 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.864988 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.865104 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.865218 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.865332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.865332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.865546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.865673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.865673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.865889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.866003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.866122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.866236 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.866358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.866474 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.866589 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.866709 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.866876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.866991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.867118 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.867235 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.867356 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.867471 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.867586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.867700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.867825 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.867947 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.868061 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.868175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.868289 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.868403 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.868589 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.868709 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.868823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.868921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.869035 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.869150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.869273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.869388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.869502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.869616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.869732 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.869846 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.869968 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.870084 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.870198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.870312 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.870426 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.870540 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.870663 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.870794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.870912 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.871026 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.871141 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.871256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.871383 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.871501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.871617 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.871732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.871847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.871969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.872093 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.872209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.872324 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.872439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.872554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] resource.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.872668 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.872791 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.872913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] role.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.873028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.873143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] role.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.873257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.873371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.873494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.873610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.873724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.873839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.873955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.874078 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.874196 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.874310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.874426 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.874540 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.874656 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.874854 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.874977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] role.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.875092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.875207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] role.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.875322 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.875436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.875559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.875675 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.875792 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.875907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.876023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.876138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.876261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.876378 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.876493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.876608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.876608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.876838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.876965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.877083 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.877198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.877313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.877428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.877543 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.877666 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.877782 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.877897 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.878013 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.878128 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.878243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.878367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.878483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.878483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.878698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.878829 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.878945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.879072 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.879190 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.879305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.879420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.879534 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.880196 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.880316 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.880431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.880546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.880661 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.880775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.880898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.881014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.881130 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.881246 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.881360 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.881360 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.881584 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.881584 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.881799 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.881913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.881913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.882127 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.882127 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.882359 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.882474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.882588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.882703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.882873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.883006 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.883125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.883239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.883355 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.883470 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.883584 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.883707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] token.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.883823 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.883938 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.884053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.884167 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.884282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.884451 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.884590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.884708 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.884823 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.884938 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.885053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.885177 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.885294 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.885410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.885525 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.885640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.885755 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.885878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.885994 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.connection = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.886156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.886285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.886403 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.886519 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.886634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.886776 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.886896 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.887011 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.887126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.887241 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.887355 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.887483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.887608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.887730 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.887730 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.887946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.888061 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.888184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.connection = **** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.888309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.888506 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.888626 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.888742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.888857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.888972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.889087 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.889210 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.889327 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.889442 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.889558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.889674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.889789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.889913 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.890062 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.890192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.890308 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.890424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.890539 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80362) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 19:14:53.890674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.890674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.890674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.890674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.890674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.890674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.890674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.891427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.891427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 15 19:14:53.891427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80361) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 15 19:14:53.921214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:53.921683 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:53.921683 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:53.922656 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:53.922968 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:53.923140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:53.930362 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:53.932199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:53.959776 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:53.959996 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:53.961816 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:53.962044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.102811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.104833 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.152757 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.152985 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.154210 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.154444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.218293 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.218511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.218607 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.218707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.218827 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.218918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.218996 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.219104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.219190 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.219323 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.219411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.219536 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.244639 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.244901 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.245020 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.245104 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.245181 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.245296 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.245382 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.245513 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.245587 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.245721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.245792 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.245941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.246027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.246151 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.257249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.257731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.269853 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.270085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.271017 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.271109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.271354 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.271439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.271579 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.271743 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.271829 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.271991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80362) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.272072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.272222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.272436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.272649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80361) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 15 19:14:54.289235 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.289439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 19:14:54.289955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.290042 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.290165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 19:14:54.290251 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 19:14:54.290436 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.290698 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.290800 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.290939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 15 19:14:54.291024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.291211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.291295 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.291470 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.291728 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.291981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.302425 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.302693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.302979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.303253 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.303603 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.303876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.304141 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.304417 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.311568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.312573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.314729 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.315028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.315307 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.315585 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.315840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.315946 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.316104 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.316186 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.316369 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.316453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.316637 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.316720 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.316899 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.316980 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.317225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.317306 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.317488 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.317742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.318070 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.318342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.318615 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.318905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.344268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.345812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.345898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.346087 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.347459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.347737 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.351431 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.351705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.351983 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.353335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.353611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.353887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.359313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.359594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.361216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.361496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.364574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.364854 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.365137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.365407 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.365677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.365945 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.366207 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.366469 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.366777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.367064 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.367341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.367622 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.367894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.368164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.368429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.368691 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.385137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.385405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.387500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.387775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.389904 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.392262 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.393546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.393836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.397104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.399941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.400072 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.402505 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.403394 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.406114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.406990 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.407284 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.407571 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.407853 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.408142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.408439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.409730 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.410028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.410315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.410617 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.411025 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.411504 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.428201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.428479 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.428744 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.429009 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.431299 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.431579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.431838 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.432097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.436859 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.438557 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.438853 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.439938 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.441634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.441902 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.442001 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.442296 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.442581 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.443065 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.443354 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.445438 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.445713 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.445987 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.446272 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.446546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.456489 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.456764 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.457059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.457310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.457583 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.458454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.458849 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.460694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.460985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.461245 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.461520 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.461793 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.462071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.462342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.478483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.481741 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.482344 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.485028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.485593 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.486621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.488402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.488678 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.488897 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.488998 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.490835 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.492575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.492848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.493127 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.496184 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.497772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.500319 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.501088 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.501372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.501649 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.501930 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.502014 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.506062 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.506346 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.506627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.506925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.511825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.512108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.512380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.516082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.516365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.516640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.520145 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80362) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.521101 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.521375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.521658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.521938 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.522225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.522503 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.522783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.523147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.523419 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.523695 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.523963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.524242 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.524495 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80362) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.525418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80361) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 15 19:14:54.525704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.525979 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.526285 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.526523 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.526822 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.527096 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.527357 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.527721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.527986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.528267 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.528527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.528798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.529061 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80361) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 15 19:14:54.561862 dv-cinder-799871-34-smb devstack@keystone.service[80362]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b072fe29c0 pid: 80362 (default app) Jul 15 19:14:54.565330 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04890def-344d-4e39-98aa-df0e6b09803a None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:14:54.565622 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04890def-344d-4e39-98aa-df0e6b09803a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:14:54.565898 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04890def-344d-4e39-98aa-df0e6b09803a None None] PATH_INFO: `/v3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:14:54.569197 dv-cinder-799871-34-smb devstack@keystone.service[80361]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b072fe29c0 pid: 80361 (default app) Jul 15 19:14:54.570829 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1/1] 10.222.0.40 () {50 vars in 791 bytes} [Fri Jul 15 19:14:54 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:03.342473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c07dba-8b81-4d96-b826-4d5e944ab9a0 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:03.343050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c07dba-8b81-4d96-b826-4d5e944ab9a0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:03.343050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c07dba-8b81-4d96-b826-4d5e944ab9a0 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:03.347484 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1/2] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:03.353775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839c8c2-41fb-4dbe-8927-c93907bb2106 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:03.354258 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839c8c2-41fb-4dbe-8927-c93907bb2106 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:03.354350 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e839c8c2-41fb-4dbe-8927-c93907bb2106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:03.423234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: INFO dbcounter [None req-e839c8c2-41fb-4dbe-8927-c93907bb2106 None None] Registered counter for database keystone Jul 15 19:15:03.445171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG oslo_db.sqlalchemy.engines [None req-e839c8c2-41fb-4dbe-8927-c93907bb2106 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80362) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 19:15:03.451770 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writer thread running {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 19:15:03.638324 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG passlib.handlers.bcrypt [None req-e839c8c2-41fb-4dbe-8927-c93907bb2106 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80362) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 19:15:03.638659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG passlib.handlers.bcrypt [None req-e839c8c2-41fb-4dbe-8927-c93907bb2106 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80362) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 19:15:03.695940 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e839c8c2-41fb-4dbe-8927-c93907bb2106 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:03.697610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e839c8c2-41fb-4dbe-8927-c93907bb2106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:03.835084 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 2/3] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:03 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 482 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 15 19:15:04.012594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c07dba-8b81-4d96-b826-4d5e944ab9a0 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:04.084573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: INFO dbcounter [None req-71c07dba-8b81-4d96-b826-4d5e944ab9a0 None None] Registered counter for database keystone Jul 15 19:15:04.104747 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG oslo_db.sqlalchemy.engines [None req-71c07dba-8b81-4d96-b826-4d5e944ab9a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80361) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 15 19:15:04.111430 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writer thread running {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 15 19:15:04.235247 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c07dba-8b81-4d96-b826-4d5e944ab9a0 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:04.240321 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d46bedf-771f-427e-bdeb-5c8ad34560a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:04.241022 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46bedf-771f-427e-bdeb-5c8ad34560a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:04.241312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46bedf-771f-427e-bdeb-5c8ad34560a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:04.241591 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d46bedf-771f-427e-bdeb-5c8ad34560a1 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:04.251211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46bedf-771f-427e-bdeb-5c8ad34560a1 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:04.305491 dv-cinder-799871-34-smb devstack@keystone.service[80361]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3d46bedf-771f-427e-bdeb-5c8ad34560a1 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 19:15:04.305750 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d46bedf-771f-427e-bdeb-5c8ad34560a1 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:04.316616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 2/4] 10.222.0.40 () {58 vars in 1324 bytes} [Fri Jul 15 19:15:04 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 19:15:04.323027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839c8c2-41fb-4dbe-8927-c93907bb2106 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:04.338202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e839c8c2-41fb-4dbe-8927-c93907bb2106 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:04.342773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d668a7f-a09f-46d4-bccc-6b416d96f106 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:04.344009 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d668a7f-a09f-46d4-bccc-6b416d96f106 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:04.344299 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d668a7f-a09f-46d4-bccc-6b416d96f106 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:04.344602 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d668a7f-a09f-46d4-bccc-6b416d96f106 admin admin] PATH_INFO: `/v3/projects/236a9e48f4d940ef9a994f185adc8b9d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:04.346158 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d668a7f-a09f-46d4-bccc-6b416d96f106 admin admin] RBAC: Authorizing `identity:get_project(project_id=236a9e48f4d940ef9a994f185adc8b9d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:04.402225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: WARNING keystone.common.rbac_enforcer.enforcer [None req-3d668a7f-a09f-46d4-bccc-6b416d96f106 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 15 19:15:04.402931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d668a7f-a09f-46d4-bccc-6b416d96f106 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:04.407501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 3/5] 10.222.0.40 () {56 vars in 1207 bytes} [Fri Jul 15 19:15:04 2022] GET /identity/v3/projects/236a9e48f4d940ef9a994f185adc8b9d => generated 344 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:06.465290 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3018ed3-bde1-4894-a053-1008ddf2c9a9 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:06.465842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3018ed3-bde1-4894-a053-1008ddf2c9a9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:06.465842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3018ed3-bde1-4894-a053-1008ddf2c9a9 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:06.469984 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 3/6] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:06.476310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fa08a-9eda-4bd0-ab0c-36c50de02def None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:06.476737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fa08a-9eda-4bd0-ab0c-36c50de02def None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:06.476874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205fa08a-9eda-4bd0-ab0c-36c50de02def None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:06.496069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-205fa08a-9eda-4bd0-ab0c-36c50de02def None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:06.497653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-205fa08a-9eda-4bd0-ab0c-36c50de02def None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:06.506460 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 4/7] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:06 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 15 19:15:06.529513 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3018ed3-bde1-4894-a053-1008ddf2c9a9 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:06.542007 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3018ed3-bde1-4894-a053-1008ddf2c9a9 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:06.546378 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36144527-c0cc-411d-8cb1-824032df1c04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:06.547067 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36144527-c0cc-411d-8cb1-824032df1c04 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:06.547354 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36144527-c0cc-411d-8cb1-824032df1c04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:06.547632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36144527-c0cc-411d-8cb1-824032df1c04 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:06.556105 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36144527-c0cc-411d-8cb1-824032df1c04 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:06.557962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36144527-c0cc-411d-8cb1-824032df1c04 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:06.567937 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 4/8] 10.222.0.40 () {58 vars in 1324 bytes} [Fri Jul 15 19:15:06 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 19:15:06.573712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fa08a-9eda-4bd0-ab0c-36c50de02def None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:06.584060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205fa08a-9eda-4bd0-ab0c-36c50de02def None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:06.588555 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d13c06-8638-47f6-b5fb-9061a3fea0b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:06.589420 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d13c06-8638-47f6-b5fb-9061a3fea0b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:06.589705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d13c06-8638-47f6-b5fb-9061a3fea0b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:06.589981 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d13c06-8638-47f6-b5fb-9061a3fea0b0 admin admin] PATH_INFO: `/v3/users/62e1112a8ecc4f798b846400813fbbe0` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:06.591427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d13c06-8638-47f6-b5fb-9061a3fea0b0 admin admin] RBAC: Authorizing `identity:get_user(user_id=62e1112a8ecc4f798b846400813fbbe0)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:06.593282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d13c06-8638-47f6-b5fb-9061a3fea0b0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:06.594943 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 5/9] 10.222.0.40 () {56 vars in 1198 bytes} [Fri Jul 15 19:15:06 2022] GET /identity/v3/users/62e1112a8ecc4f798b846400813fbbe0 => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:08.696281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b045cf-c951-45a6-8895-86ff60e395dd None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:08.696828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b045cf-c951-45a6-8895-86ff60e395dd None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:08.696828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b045cf-c951-45a6-8895-86ff60e395dd None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:08.698187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 5/10] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:08.703410 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cd976-d695-46b5-a8d7-220003021905 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:08.703838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cd976-d695-46b5-a8d7-220003021905 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:08.704092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8cd976-d695-46b5-a8d7-220003021905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:08.721225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4f8cd976-d695-46b5-a8d7-220003021905 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:08.722409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4f8cd976-d695-46b5-a8d7-220003021905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:08.756458 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb90dfc-f33e-42de-be88-10da1c828ebd None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:08.756737 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb90dfc-f33e-42de-be88-10da1c828ebd None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:08.757017 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb90dfc-f33e-42de-be88-10da1c828ebd None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:08.758373 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 6/11] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:15:08.763650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e523e81-8819-4e3f-aabd-e9101a3a019d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:08.763940 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e523e81-8819-4e3f-aabd-e9101a3a019d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:08.764216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e523e81-8819-4e3f-aabd-e9101a3a019d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:08.804783 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG passlib.handlers.bcrypt [None req-6e523e81-8819-4e3f-aabd-e9101a3a019d None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80361) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 15 19:15:08.805200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG passlib.handlers.bcrypt [None req-6e523e81-8819-4e3f-aabd-e9101a3a019d None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80361) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 15 19:15:08.805562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 6/12] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:08.828707 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cd976-d695-46b5-a8d7-220003021905 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:08.851624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-6e523e81-8819-4e3f-aabd-e9101a3a019d None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:08.853051 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:08.853254 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6e523e81-8819-4e3f-aabd-e9101a3a019d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:08.934048 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8cd976-d695-46b5-a8d7-220003021905 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:08.958709 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 7/13] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:15:08.969294 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac4b3b-86a7-4472-a294-d95617bea6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:08.970097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac4b3b-86a7-4472-a294-d95617bea6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:08.970386 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac4b3b-86a7-4472-a294-d95617bea6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:08.970666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebac4b3b-86a7-4472-a294-d95617bea6d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:08.980443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e523e81-8819-4e3f-aabd-e9101a3a019d None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:08.982095 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebac4b3b-86a7-4472-a294-d95617bea6d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:08.993545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ebac4b3b-86a7-4472-a294-d95617bea6d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:08.993545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:08.993545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:08.993545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:08.993545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:08.993545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:08.993545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:08.993545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:08.993545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:08.993545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:08.993545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:08.993545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:08.993545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:08.993545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:08.993545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:08.993545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:08.994483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:08.994483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:08.994483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:08.994483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:08.994483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:08.994483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:08.994483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:08.994483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:08.994483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:08.994483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:08.994483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:08.994483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:08.994483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:08.994483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:08.994483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:08.994483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:08.995645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:08.995645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:08.995645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:08.995645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:08.995645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:08.995645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:08.995645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:08.995645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:08.995645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:08.995645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:08.995645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:08.995645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:08.995645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 7/14] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:15:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:15:09.000473 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac4b3b-86a7-4472-a294-d95617bea6d3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:09.085532 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e523e81-8819-4e3f-aabd-e9101a3a019d None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:09.085687 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:09.088170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:09.104529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebac4b3b-86a7-4472-a294-d95617bea6d3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:09.124653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bdadb-936d-4305-ae3b-e5305651ed2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:09.125546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bdadb-936d-4305-ae3b-e5305651ed2d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:09.125831 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bdadb-936d-4305-ae3b-e5305651ed2d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:09.126106 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532bdadb-936d-4305-ae3b-e5305651ed2d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:09.139749 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033554c-a340-4c9c-bc22-46f72d3cb460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:09.140571 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033554c-a340-4c9c-bc22-46f72d3cb460 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:09.140751 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033554c-a340-4c9c-bc22-46f72d3cb460 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:09.141033 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4033554c-a340-4c9c-bc22-46f72d3cb460 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:09.141803 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033554c-a340-4c9c-bc22-46f72d3cb460 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:09.142114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033554c-a340-4c9c-bc22-46f72d3cb460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:09.143591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4033554c-a340-4c9c-bc22-46f72d3cb460 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:09.156886 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 8/15] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:09.163093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033554c-a340-4c9c-bc22-46f72d3cb460 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:09.200397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bdadb-936d-4305-ae3b-e5305651ed2d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:09.201932 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532bdadb-936d-4305-ae3b-e5305651ed2d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:09.271214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4033554c-a340-4c9c-bc22-46f72d3cb460 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:09.304330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 8/16] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 19:15:09.308415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e752a7-7914-425b-a27a-1d390b551063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:09.309298 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e752a7-7914-425b-a27a-1d390b551063 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:09.309580 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e752a7-7914-425b-a27a-1d390b551063 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:09.309857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7e752a7-7914-425b-a27a-1d390b551063 None admin] PATH_INFO: `/v3/users/62e1112a8ecc4f798b846400813fbbe0` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:09.310064 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bdadb-936d-4305-ae3b-e5305651ed2d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:09.311126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e752a7-7914-425b-a27a-1d390b551063 None admin] RBAC: Authorizing `identity:get_user(user_id=62e1112a8ecc4f798b846400813fbbe0)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:09.312604 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7e752a7-7914-425b-a27a-1d390b551063 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:09.313176 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:09.314349 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 9/17] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:09 2022] GET /identity/v3/users/62e1112a8ecc4f798b846400813fbbe0 => generated 247 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:09.319641 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e752a7-7914-425b-a27a-1d390b551063 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:09.335309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:09.412549 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532bdadb-936d-4305-ae3b-e5305651ed2d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:09.420580 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7e752a7-7914-425b-a27a-1d390b551063 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:09.447028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4c275-84eb-4667-b88c-0b94d88e3323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:09.447820 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4c275-84eb-4667-b88c-0b94d88e3323 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:09.448106 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4c275-84eb-4667-b88c-0b94d88e3323 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:09.448377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f4c275-84eb-4667-b88c-0b94d88e3323 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:09.455721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460e582-9f85-4adc-ab33-62174ea2b938 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:09.456515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460e582-9f85-4adc-ab33-62174ea2b938 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:09.456848 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460e582-9f85-4adc-ab33-62174ea2b938 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:09.457129 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5460e582-9f85-4adc-ab33-62174ea2b938 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:09.458347 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460e582-9f85-4adc-ab33-62174ea2b938 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:09.459854 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5460e582-9f85-4adc-ab33-62174ea2b938 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:09.461827 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 10/18] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:15:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:09.467344 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460e582-9f85-4adc-ab33-62174ea2b938 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:09.469170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4c275-84eb-4667-b88c-0b94d88e3323 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:09.470692 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f4c275-84eb-4667-b88c-0b94d88e3323 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:09.492060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-c6f4c275-84eb-4667-b88c-0b94d88e3323 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:15:09.492060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:09.492060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:09.492060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:09.492060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:09.492060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:09.492060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:09.492060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:09.492060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:09.492060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:09.492060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:09.492060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:09.492060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:15:09.492060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:15:09.492060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:15:09.492977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:15:09.492977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:09.492977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:09.492977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:09.492977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:09.492977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:09.492977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:09.492977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:09.492977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:09.492977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:09.492977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:09.492977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:09.492977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:09.492977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:09.492977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:09.492977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:09.492977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:09.493794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:15:09.493794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:15:09.493794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:15:09.493794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:09.493794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 9/19] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:15:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:15:09.500108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4c275-84eb-4667-b88c-0b94d88e3323 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:09.549847 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:09.559448 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:09.569705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5460e582-9f85-4adc-ab33-62174ea2b938 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:09.605300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f4c275-84eb-4667-b88c-0b94d88e3323 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:09.605845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6084696e-bf04-4345-9008-6f5149079f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:09.606502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084696e-bf04-4345-9008-6f5149079f78 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:09.606815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084696e-bf04-4345-9008-6f5149079f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:09.607097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6084696e-bf04-4345-9008-6f5149079f78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:09.607940 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084696e-bf04-4345-9008-6f5149079f78 None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.domain.id=default, user.id=62e1112a8ecc4f798b846400813fbbe0) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:09.608250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084696e-bf04-4345-9008-6f5149079f78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:09.609704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6084696e-bf04-4345-9008-6f5149079f78 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:09.616766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 11/20] 10.222.0.40 () {56 vars in 1322 bytes} [Fri Jul 15 19:15:09 2022] GET /identity/v3/role_assignments?user.id=62e1112a8ecc4f798b846400813fbbe0&scope.domain.id=default&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 233 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:09.641383 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f192ee9-e6fd-4d47-83ea-dc2e7ea7c388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:09.642072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f192ee9-e6fd-4d47-83ea-dc2e7ea7c388 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:09.642355 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f192ee9-e6fd-4d47-83ea-dc2e7ea7c388 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:09.642631 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f192ee9-e6fd-4d47-83ea-dc2e7ea7c388 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:09.643424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f192ee9-e6fd-4d47-83ea-dc2e7ea7c388 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:09.643733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f192ee9-e6fd-4d47-83ea-dc2e7ea7c388 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:09.646293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f192ee9-e6fd-4d47-83ea-dc2e7ea7c388 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:09.665862 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 10/21] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:15:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:11.944044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a6674-a95d-4cb7-b50a-e06d49f3c5f7 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:11.944556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a6674-a95d-4cb7-b50a-e06d49f3c5f7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:11.944658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88a6674-a95d-4cb7-b50a-e06d49f3c5f7 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:11.945984 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 12/22] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:15:11.951598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21187bf-996b-4808-bf5c-c7e8b74c4551 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:11.952487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21187bf-996b-4808-bf5c-c7e8b74c4551 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:11.952969 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e21187bf-996b-4808-bf5c-c7e8b74c4551 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:11.971480 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-e21187bf-996b-4808-bf5c-c7e8b74c4551 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:11.973107 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e21187bf-996b-4808-bf5c-c7e8b74c4551 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:12.062726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 11/23] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:15:12.098502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a6674-a95d-4cb7-b50a-e06d49f3c5f7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:12.233709 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88a6674-a95d-4cb7-b50a-e06d49f3c5f7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:12.250058 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33967167-bd87-490d-8531-76d49e879277 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:12.250363 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33967167-bd87-490d-8531-76d49e879277 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:12.250633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33967167-bd87-490d-8531-76d49e879277 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:12.252326 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 12/24] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:12.258488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433a0df-0f80-4c9c-9cbd-32c8ca824213 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:12.258821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433a0df-0f80-4c9c-9cbd-32c8ca824213 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:12.259170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1433a0df-0f80-4c9c-9cbd-32c8ca824213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:12.283959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-1433a0df-0f80-4c9c-9cbd-32c8ca824213 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:12.286273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1433a0df-0f80-4c9c-9cbd-32c8ca824213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:12.308601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855bede-597e-435e-ae68-5a51a43a0aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:12.309417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855bede-597e-435e-ae68-5a51a43a0aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:12.309702 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855bede-597e-435e-ae68-5a51a43a0aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:12.309980 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5855bede-597e-435e-ae68-5a51a43a0aa3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:12.325575 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855bede-597e-435e-ae68-5a51a43a0aa3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:12.332737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5855bede-597e-435e-ae68-5a51a43a0aa3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:12.335974 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:12.359617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-5855bede-597e-435e-ae68-5a51a43a0aa3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:15:12.359617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:12.359617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:12.359617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:12.359617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:12.359617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:12.359617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:12.359617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:12.359617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:12.359617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:12.359617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:12.359617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:12.359617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:15:12.359617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:15:12.359617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:15:12.369364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:15:12.369364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:12.369364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:12.369364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:12.369364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:12.369364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:12.369364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:12.369364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:12.369364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:12.369364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:12.369364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:12.369364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:12.369364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:12.369364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:12.369364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:12.369364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:12.369364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:12.370209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:15:12.370209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:15:12.370209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:15:12.370209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:12.370209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 13/25] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:15:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:12.370209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855bede-597e-435e-ae68-5a51a43a0aa3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:12.383129 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:12.437497 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 13/26] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:15:12.439046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462d218-58f1-4288-8106-ac5f869f3807 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:12.439622 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462d218-58f1-4288-8106-ac5f869f3807 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:12.439933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0462d218-58f1-4288-8106-ac5f869f3807 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:12.441733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 14/27] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:12.447460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2c131-ce3f-42a0-b7cb-c8683cd1edaa None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:12.447749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2c131-ce3f-42a0-b7cb-c8683cd1edaa None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:12.448032 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc2c131-ce3f-42a0-b7cb-c8683cd1edaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:12.488392 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-9cc2c131-ce3f-42a0-b7cb-c8683cd1edaa None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:12.489839 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9cc2c131-ce3f-42a0-b7cb-c8683cd1edaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:12.495732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5855bede-597e-435e-ae68-5a51a43a0aa3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:12.532522 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2c249-d586-4099-b131-549ed6ae41ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:12.533436 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2c249-d586-4099-b131-549ed6ae41ce None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:12.533892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2c249-d586-4099-b131-549ed6ae41ce None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:12.534315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f2c249-d586-4099-b131-549ed6ae41ce None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:12.535810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2c249-d586-4099-b131-549ed6ae41ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:12.536270 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2c249-d586-4099-b131-549ed6ae41ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:12.537876 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f2c249-d586-4099-b131-549ed6ae41ce None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:12.561220 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 14/28] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:15:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:12.562443 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2c249-d586-4099-b131-549ed6ae41ce None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:12.622665 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:12.640127 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 15/29] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:15:12.641329 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2c131-ce3f-42a0-b7cb-c8683cd1edaa None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:12.670572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f2c249-d586-4099-b131-549ed6ae41ce None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:12.708520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9979b55-580d-4fab-bd89-f8b0f86f1cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:12.709615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9979b55-580d-4fab-bd89-f8b0f86f1cab None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:12.710085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9979b55-580d-4fab-bd89-f8b0f86f1cab None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:12.710539 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9979b55-580d-4fab-bd89-f8b0f86f1cab None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:12.722035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9979b55-580d-4fab-bd89-f8b0f86f1cab None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:12.730591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-e9979b55-580d-4fab-bd89-f8b0f86f1cab None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:12.730591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:12.730591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:12.730591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:12.730591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:12.730591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:12.730591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:12.730591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:12.730591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:12.730591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:12.730591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:12.730591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:12.730591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:12.730591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:12.730591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:12.730591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:12.731546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:12.731546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:12.731546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:12.731546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:12.731546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:12.731546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:12.731546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:12.731546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:12.731546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:12.731546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:12.731546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:12.731546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:12.731546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:12.731546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:12.731546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:12.731546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:12.732501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:12.732501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:12.732501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:12.732501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:12.732501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:12.732501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:12.732501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:12.732501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:12.732501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:12.732501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:12.732501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:12.732501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:12.734742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 15/30] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:15:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:12.736268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8964fb-6cea-48fb-a00c-4ca865171172 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:12.736729 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8964fb-6cea-48fb-a00c-4ca865171172 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:12.737162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8964fb-6cea-48fb-a00c-4ca865171172 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:12.742030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 16/31] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:12.742030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8964fb-6cea-48fb-a00c-4ca865171172 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:12.768011 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cc2c131-ce3f-42a0-b7cb-c8683cd1edaa None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:12.777179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:12.808769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221544e3-531e-47f5-9388-d5b702e26613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:12.809775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221544e3-531e-47f5-9388-d5b702e26613 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:12.810252 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221544e3-531e-47f5-9388-d5b702e26613 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:12.810670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-221544e3-531e-47f5-9388-d5b702e26613 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:12.811974 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221544e3-531e-47f5-9388-d5b702e26613 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:12.814603 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-221544e3-531e-47f5-9388-d5b702e26613 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:12.855558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8964fb-6cea-48fb-a00c-4ca865171172 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:12.876921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:12.896709 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f9d572-8c40-418f-a23a-20f59a98a699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:12.897419 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9d572-8c40-418f-a23a-20f59a98a699 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:12.897705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9d572-8c40-418f-a23a-20f59a98a699 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:12.897984 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f9d572-8c40-418f-a23a-20f59a98a699 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:12.898767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9d572-8c40-418f-a23a-20f59a98a699 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:12.900232 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f9d572-8c40-418f-a23a-20f59a98a699 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:13.045194 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 16/32] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Jul 15 19:15:12 2022] POST /identity/v3/projects => generated 301 bytes in 404 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:15:13.047053 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221544e3-531e-47f5-9388-d5b702e26613 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:13.171191 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-221544e3-531e-47f5-9388-d5b702e26613 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:13.172405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 17/33] 10.222.0.40 () {60 vars in 1131 bytes} [Fri Jul 15 19:15:12 2022] POST /identity/v3/roles => generated 225 bytes in 433 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:15:13.173978 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d180edf-00c8-498b-b978-2945f4274aec None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:13.174279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d180edf-00c8-498b-b978-2945f4274aec None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:13.174566 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d180edf-00c8-498b-b978-2945f4274aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:13.204073 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0d180edf-00c8-498b-b978-2945f4274aec None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:13.206167 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0d180edf-00c8-498b-b978-2945f4274aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:13.218373 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af29fa4-831e-4a57-9c4b-afd768981f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:13.219479 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af29fa4-831e-4a57-9c4b-afd768981f23 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:13.219957 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af29fa4-831e-4a57-9c4b-afd768981f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:13.220485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af29fa4-831e-4a57-9c4b-afd768981f23 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:13.221490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af29fa4-831e-4a57-9c4b-afd768981f23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:13.221982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af29fa4-831e-4a57-9c4b-afd768981f23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:13.224016 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af29fa4-831e-4a57-9c4b-afd768981f23 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:13.240323 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 17/34] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:13.253288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af29fa4-831e-4a57-9c4b-afd768981f23 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:13.294919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:13.408186 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af29fa4-831e-4a57-9c4b-afd768981f23 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:13.409557 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 18/35] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:13.434646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d180edf-00c8-498b-b978-2945f4274aec None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:13.448596 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bacee-d646-4c54-966f-cbe289522e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:13.449740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bacee-d646-4c54-966f-cbe289522e10 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:13.450306 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bacee-d646-4c54-966f-cbe289522e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:13.450737 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bacee-d646-4c54-966f-cbe289522e10 None admin] PATH_INFO: `/v3/users/62e1112a8ecc4f798b846400813fbbe0` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:13.452665 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bacee-d646-4c54-966f-cbe289522e10 None admin] RBAC: Authorizing `identity:get_user(user_id=62e1112a8ecc4f798b846400813fbbe0)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:13.454356 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bacee-d646-4c54-966f-cbe289522e10 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:13.457004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 18/36] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:13 2022] GET /identity/v3/users/62e1112a8ecc4f798b846400813fbbe0 => generated 247 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:13.462628 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bacee-d646-4c54-966f-cbe289522e10 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:13.556460 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d180edf-00c8-498b-b978-2945f4274aec None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:13.564858 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:13.569670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:13.588979 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bacee-d646-4c54-966f-cbe289522e10 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:13.596099 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc63bfd5-ca6e-490b-9380-d61bad7cbfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:13.597073 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63bfd5-ca6e-490b-9380-d61bad7cbfe6 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:13.598271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63bfd5-ca6e-490b-9380-d61bad7cbfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:13.598737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc63bfd5-ca6e-490b-9380-d61bad7cbfe6 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:13.599766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63bfd5-ca6e-490b-9380-d61bad7cbfe6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:13.601546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc63bfd5-ca6e-490b-9380-d61bad7cbfe6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:13.629519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d36dedd-0851-4859-aa02-d3c99e81eda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:13.630381 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36dedd-0851-4859-aa02-d3c99e81eda0 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:13.630680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36dedd-0851-4859-aa02-d3c99e81eda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:13.630984 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d36dedd-0851-4859-aa02-d3c99e81eda0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:13.632339 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36dedd-0851-4859-aa02-d3c99e81eda0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:13.633782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d36dedd-0851-4859-aa02-d3c99e81eda0 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:13.635442 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 19/37] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:15:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:13.636890 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7697e1-665d-46b1-a2ae-ddc4ae66e122 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:13.637176 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7697e1-665d-46b1-a2ae-ddc4ae66e122 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:13.637454 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7697e1-665d-46b1-a2ae-ddc4ae66e122 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:13.638848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 20/38] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:13.643466 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7697e1-665d-46b1-a2ae-ddc4ae66e122 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:13.683265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 19/39] 10.222.0.40 () {60 vars in 1131 bytes} [Fri Jul 15 19:15:13 2022] POST /identity/v3/roles => generated 219 bytes in 249 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:15:13.685546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c78b06-2f51-487e-b9eb-3d2c64a879c5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:13.685836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c78b06-2f51-487e-b9eb-3d2c64a879c5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:13.686116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c78b06-2f51-487e-b9eb-3d2c64a879c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:13.724258 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a6c78b06-2f51-487e-b9eb-3d2c64a879c5 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:13.726496 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a6c78b06-2f51-487e-b9eb-3d2c64a879c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:13.816511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7697e1-665d-46b1-a2ae-ddc4ae66e122 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:13.855775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 20/40] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:13.869082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5a4bf2-7a58-4442-82f5-285201565dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:13.870332 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a4bf2-7a58-4442-82f5-285201565dfa None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:13.870865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a4bf2-7a58-4442-82f5-285201565dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:13.871347 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5a4bf2-7a58-4442-82f5-285201565dfa None admin] PATH_INFO: `/v3/domains/default/users/62e1112a8ecc4f798b846400813fbbe0/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:13.873643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a4bf2-7a58-4442-82f5-285201565dfa None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=62e1112a8ecc4f798b846400813fbbe0, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:13.875384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5a4bf2-7a58-4442-82f5-285201565dfa None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:13.878788 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c78b06-2f51-487e-b9eb-3d2c64a879c5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:13.986706 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:13.993510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c78b06-2f51-487e-b9eb-3d2c64a879c5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:14.029208 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15eccd-99eb-4651-8ed2-ba87b394fc81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:14.029562 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 21/41] 10.222.0.40 () {58 vars in 1361 bytes} [Fri Jul 15 19:15:13 2022] PUT /identity/v3/domains/default/users/62e1112a8ecc4f798b846400813fbbe0/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:15:14.038969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15eccd-99eb-4651-8ed2-ba87b394fc81 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:14.038969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15eccd-99eb-4651-8ed2-ba87b394fc81 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:14.038969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15eccd-99eb-4651-8ed2-ba87b394fc81 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:14.039245 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374813-6b42-419c-9f29-6f57a61ac7ca None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:14.039245 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374813-6b42-419c-9f29-6f57a61ac7ca None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:14.039402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15eccd-99eb-4651-8ed2-ba87b394fc81 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:14.039483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10374813-6b42-419c-9f29-6f57a61ac7ca None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:14.039559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15eccd-99eb-4651-8ed2-ba87b394fc81 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:14.039635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 22/42] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:14.039635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec3038-5d44-4ca2-9246-48a32439ebf6 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:14.039635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec3038-5d44-4ca2-9246-48a32439ebf6 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:14.039635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ec3038-5d44-4ca2-9246-48a32439ebf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:14.057609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-94ec3038-5d44-4ca2-9246-48a32439ebf6 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:14.068894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-94ec3038-5d44-4ca2-9246-48a32439ebf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:14.075766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:14.137575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 23/43] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:15:14.146811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 21/44] 10.222.0.40 () {60 vars in 1131 bytes} [Fri Jul 15 19:15:13 2022] POST /identity/v3/roles => generated 223 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:15:14.163420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec3038-5d44-4ca2-9246-48a32439ebf6 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:14.287560 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ec3038-5d44-4ca2-9246-48a32439ebf6 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:14.327353 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f132c60-2c09-4f26-b128-9c512c473f23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:14.328158 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f132c60-2c09-4f26-b128-9c512c473f23 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:14.328447 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f132c60-2c09-4f26-b128-9c512c473f23 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:14.328729 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f132c60-2c09-4f26-b128-9c512c473f23 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:14.330047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f132c60-2c09-4f26-b128-9c512c473f23 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:14.332488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f132c60-2c09-4f26-b128-9c512c473f23 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:14.334262 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 24/45] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:15:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:14.340116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15eccd-99eb-4651-8ed2-ba87b394fc81 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:14.446829 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15eccd-99eb-4651-8ed2-ba87b394fc81 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:14.481256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b3f3b0-27da-457d-a1d6-e89ca1d6a669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:14.481922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3f3b0-27da-457d-a1d6-e89ca1d6a669 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:14.482208 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3f3b0-27da-457d-a1d6-e89ca1d6a669 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:14.482521 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b3f3b0-27da-457d-a1d6-e89ca1d6a669 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:14.483255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3f3b0-27da-457d-a1d6-e89ca1d6a669 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:14.484728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53b3f3b0-27da-457d-a1d6-e89ca1d6a669 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:14.591355 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 22/46] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Jul 15 19:15:14 2022] POST /identity/v3/projects => generated 312 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:15:16.054772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ce1ad-7272-476e-b5ef-7b02d64b8a74 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:16.055356 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ce1ad-7272-476e-b5ef-7b02d64b8a74 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:16.055356 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3ce1ad-7272-476e-b5ef-7b02d64b8a74 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:16.056746 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 25/47] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:16.062277 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f13cc-58d0-4812-935a-dc380cbe811c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:16.062659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f13cc-58d0-4812-935a-dc380cbe811c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:16.062849 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f13cc-58d0-4812-935a-dc380cbe811c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:16.081931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-925f13cc-58d0-4812-935a-dc380cbe811c None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:16.083176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-925f13cc-58d0-4812-935a-dc380cbe811c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:16.085237 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:16.151328 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 23/48] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:16.174377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ce1ad-7272-476e-b5ef-7b02d64b8a74 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:16.191487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:16.280424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3ce1ad-7272-476e-b5ef-7b02d64b8a74 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:16.315169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97173143-faa1-4735-a4dd-bef73dc03f4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:16.315993 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97173143-faa1-4735-a4dd-bef73dc03f4b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:16.316277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97173143-faa1-4735-a4dd-bef73dc03f4b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:16.316557 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97173143-faa1-4735-a4dd-bef73dc03f4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:16.327785 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97173143-faa1-4735-a4dd-bef73dc03f4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:16.336719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-97173143-faa1-4735-a4dd-bef73dc03f4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:16.336719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:16.336719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:16.336719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:16.336719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:16.336719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:16.336719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:16.336719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:16.336719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:16.336719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:16.336719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:16.336719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:16.336719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:16.336719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:16.336719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:16.336719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:16.337643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:16.337643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:16.337643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:16.337643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:16.337643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:16.337643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:16.337643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:16.337643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:16.337643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:16.337643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:16.337643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:16.337643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:16.337643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:16.337643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:16.337643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:16.337643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:16.338645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:16.338645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:16.338645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:16.338645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:16.338645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:16.338645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:16.338645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:16.338645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:16.338645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:16.338645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:16.338645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:16.338645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:16.338645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 26/49] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:15:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:16.343849 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f13cc-58d0-4812-935a-dc380cbe811c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:16.444697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f13cc-58d0-4812-935a-dc380cbe811c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:16.478232 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-292754a2-c566-4904-854e-063a5f23db07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:16.478934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292754a2-c566-4904-854e-063a5f23db07 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:16.479223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292754a2-c566-4904-854e-063a5f23db07 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:16.479501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-292754a2-c566-4904-854e-063a5f23db07 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:16.480263 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292754a2-c566-4904-854e-063a5f23db07 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:16.480574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292754a2-c566-4904-854e-063a5f23db07 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:16.481959 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-292754a2-c566-4904-854e-063a5f23db07 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:16.487246 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:16.491003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 24/50] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:16.496950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97173143-faa1-4735-a4dd-bef73dc03f4b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:16.574973 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:16.600009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97173143-faa1-4735-a4dd-bef73dc03f4b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:16.618539 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d0d6b-2326-4ecd-b416-9cf90706e9bd None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:16.618856 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d0d6b-2326-4ecd-b416-9cf90706e9bd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:16.619139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5d0d6b-2326-4ecd-b416-9cf90706e9bd None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:16.620523 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 25/51] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:16.625346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d48678-1165-49aa-b2bb-322bbccece38 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:16.625635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d48678-1165-49aa-b2bb-322bbccece38 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:16.625916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d48678-1165-49aa-b2bb-322bbccece38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:16.635467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bbadb-80d2-442a-b7a4-99cdda6e905f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:16.636363 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bbadb-80d2-442a-b7a4-99cdda6e905f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:16.636654 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bbadb-80d2-442a-b7a4-99cdda6e905f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:16.636937 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06bbadb-80d2-442a-b7a4-99cdda6e905f None admin] PATH_INFO: `/v3/users/62e1112a8ecc4f798b846400813fbbe0` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:16.638168 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bbadb-80d2-442a-b7a4-99cdda6e905f None admin] RBAC: Authorizing `identity:get_user(user_id=62e1112a8ecc4f798b846400813fbbe0)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:16.639667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06bbadb-80d2-442a-b7a4-99cdda6e905f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:16.641305 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 27/52] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:16 2022] GET /identity/v3/users/62e1112a8ecc4f798b846400813fbbe0 => generated 247 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:16.643225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f3d48678-1165-49aa-b2bb-322bbccece38 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:16.645137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f3d48678-1165-49aa-b2bb-322bbccece38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:16.646967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bbadb-80d2-442a-b7a4-99cdda6e905f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:16.716345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 26/53] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:15:16.740443 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d48678-1165-49aa-b2bb-322bbccece38 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:16.750024 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06bbadb-80d2-442a-b7a4-99cdda6e905f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:16.785295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87616ee9-191b-44fc-8bcb-ddcd058458b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:16.786167 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87616ee9-191b-44fc-8bcb-ddcd058458b3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:16.786467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87616ee9-191b-44fc-8bcb-ddcd058458b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:16.786765 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87616ee9-191b-44fc-8bcb-ddcd058458b3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:16.788026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87616ee9-191b-44fc-8bcb-ddcd058458b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:16.789479 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87616ee9-191b-44fc-8bcb-ddcd058458b3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:16.791440 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 28/54] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:15:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:16.797202 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87616ee9-191b-44fc-8bcb-ddcd058458b3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:16.849760 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d48678-1165-49aa-b2bb-322bbccece38 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:16.883966 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:16.889747 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f4168-e2ee-48e5-8e46-c3f151ede7d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:16.890572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f4168-e2ee-48e5-8e46-c3f151ede7d1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:16.890886 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f4168-e2ee-48e5-8e46-c3f151ede7d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:16.891174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598f4168-e2ee-48e5-8e46-c3f151ede7d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:16.892445 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f4168-e2ee-48e5-8e46-c3f151ede7d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:16.895444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598f4168-e2ee-48e5-8e46-c3f151ede7d1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:16.896229 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 27/55] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:15:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:16.901974 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f4168-e2ee-48e5-8e46-c3f151ede7d1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:16.916077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:17.007140 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598f4168-e2ee-48e5-8e46-c3f151ede7d1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:17.009129 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87616ee9-191b-44fc-8bcb-ddcd058458b3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:17.041675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a5b271-a238-4e54-a990-1f8997726463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:17.042343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5b271-a238-4e54-a990-1f8997726463 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:17.042632 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5b271-a238-4e54-a990-1f8997726463 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:17.042941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a5b271-a238-4e54-a990-1f8997726463 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:17.046050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5b271-a238-4e54-a990-1f8997726463 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:17.046142 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d028c5-099d-45cc-9a8d-38988d213a27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:17.046226 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a5b271-a238-4e54-a990-1f8997726463 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:17.046292 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d028c5-099d-45cc-9a8d-38988d213a27 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:17.046292 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d028c5-099d-45cc-9a8d-38988d213a27 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:17.046292 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d028c5-099d-45cc-9a8d-38988d213a27 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:17.046598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d028c5-099d-45cc-9a8d-38988d213a27 None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.domain.id=default, user.id=62e1112a8ecc4f798b846400813fbbe0) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:17.046947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d028c5-099d-45cc-9a8d-38988d213a27 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:17.048381 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d028c5-099d-45cc-9a8d-38988d213a27 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:17.057262 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 29/56] 10.222.0.40 () {56 vars in 1322 bytes} [Fri Jul 15 19:15:16 2022] GET /identity/v3/role_assignments?user.id=62e1112a8ecc4f798b846400813fbbe0&scope.domain.id=default&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 530 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:17.152810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 28/57] 10.222.0.40 () {60 vars in 1140 bytes} [Fri Jul 15 19:15:16 2022] POST /identity/v3/projects => generated 298 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:15:19.176851 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f4e94-577d-41c7-9b7b-366ee77a071c None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:19.177366 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f4e94-577d-41c7-9b7b-366ee77a071c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:19.177481 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981f4e94-577d-41c7-9b7b-366ee77a071c None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:19.178837 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 30/58] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:19.184283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a54ce-0111-4141-a8b2-fe67eb068787 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:19.184707 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a54ce-0111-4141-a8b2-fe67eb068787 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:19.184836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a54ce-0111-4141-a8b2-fe67eb068787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:19.203173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7c3a54ce-0111-4141-a8b2-fe67eb068787 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:19.204378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7c3a54ce-0111-4141-a8b2-fe67eb068787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:19.252392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:19.274040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 29/59] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:19.298058 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f4e94-577d-41c7-9b7b-366ee77a071c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:19.376866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:19.404133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981f4e94-577d-41c7-9b7b-366ee77a071c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:19.436559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45916c32-7dad-41a5-8e7a-ce96f6c0bcab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:19.437342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45916c32-7dad-41a5-8e7a-ce96f6c0bcab None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:19.437632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45916c32-7dad-41a5-8e7a-ce96f6c0bcab None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:19.437913 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45916c32-7dad-41a5-8e7a-ce96f6c0bcab None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:19.439227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45916c32-7dad-41a5-8e7a-ce96f6c0bcab None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:19.441274 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45916c32-7dad-41a5-8e7a-ce96f6c0bcab None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:19.442961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 31/60] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:15:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:19.448749 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a54ce-0111-4141-a8b2-fe67eb068787 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:19.545315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a54ce-0111-4141-a8b2-fe67eb068787 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:19.578997 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50722f0f-57c6-421d-8ea8-be35494edaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:19.579659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50722f0f-57c6-421d-8ea8-be35494edaf8 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:19.579946 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50722f0f-57c6-421d-8ea8-be35494edaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:19.580223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50722f0f-57c6-421d-8ea8-be35494edaf8 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:19.580927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50722f0f-57c6-421d-8ea8-be35494edaf8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:19.583043 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50722f0f-57c6-421d-8ea8-be35494edaf8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:19.678554 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 30/61] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:15:19 2022] POST /identity/v3/users => generated 275 bytes in 230 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:15:23.008828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd048bdf-1cf8-409a-8f03-a1740470b3ad None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:23.009985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd048bdf-1cf8-409a-8f03-a1740470b3ad None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:23.010489 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd048bdf-1cf8-409a-8f03-a1740470b3ad None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:23.012238 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 32/62] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:23.018079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a70140-d8c8-4794-bcc9-876fcd55d169 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:23.019054 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a70140-d8c8-4794-bcc9-876fcd55d169 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:23.019813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a70140-d8c8-4794-bcc9-876fcd55d169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:23.045516 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e6a70140-d8c8-4794-bcc9-876fcd55d169 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:23.047165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e6a70140-d8c8-4794-bcc9-876fcd55d169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:23.091995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:23.103822 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec67b5-084a-4238-abd4-9d5abe7d9dac None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:23.108520 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec67b5-084a-4238-abd4-9d5abe7d9dac None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:23.108520 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaec67b5-084a-4238-abd4-9d5abe7d9dac None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:23.108520 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 33/63] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:23.111516 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9634cc5-1224-4cb7-88c9-c1a4815f8a3e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:23.112517 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9634cc5-1224-4cb7-88c9-c1a4815f8a3e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:23.113023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9634cc5-1224-4cb7-88c9-c1a4815f8a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:23.152666 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d9634cc5-1224-4cb7-88c9-c1a4815f8a3e None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:23.155340 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d9634cc5-1224-4cb7-88c9-c1a4815f8a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:23.168924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 31/64] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:23.242048 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a11fe7-8b47-4989-91f4-562bc737d1cb None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:23.242695 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a11fe7-8b47-4989-91f4-562bc737d1cb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:23.243217 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a11fe7-8b47-4989-91f4-562bc737d1cb None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:23.244817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 32/65] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:15:23.249940 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a11fe7-8b47-4989-91f4-562bc737d1cb None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:23.262603 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 34/66] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:15:23.264440 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1e744-afe6-4160-a1d5-6000537ae08c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:23.264947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1e744-afe6-4160-a1d5-6000537ae08c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:23.265452 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c1e744-afe6-4160-a1d5-6000537ae08c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:23.284237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-72c1e744-afe6-4160-a1d5-6000537ae08c None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:23.285939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-72c1e744-afe6-4160-a1d5-6000537ae08c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:23.378839 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 35/67] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:23.378839 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1e744-afe6-4160-a1d5-6000537ae08c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:23.379755 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:23.393018 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a11fe7-8b47-4989-91f4-562bc737d1cb None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:23.443971 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa331b1-0582-4d9c-b05f-ba849b4ffd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:23.444769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa331b1-0582-4d9c-b05f-ba849b4ffd05 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:23.445079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa331b1-0582-4d9c-b05f-ba849b4ffd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:23.445356 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa331b1-0582-4d9c-b05f-ba849b4ffd05 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:23.456679 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa331b1-0582-4d9c-b05f-ba849b4ffd05 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:23.464449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ffa331b1-0582-4d9c-b05f-ba849b4ffd05 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:23.464449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:23.464449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:23.464449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:23.464449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:23.464449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:23.464449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:23.464449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:23.464449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:23.464449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:23.464449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:23.464449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:23.464449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:23.464449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:23.464449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:23.464449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:23.465433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:23.465433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:23.465433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:23.465433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:23.465433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:23.465433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:23.465433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:23.465433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:23.465433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:23.465433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:23.465433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:23.465433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:23.465433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:23.465433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:23.465433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:23.465433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:23.466274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:23.466274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:23.466274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:23.466274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:23.466274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:23.466274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:23.466274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:23.466274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:23.466274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:23.466274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:23.466274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:23.466274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:23.466274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 33/68] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:15:23.467500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3c025-7fa2-4c7c-9199-4f0a03dd6de9 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:23.467500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3c025-7fa2-4c7c-9199-4f0a03dd6de9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:23.467634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e3c025-7fa2-4c7c-9199-4f0a03dd6de9 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:23.468903 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 34/69] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:23.472761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3c025-7fa2-4c7c-9199-4f0a03dd6de9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:23.495640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c1e744-afe6-4160-a1d5-6000537ae08c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:23.503462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:23.533100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500c316-a45f-4848-8e21-27cb649d1c3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:23.533830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500c316-a45f-4848-8e21-27cb649d1c3c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:23.535265 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500c316-a45f-4848-8e21-27cb649d1c3c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:23.535972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1500c316-a45f-4848-8e21-27cb649d1c3c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:23.546553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1500c316-a45f-4848-8e21-27cb649d1c3c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:23.554961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-1500c316-a45f-4848-8e21-27cb649d1c3c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:15:23.554961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:23.554961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:23.554961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:23.554961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:23.554961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:23.554961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:23.554961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:23.554961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:23.554961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:23.554961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:23.554961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:23.554961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:23.554961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:23.554961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:23.554961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:23.555904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:23.555904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:23.555904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:23.555904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:23.555904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:23.555904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:23.555904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:23.555904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:23.555904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:23.555904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:23.555904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:23.555904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:23.555904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:23.555904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:23.555904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:23.555904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:23.556670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:23.556670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:23.556670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:23.556670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:23.556670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:23.556670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:23.556670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:23.556670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:23.556670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:23.556670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:23.556670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:15:23.556670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:23.556670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 36/70] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:15:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:23.557497 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500c316-a45f-4848-8e21-27cb649d1c3c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:23.585065 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e3c025-7fa2-4c7c-9199-4f0a03dd6de9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:23.622699 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c2f807-d11b-43ff-b465-1c600e4c2c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:23.623251 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:23.623527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2f807-d11b-43ff-b465-1c600e4c2c42 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:23.624003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2f807-d11b-43ff-b465-1c600e4c2c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:23.624130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c2f807-d11b-43ff-b465-1c600e4c2c42 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:23.634636 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c2f807-d11b-43ff-b465-1c600e4c2c42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:23.642501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b5c2f807-d11b-43ff-b465-1c600e4c2c42 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:23.642501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:23.642501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:23.642501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:23.642501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:23.642501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:23.642501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:23.642501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:23.642501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:23.642501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:23.642501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:23.642501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:23.642501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:23.642501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:23.642501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:23.642501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:23.643933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:23.643933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:23.643933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:23.643933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:23.643933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:23.643933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:23.643933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:23.643933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:23.643933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:23.643933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:23.643933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:23.643933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:23.643933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:23.643933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:23.643933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:23.643933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:23.645518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:23.645518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:23.645518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:23.645518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:23.645518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:23.645518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:23.645518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:23.645518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:23.645518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:23.645518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:23.645518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:23.645518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:23.645518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 35/71] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:15:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:23.646180 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5700d-10b6-4af4-9045-8c40af5f80f4 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:23.646436 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5700d-10b6-4af4-9045-8c40af5f80f4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:23.646661 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f5700d-10b6-4af4-9045-8c40af5f80f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:23.664968 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-81f5700d-10b6-4af4-9045-8c40af5f80f4 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:23.666190 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-81f5700d-10b6-4af4-9045-8c40af5f80f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:23.669986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1500c316-a45f-4848-8e21-27cb649d1c3c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:23.703407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dac86f-318d-4041-b41f-b1f856db9868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:23.704083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dac86f-318d-4041-b41f-b1f856db9868 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:23.704374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dac86f-318d-4041-b41f-b1f856db9868 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:23.704654 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dac86f-318d-4041-b41f-b1f856db9868 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:23.705416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dac86f-318d-4041-b41f-b1f856db9868 None admin] RBAC: Adding query filter params (name=member) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:23.705729 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dac86f-318d-4041-b41f-b1f856db9868 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:23.708256 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dac86f-318d-4041-b41f-b1f856db9868 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:23.717008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 37/72] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:23.718332 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0203-ef43-4c6d-a769-93e6b63aeffb None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:23.718626 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0203-ef43-4c6d-a769-93e6b63aeffb None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:23.718941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dd0203-ef43-4c6d-a769-93e6b63aeffb None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:23.720347 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 38/73] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:23.720901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd0203-ef43-4c6d-a769-93e6b63aeffb None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:23.741630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 36/74] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:23.742328 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5700d-10b6-4af4-9045-8c40af5f80f4 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:23.762996 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:23.829824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dd0203-ef43-4c6d-a769-93e6b63aeffb None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:23.847600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f5700d-10b6-4af4-9045-8c40af5f80f4 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:23.854052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:23.865102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8656d7-a7c8-4cad-b2ca-b01b792cfd2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:23.865769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8656d7-a7c8-4cad-b2ca-b01b792cfd2a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:23.866054 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8656d7-a7c8-4cad-b2ca-b01b792cfd2a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:23.866664 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8656d7-a7c8-4cad-b2ca-b01b792cfd2a None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:23.867116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8656d7-a7c8-4cad-b2ca-b01b792cfd2a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:23.867431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8656d7-a7c8-4cad-b2ca-b01b792cfd2a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:23.868920 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8656d7-a7c8-4cad-b2ca-b01b792cfd2a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:23.879506 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 39/75] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:15:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:23.880057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8656d7-a7c8-4cad-b2ca-b01b792cfd2a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:23.884053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1a86ee-a007-46b2-9364-66c43bd65349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:23.884786 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a86ee-a007-46b2-9364-66c43bd65349 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:23.885071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a86ee-a007-46b2-9364-66c43bd65349 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:23.885357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1a86ee-a007-46b2-9364-66c43bd65349 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:23.886124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a86ee-a007-46b2-9364-66c43bd65349 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:23.886436 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a86ee-a007-46b2-9364-66c43bd65349 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:23.888050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1a86ee-a007-46b2-9364-66c43bd65349 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:23.898217 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 37/76] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:23.899617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c086de5-dbd3-40f6-8a58-33f4b3ca6f41 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:23.899923 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c086de5-dbd3-40f6-8a58-33f4b3ca6f41 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:23.900186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c086de5-dbd3-40f6-8a58-33f4b3ca6f41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:23.916805 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6c086de5-dbd3-40f6-8a58-33f4b3ca6f41 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:23.918057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6c086de5-dbd3-40f6-8a58-33f4b3ca6f41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:23.987229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8656d7-a7c8-4cad-b2ca-b01b792cfd2a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:23.987428 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 38/77] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:23.988169 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c086de5-dbd3-40f6-8a58-33f4b3ca6f41 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:24.003991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:24.025229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f62e7d-da25-4d14-a813-c22220a4f4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:24.026115 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f62e7d-da25-4d14-a813-c22220a4f4fd None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:24.026402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f62e7d-da25-4d14-a813-c22220a4f4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:24.026685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f62e7d-da25-4d14-a813-c22220a4f4fd None admin] PATH_INFO: `/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:24.042733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f62e7d-da25-4d14-a813-c22220a4f4fd None admin] RBAC: Authorizing `identity:get_user(user_id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:24.044223 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f62e7d-da25-4d14-a813-c22220a4f4fd None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:24.045980 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 40/78] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:23 2022] GET /identity/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:24.047439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f62e7d-da25-4d14-a813-c22220a4f4fd None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:24.099209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c086de5-dbd3-40f6-8a58-33f4b3ca6f41 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:24.100178 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:24.134729 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6d82c-f4d8-476e-862e-0da2001cec83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:24.135550 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6d82c-f4d8-476e-862e-0da2001cec83 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:24.135838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6d82c-f4d8-476e-862e-0da2001cec83 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:24.136117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da6d82c-f4d8-476e-862e-0da2001cec83 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:24.137413 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6d82c-f4d8-476e-862e-0da2001cec83 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:24.138928 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5da6d82c-f4d8-476e-862e-0da2001cec83 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:24.140566 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 39/79] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:15:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:24.141332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6d82c-f4d8-476e-862e-0da2001cec83 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:24.157950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f62e7d-da25-4d14-a813-c22220a4f4fd None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:24.193195 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d9532-2eba-49d3-846b-4c1fa2a0501a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:24.194058 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d9532-2eba-49d3-846b-4c1fa2a0501a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:24.194340 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d9532-2eba-49d3-846b-4c1fa2a0501a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:24.194615 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1d9532-2eba-49d3-846b-4c1fa2a0501a None admin] PATH_INFO: `/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:24.195858 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d9532-2eba-49d3-846b-4c1fa2a0501a None admin] RBAC: Authorizing `identity:get_user(user_id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:24.197389 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a1d9532-2eba-49d3-846b-4c1fa2a0501a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:24.198966 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 41/80] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:24 2022] GET /identity/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8 => generated 275 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:24.199748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d9532-2eba-49d3-846b-4c1fa2a0501a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:24.219520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:24.243520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da6d82c-f4d8-476e-862e-0da2001cec83 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:24.277858 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e60057-dae5-42f5-8c2b-f6f0e5912bbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:24.278729 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e60057-dae5-42f5-8c2b-f6f0e5912bbc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:24.279044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e60057-dae5-42f5-8c2b-f6f0e5912bbc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:24.279365 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e60057-dae5-42f5-8c2b-f6f0e5912bbc None admin] PATH_INFO: `/v3/users/62e1112a8ecc4f798b846400813fbbe0` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:24.280540 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e60057-dae5-42f5-8c2b-f6f0e5912bbc None admin] RBAC: Authorizing `identity:get_user(user_id=62e1112a8ecc4f798b846400813fbbe0)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:24.282006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e60057-dae5-42f5-8c2b-f6f0e5912bbc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:24.283676 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 40/81] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:24 2022] GET /identity/v3/users/62e1112a8ecc4f798b846400813fbbe0 => generated 247 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:24.284563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e60057-dae5-42f5-8c2b-f6f0e5912bbc None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:24.306797 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a1d9532-2eba-49d3-846b-4c1fa2a0501a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:24.320247 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:24.341405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03fa02-4c2a-465d-8b96-b3e85abf550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:24.342198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03fa02-4c2a-465d-8b96-b3e85abf550e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:24.342483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03fa02-4c2a-465d-8b96-b3e85abf550e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:24.342788 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a03fa02-4c2a-465d-8b96-b3e85abf550e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:24.352888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a03fa02-4c2a-465d-8b96-b3e85abf550e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:24.360460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-5a03fa02-4c2a-465d-8b96-b3e85abf550e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:24.360460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:24.360460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:24.360460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:24.360460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:24.360460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:24.360460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:24.360460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:24.360460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:24.360460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:24.360460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:24.360460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:24.360460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:24.360460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:24.360460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:24.360460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:24.361395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:24.361395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:24.361395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:24.361395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:24.361395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:24.361395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:24.361395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:24.361395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:24.361395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:24.361395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:24.361395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:24.361395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:24.361395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:24.361395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:24.361395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:24.361395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:24.362680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:24.362680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:24.362680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:24.362680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:24.362680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:24.362680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:24.362680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:24.362680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:24.362680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:24.362680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:24.362680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:24.362680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:24.362680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 42/82] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:24.363380 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03fa02-4c2a-465d-8b96-b3e85abf550e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:24.386712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e60057-dae5-42f5-8c2b-f6f0e5912bbc None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:24.421351 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc666110-1f0b-49c1-8b2f-a42d6e4f35e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:24.422002 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc666110-1f0b-49c1-8b2f-a42d6e4f35e5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:24.422285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc666110-1f0b-49c1-8b2f-a42d6e4f35e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:24.422560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc666110-1f0b-49c1-8b2f-a42d6e4f35e5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:24.438703 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:24.464612 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a03fa02-4c2a-465d-8b96-b3e85abf550e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:24.496087 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc666110-1f0b-49c1-8b2f-a42d6e4f35e5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:24.497642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc666110-1f0b-49c1-8b2f-a42d6e4f35e5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:24.498983 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f69ade-97b3-47f4-8669-e6ee6e36d74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:24.499657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f69ade-97b3-47f4-8669-e6ee6e36d74b None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:24.499940 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f69ade-97b3-47f4-8669-e6ee6e36d74b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:24.500217 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f69ade-97b3-47f4-8669-e6ee6e36d74b None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:24.500930 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f69ade-97b3-47f4-8669-e6ee6e36d74b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:24.502379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f69ade-97b3-47f4-8669-e6ee6e36d74b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:24.599743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 41/83] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:15:24.600601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc666110-1f0b-49c1-8b2f-a42d6e4f35e5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:24.637010 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 43/84] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:15:24 2022] POST /identity/v3/users => generated 289 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:15:24.638089 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f69ade-97b3-47f4-8669-e6ee6e36d74b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:24.651237 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:24.680082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:24.719941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc666110-1f0b-49c1-8b2f-a42d6e4f35e5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:24.761742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3dffc-d99e-4a48-b6c5-eea7c6ff7ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:24.762099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f69ade-97b3-47f4-8669-e6ee6e36d74b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:24.763012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3dffc-d99e-4a48-b6c5-eea7c6ff7ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:24.763453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3dffc-d99e-4a48-b6c5-eea7c6ff7ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:24.763934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc3dffc-d99e-4a48-b6c5-eea7c6ff7ce0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:24.808897 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f2893-0b9a-4b2e-9448-0e5f000e4f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:24.809566 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f2893-0b9a-4b2e-9448-0e5f000e4f9b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:24.809860 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f2893-0b9a-4b2e-9448-0e5f000e4f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:24.810142 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f2893-0b9a-4b2e-9448-0e5f000e4f9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:24.847316 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3dffc-d99e-4a48-b6c5-eea7c6ff7ce0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:24.848795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc3dffc-d99e-4a48-b6c5-eea7c6ff7ce0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:24.895850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f2893-0b9a-4b2e-9448-0e5f000e4f9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:24.897311 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f2893-0b9a-4b2e-9448-0e5f000e4f9b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:24.912321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:24.934424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:24.987669 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 42/85] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 387 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:15:24.988576 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3dffc-d99e-4a48-b6c5-eea7c6ff7ce0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:25.030862 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 44/86] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:15:25.032417 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f2893-0b9a-4b2e-9448-0e5f000e4f9b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:25.122458 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc3dffc-d99e-4a48-b6c5-eea7c6ff7ce0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:25.157519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f2893-0b9a-4b2e-9448-0e5f000e4f9b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:25.176856 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148265c-8d38-4d79-9a6b-e85093eb873f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:25.177882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148265c-8d38-4d79-9a6b-e85093eb873f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:25.178335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148265c-8d38-4d79-9a6b-e85093eb873f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:25.179105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3148265c-8d38-4d79-9a6b-e85093eb873f None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:25.180493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148265c-8d38-4d79-9a6b-e85093eb873f None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:25.180964 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148265c-8d38-4d79-9a6b-e85093eb873f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:25.182528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3148265c-8d38-4d79-9a6b-e85093eb873f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:25.191573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:25.196856 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 43/87] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:25.198185 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148265c-8d38-4d79-9a6b-e85093eb873f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:25.200528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aaf7b-48c5-4b96-9329-48df45e3f57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:25.201559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aaf7b-48c5-4b96-9329-48df45e3f57f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:25.201795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aaf7b-48c5-4b96-9329-48df45e3f57f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:25.205497 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2aaf7b-48c5-4b96-9329-48df45e3f57f None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:25.205497 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2aaf7b-48c5-4b96-9329-48df45e3f57f None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:25.205497 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2aaf7b-48c5-4b96-9329-48df45e3f57f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:25.207581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 45/88] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:25 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:25.208464 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aaf7b-48c5-4b96-9329-48df45e3f57f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:25.210059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:25.332780 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3148265c-8d38-4d79-9a6b-e85093eb873f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:25.343497 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2aaf7b-48c5-4b96-9329-48df45e3f57f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:25.369312 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38558de-5605-4e5d-9bfe-299e9ee48810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:25.370300 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38558de-5605-4e5d-9bfe-299e9ee48810 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:25.370651 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38558de-5605-4e5d-9bfe-299e9ee48810 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:25.371032 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38558de-5605-4e5d-9bfe-299e9ee48810 None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:25.372361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38558de-5605-4e5d-9bfe-299e9ee48810 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:25.373918 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38558de-5605-4e5d-9bfe-299e9ee48810 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:25.375773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 44/89] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:25 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:25.382465 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38558de-5605-4e5d-9bfe-299e9ee48810 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:25.391983 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2ebf2-7b93-4e9e-b779-f3dcecb932f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:25.394190 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2ebf2-7b93-4e9e-b779-f3dcecb932f3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:25.394904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2ebf2-7b93-4e9e-b779-f3dcecb932f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:25.395320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f2ebf2-7b93-4e9e-b779-f3dcecb932f3 None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:25.397284 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2ebf2-7b93-4e9e-b779-f3dcecb932f3 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:25.399584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f2ebf2-7b93-4e9e-b779-f3dcecb932f3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:25.402511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 46/90] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:25 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:25.403661 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2ebf2-7b93-4e9e-b779-f3dcecb932f3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:25.470642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:25.480617 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:25.498166 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38558de-5605-4e5d-9bfe-299e9ee48810 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:25.522363 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f2ebf2-7b93-4e9e-b779-f3dcecb932f3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:25.537722 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93791aee-8fc8-44f5-a5db-406f2bc0cddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:25.538865 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93791aee-8fc8-44f5-a5db-406f2bc0cddb None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:25.539219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93791aee-8fc8-44f5-a5db-406f2bc0cddb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:25.539564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93791aee-8fc8-44f5-a5db-406f2bc0cddb None admin] PATH_INFO: `/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:25.540900 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93791aee-8fc8-44f5-a5db-406f2bc0cddb None admin] RBAC: Authorizing `identity:get_user(user_id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:25.542659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93791aee-8fc8-44f5-a5db-406f2bc0cddb None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:25.544717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 45/91] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:25 2022] GET /identity/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8 => generated 275 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:25.545643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93791aee-8fc8-44f5-a5db-406f2bc0cddb None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:25.564093 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05d094-bb00-4687-b1ed-1a866ce4fb9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:25.565013 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05d094-bb00-4687-b1ed-1a866ce4fb9f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:25.565970 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05d094-bb00-4687-b1ed-1a866ce4fb9f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:25.566390 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05d094-bb00-4687-b1ed-1a866ce4fb9f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:25.567426 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05d094-bb00-4687-b1ed-1a866ce4fb9f None admin] RBAC: Adding query filter params (role.id=5d20b549441d429db11d5e91f3825e86, scope.project.id=3c0917f4477b4c16bde98021e0a84078, user.id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:25.567878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05d094-bb00-4687-b1ed-1a866ce4fb9f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:25.569621 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05d094-bb00-4687-b1ed-1a866ce4fb9f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:25.575938 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 47/92] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:25 2022] GET /identity/v3/role_assignments?user.id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8&scope.project.id=3c0917f4477b4c16bde98021e0a84078&role.id=5d20b549441d429db11d5e91f3825e86 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:25.577016 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05d094-bb00-4687-b1ed-1a866ce4fb9f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:25.666252 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93791aee-8fc8-44f5-a5db-406f2bc0cddb None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:25.685842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05d094-bb00-4687-b1ed-1a866ce4fb9f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:25.706724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87884a-42fb-4ba4-bbef-0608ffa3c16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:25.707423 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87884a-42fb-4ba4-bbef-0608ffa3c16e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:25.707712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87884a-42fb-4ba4-bbef-0608ffa3c16e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:25.707992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87884a-42fb-4ba4-bbef-0608ffa3c16e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:25.708923 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87884a-42fb-4ba4-bbef-0608ffa3c16e None admin] RBAC: Adding query filter params (role.id=a1dd99d822514511a82daa669061e683, scope.project.id=3c0917f4477b4c16bde98021e0a84078, user.id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:25.709578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87884a-42fb-4ba4-bbef-0608ffa3c16e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:25.710883 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd87884a-42fb-4ba4-bbef-0608ffa3c16e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:25.716868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:25.718531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 46/93] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:25 2022] GET /identity/v3/role_assignments?user.id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8&scope.project.id=3c0917f4477b4c16bde98021e0a84078&role.id=a1dd99d822514511a82daa669061e683 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:25.723671 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87884a-42fb-4ba4-bbef-0608ffa3c16e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:25.726872 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855551c5-3e47-4efa-aef7-f88b08700ab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:25.727757 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855551c5-3e47-4efa-aef7-f88b08700ab5 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:25.728187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855551c5-3e47-4efa-aef7-f88b08700ab5 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:25.728633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855551c5-3e47-4efa-aef7-f88b08700ab5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:25.729640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855551c5-3e47-4efa-aef7-f88b08700ab5 None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=3c0917f4477b4c16bde98021e0a84078, user.id=62e1112a8ecc4f798b846400813fbbe0) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:25.730098 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855551c5-3e47-4efa-aef7-f88b08700ab5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:25.731750 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855551c5-3e47-4efa-aef7-f88b08700ab5 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:25.736432 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:25.739149 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 48/94] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:25 2022] GET /identity/v3/role_assignments?user.id=62e1112a8ecc4f798b846400813fbbe0&scope.project.id=3c0917f4477b4c16bde98021e0a84078&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:25.886642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd87884a-42fb-4ba4-bbef-0608ffa3c16e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:25.929076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb13fd-4f75-4574-803d-ecaa3aaee3fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:25.929758 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb13fd-4f75-4574-803d-ecaa3aaee3fa None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:25.930046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb13fd-4f75-4574-803d-ecaa3aaee3fa None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:25.930330 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcb13fd-4f75-4574-803d-ecaa3aaee3fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:26.015824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb13fd-4f75-4574-803d-ecaa3aaee3fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:26.017246 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dcb13fd-4f75-4574-803d-ecaa3aaee3fa None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:26.026816 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:26.130569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 47/95] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:15:26.135831 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855551c5-3e47-4efa-aef7-f88b08700ab5 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:26.254731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855551c5-3e47-4efa-aef7-f88b08700ab5 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:26.296733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ea2ef-9ab0-405c-9685-80f1f8fbd2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:26.297988 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ea2ef-9ab0-405c-9685-80f1f8fbd2aa None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:26.298490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ea2ef-9ab0-405c-9685-80f1f8fbd2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:26.298996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ea2ef-9ab0-405c-9685-80f1f8fbd2aa None admin] PATH_INFO: `/v3/projects/86252f6e16a84baf8b191fcdb0b76b18` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:26.301369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ea2ef-9ab0-405c-9685-80f1f8fbd2aa None admin] RBAC: Authorizing `identity:get_project(project_id=86252f6e16a84baf8b191fcdb0b76b18)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:26.303039 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ea2ef-9ab0-405c-9685-80f1f8fbd2aa None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:26.304975 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 49/96] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:26 2022] GET /identity/v3/projects/86252f6e16a84baf8b191fcdb0b76b18 => generated 312 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:26.311198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb13fd-4f75-4574-803d-ecaa3aaee3fa None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:26.462210 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dcb13fd-4f75-4574-803d-ecaa3aaee3fa None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:26.474439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:26.507650 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c90fe5-b31b-4619-8997-35498adbb879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:26.508319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c90fe5-b31b-4619-8997-35498adbb879 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:26.511139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c90fe5-b31b-4619-8997-35498adbb879 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:26.511435 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c90fe5-b31b-4619-8997-35498adbb879 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:26.512299 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c90fe5-b31b-4619-8997-35498adbb879 None admin] RBAC: Adding query filter params (role.id=5d20b549441d429db11d5e91f3825e86, scope.project.id=86252f6e16a84baf8b191fcdb0b76b18, user.id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:26.512619 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c90fe5-b31b-4619-8997-35498adbb879 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:26.514102 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89c90fe5-b31b-4619-8997-35498adbb879 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:26.520875 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 48/97] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:26 2022] GET /identity/v3/role_assignments?user.id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8&scope.project.id=86252f6e16a84baf8b191fcdb0b76b18&role.id=5d20b549441d429db11d5e91f3825e86 => generated 259 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:27.303414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c7967-2ff7-4c5b-8226-83d7dde0921f None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:27.303922 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c7967-2ff7-4c5b-8226-83d7dde0921f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:27.304232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89c7967-2ff7-4c5b-8226-83d7dde0921f None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:27.305841 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 50/98] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:27.311344 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc98e2-1541-4217-ba6c-d5a4a011c13e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:27.311786 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc98e2-1541-4217-ba6c-d5a4a011c13e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:27.311955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73cc98e2-1541-4217-ba6c-d5a4a011c13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:27.343871 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-73cc98e2-1541-4217-ba6c-d5a4a011c13e None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:27.345003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-73cc98e2-1541-4217-ba6c-d5a4a011c13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:27.387190 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b3e1c-7191-438e-b05a-db131ec543c9 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:27.387820 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b3e1c-7191-438e-b05a-db131ec543c9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:27.388290 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b3e1c-7191-438e-b05a-db131ec543c9 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:27.390897 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 51/99] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:27.395837 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fc202-d625-4ce5-965f-e7abada89978 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:27.396394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fc202-d625-4ce5-965f-e7abada89978 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:27.396866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272fc202-d625-4ce5-965f-e7abada89978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:27.428680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-272fc202-d625-4ce5-965f-e7abada89978 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:27.430377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-272fc202-d625-4ce5-965f-e7abada89978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:27.461070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 49/100] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:27.493598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc98e2-1541-4217-ba6c-d5a4a011c13e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:27.534857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:27.555652 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 52/101] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:27.592205 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fc202-d625-4ce5-965f-e7abada89978 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:27.679773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:27.691138 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73cc98e2-1541-4217-ba6c-d5a4a011c13e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:27.816668 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b283e-f99e-4901-b0ef-22b06e52a7f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:27.817538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b283e-f99e-4901-b0ef-22b06e52a7f7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:27.817825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b283e-f99e-4901-b0ef-22b06e52a7f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:27.818104 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b7b283e-f99e-4901-b0ef-22b06e52a7f7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:27.820882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272fc202-d625-4ce5-965f-e7abada89978 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:27.855275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b7b283e-f99e-4901-b0ef-22b06e52a7f7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:27.871779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-3b7b283e-f99e-4901-b0ef-22b06e52a7f7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:27.871779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:27.871779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:27.871779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:27.871779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:27.871779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:27.871779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:27.871779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:27.871779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:27.871779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:27.871779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:27.871779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:27.871779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:27.871779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:27.871779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:27.871779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:27.872675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:27.872675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:27.872675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:27.872675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:27.872675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:27.872675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:27.872675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:27.872675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:27.872675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:27.872675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:27.872675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:27.872675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:27.872675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:27.872675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:27.872675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:27.872675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:27.873454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:27.873454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:27.873454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:27.873454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:27.873454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:27.873454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:27.873454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:27.873454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:27.873454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:27.873454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:27.873454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:27.873454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:27.873454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 50/102] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:27 2022] GET /identity/v3/roles/reader => generated 84 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:15:27.883720 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b283e-f99e-4901-b0ef-22b06e52a7f7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:27.895521 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a91278-b285-4182-a281-6f70c796e442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:27.896324 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a91278-b285-4182-a281-6f70c796e442 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:27.896608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a91278-b285-4182-a281-6f70c796e442 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:27.896886 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a91278-b285-4182-a281-6f70c796e442 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:27.898136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a91278-b285-4182-a281-6f70c796e442 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:27.899630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a91278-b285-4182-a281-6f70c796e442 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:27.901411 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 53/103] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:15:27 2022] GET /identity/v3/domains/default => generated 199 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:27.912408 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a91278-b285-4182-a281-6f70c796e442 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:28.020851 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:28.110317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a91278-b285-4182-a281-6f70c796e442 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:28.180038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164318d9-a939-44e9-b4bf-e667c093459d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:28.180740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164318d9-a939-44e9-b4bf-e667c093459d None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:28.181023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164318d9-a939-44e9-b4bf-e667c093459d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:28.181300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-164318d9-a939-44e9-b4bf-e667c093459d None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:28.182042 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164318d9-a939-44e9-b4bf-e667c093459d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:28.183567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-164318d9-a939-44e9-b4bf-e667c093459d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:28.197064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b7b283e-f99e-4901-b0ef-22b06e52a7f7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:28.268943 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df35b5-471e-4333-969f-efa3d4e9460d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:28.269994 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df35b5-471e-4333-969f-efa3d4e9460d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:28.270285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df35b5-471e-4333-969f-efa3d4e9460d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:28.270570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1df35b5-471e-4333-969f-efa3d4e9460d None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:28.271435 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df35b5-471e-4333-969f-efa3d4e9460d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:28.271701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df35b5-471e-4333-969f-efa3d4e9460d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:28.273109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1df35b5-471e-4333-969f-efa3d4e9460d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:28.289412 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 54/104] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Jul 15 19:15:27 2022] POST /identity/v3/projects => generated 302 bytes in 377 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:15:28.291748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 51/105] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:27 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 411 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:28.297206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164318d9-a939-44e9-b4bf-e667c093459d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:28.420883 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-164318d9-a939-44e9-b4bf-e667c093459d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:28.432346 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:28.458408 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8ea01f-f1a7-4275-92fb-ebda8a5b1080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:28.459346 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ea01f-f1a7-4275-92fb-ebda8a5b1080 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:28.459631 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ea01f-f1a7-4275-92fb-ebda8a5b1080 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:28.459908 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8ea01f-f1a7-4275-92fb-ebda8a5b1080 None admin] PATH_INFO: `/v3/users/551bc06b95cd44708730a010b97d14ac` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:28.475312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ea01f-f1a7-4275-92fb-ebda8a5b1080 None admin] RBAC: Authorizing `identity:get_user(user_id=551bc06b95cd44708730a010b97d14ac)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:28.476888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8ea01f-f1a7-4275-92fb-ebda8a5b1080 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:28.478693 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 55/106] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:28 2022] GET /identity/v3/users/551bc06b95cd44708730a010b97d14ac => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:28.484503 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df35b5-471e-4333-969f-efa3d4e9460d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:28.534280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:28.646050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1df35b5-471e-4333-969f-efa3d4e9460d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:28.698232 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26fec8-b39d-4567-9196-d98f6f765929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:28.699313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26fec8-b39d-4567-9196-d98f6f765929 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:28.699807 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26fec8-b39d-4567-9196-d98f6f765929 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:28.700275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e26fec8-b39d-4567-9196-d98f6f765929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:28.817421 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26fec8-b39d-4567-9196-d98f6f765929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:28.819252 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e26fec8-b39d-4567-9196-d98f6f765929 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:28.852857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:28.880414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf612a-a783-4fa1-a7a4-1f09ac47479d None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:28.881164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf612a-a783-4fa1-a7a4-1f09ac47479d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:28.881643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaf612a-a783-4fa1-a7a4-1f09ac47479d None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:28.883358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 56/107] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:28.892208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a728c-d838-4161-8d27-5eda1587ef4b None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:28.892816 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a728c-d838-4161-8d27-5eda1587ef4b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:28.893813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99a728c-d838-4161-8d27-5eda1587ef4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:28.927016 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c99a728c-d838-4161-8d27-5eda1587ef4b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:28.928624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c99a728c-d838-4161-8d27-5eda1587ef4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:28.942424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 52/108] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:15:28.948107 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26fec8-b39d-4567-9196-d98f6f765929 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:29.041101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 57/109] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:29.043063 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedaafa-8c40-4087-8400-3198a47846c1 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:29.043561 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedaafa-8c40-4087-8400-3198a47846c1 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:29.044108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceedaafa-8c40-4087-8400-3198a47846c1 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:29.045724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 58/110] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:29.047344 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9633c-02ef-46a5-8301-1794c2391118 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:29.047842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9633c-02ef-46a5-8301-1794c2391118 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:29.048315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb9633c-02ef-46a5-8301-1794c2391118 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:29.049986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 59/111] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:29.055693 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2706e-74da-4f77-a7c7-918252e4ef33 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:29.056226 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2706e-74da-4f77-a7c7-918252e4ef33 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:29.056700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d2706e-74da-4f77-a7c7-918252e4ef33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:29.075462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e26fec8-b39d-4567-9196-d98f6f765929 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:29.075975 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-83d2706e-74da-4f77-a7c7-918252e4ef33 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:29.077270 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-83d2706e-74da-4f77-a7c7-918252e4ef33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:29.102095 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:29.115623 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f40746-587c-4885-a672-75ada5f56a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:29.116751 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f40746-587c-4885-a672-75ada5f56a1a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:29.118417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f40746-587c-4885-a672-75ada5f56a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:29.118417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f40746-587c-4885-a672-75ada5f56a1a None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:29.119288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f40746-587c-4885-a672-75ada5f56a1a None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:29.121027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f40746-587c-4885-a672-75ada5f56a1a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:29.123113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 53/112] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:28 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:29.124701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a82fd-4422-489e-8598-4568cfa2b3d2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:29.125212 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a82fd-4422-489e-8598-4568cfa2b3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:29.125688 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581a82fd-4422-489e-8598-4568cfa2b3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:29.145536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-581a82fd-4422-489e-8598-4568cfa2b3d2 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:29.147146 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-581a82fd-4422-489e-8598-4568cfa2b3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:29.153095 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 60/113] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:29.154037 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2706e-74da-4f77-a7c7-918252e4ef33 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:29.185625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:29.225277 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 54/114] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:29.226554 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a82fd-4422-489e-8598-4568cfa2b3d2 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:29.290645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d2706e-74da-4f77-a7c7-918252e4ef33 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:29.328988 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c78bf-4d45-4dfe-9ef7-3c09867876a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:29.329885 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c78bf-4d45-4dfe-9ef7-3c09867876a7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:29.330177 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c78bf-4d45-4dfe-9ef7-3c09867876a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:29.330776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-812c78bf-4d45-4dfe-9ef7-3c09867876a7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:29.341252 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581a82fd-4422-489e-8598-4568cfa2b3d2 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:29.342586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-812c78bf-4d45-4dfe-9ef7-3c09867876a7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:29.351302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-812c78bf-4d45-4dfe-9ef7-3c09867876a7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:29.351302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:29.351302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:29.351302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:29.351302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:29.351302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:29.351302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:29.351302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:29.351302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:29.351302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:29.351302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:29.351302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:29.351302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:29.351302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:29.351302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:29.351302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:29.352201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:29.352201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:29.352201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:29.352201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:29.352201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:29.352201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:29.352201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:29.352201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:29.352201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:29.352201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:29.352201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:29.352201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:29.352201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:29.352201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:29.352201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:29.352201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:29.353038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:29.353038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:29.353038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:29.353038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:29.353038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:29.353038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:29.353038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:29.353038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:29.353038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:29.353038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:29.353038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:29.353038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:29.353038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 61/115] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:15:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:29.353685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c78bf-4d45-4dfe-9ef7-3c09867876a7 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:29.369209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:29.386361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd5b52-27a7-4bb6-b32b-27c230c2ad6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:29.387434 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd5b52-27a7-4bb6-b32b-27c230c2ad6a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:29.387960 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd5b52-27a7-4bb6-b32b-27c230c2ad6a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:29.388441 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd5b52-27a7-4bb6-b32b-27c230c2ad6a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:29.389646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd5b52-27a7-4bb6-b32b-27c230c2ad6a None admin] RBAC: Adding query filter params (role.id=5ef1e825011442a2b31c10b82ae1b427, scope.project.id=3c0917f4477b4c16bde98021e0a84078, user.id=551bc06b95cd44708730a010b97d14ac) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:29.390229 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd5b52-27a7-4bb6-b32b-27c230c2ad6a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:29.391982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd5b52-27a7-4bb6-b32b-27c230c2ad6a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:29.400646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 55/116] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:29 2022] GET /identity/v3/role_assignments?user.id=551bc06b95cd44708730a010b97d14ac&scope.project.id=3c0917f4477b4c16bde98021e0a84078&role.id=5ef1e825011442a2b31c10b82ae1b427 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:29.401920 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd5b52-27a7-4bb6-b32b-27c230c2ad6a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:29.457051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:29.476026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-812c78bf-4d45-4dfe-9ef7-3c09867876a7 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:29.519945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0745c7-bd2c-4052-ab6b-7816fc291f25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:29.520771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0745c7-bd2c-4052-ab6b-7816fc291f25 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:29.521113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0745c7-bd2c-4052-ab6b-7816fc291f25 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:29.521396 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0745c7-bd2c-4052-ab6b-7816fc291f25 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:29.534790 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0745c7-bd2c-4052-ab6b-7816fc291f25 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:29.543111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-dc0745c7-bd2c-4052-ab6b-7816fc291f25 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:29.543111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:29.543111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:29.543111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:29.543111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:29.543111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:29.543111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:29.543111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:29.543111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:29.543111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:29.543111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:29.543111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:29.543111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:29.543111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:29.543111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:29.543111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:29.544052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:29.544052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:29.544052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:29.544052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:29.544052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:29.544052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:29.544052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:29.544052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:29.544052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:29.544052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:29.544052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:29.544052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:29.544052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:29.544052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:29.544052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:29.544052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:29.544804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:29.544804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:29.544804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:29.544804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:29.544804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:29.544804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:29.544804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:29.544804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:29.544804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:29.544804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:29.544804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:29.544804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:29.544804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 62/117] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:29.546242 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0745c7-bd2c-4052-ab6b-7816fc291f25 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:29.552246 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd5b52-27a7-4bb6-b32b-27c230c2ad6a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:29.603405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168461c-d163-43c9-8cd8-48c4055cfd01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:29.604144 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168461c-d163-43c9-8cd8-48c4055cfd01 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:29.604431 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168461c-d163-43c9-8cd8-48c4055cfd01 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:29.604739 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168461c-d163-43c9-8cd8-48c4055cfd01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:29.617024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6168461c-d163-43c9-8cd8-48c4055cfd01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:29.625621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-6168461c-d163-43c9-8cd8-48c4055cfd01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:15:29.625621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:29.625621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:29.625621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:29.625621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:29.625621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:29.625621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:29.625621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:29.625621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:29.625621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:29.625621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:29.625621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:29.625621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:29.625621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:29.625621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:29.625621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:29.626558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:29.626558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:29.626558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:29.626558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:29.626558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:29.626558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:29.626558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:29.626558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:29.626558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:29.626558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:29.626558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:29.626558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:29.626558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:29.626558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:29.626558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:29.626558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:29.627467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:29.627467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:29.627467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:29.627467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:29.627467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:29.627467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:29.627467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:29.627467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:29.627467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:29.627467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:29.627467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:15:29.627467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:29.627467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 56/118] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:15:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:29.629192 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3f327-3efe-445f-b565-07adfd93f7d1 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:29.629487 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3f327-3efe-445f-b565-07adfd93f7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:29.629771 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba3f327-3efe-445f-b565-07adfd93f7d1 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:29.631423 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 57/119] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:29.631849 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3f327-3efe-445f-b565-07adfd93f7d1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:29.689072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0745c7-bd2c-4052-ab6b-7816fc291f25 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:29.719253 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:29.735937 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73839fd-6fff-4b2e-859e-d6abe44d6ebd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:29.737912 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73839fd-6fff-4b2e-859e-d6abe44d6ebd None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:29.738437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73839fd-6fff-4b2e-859e-d6abe44d6ebd None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:29.738943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73839fd-6fff-4b2e-859e-d6abe44d6ebd None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:29.740149 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73839fd-6fff-4b2e-859e-d6abe44d6ebd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:29.740979 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73839fd-6fff-4b2e-859e-d6abe44d6ebd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:29.743232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73839fd-6fff-4b2e-859e-d6abe44d6ebd None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:29.756477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 63/120] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:29.757340 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73839fd-6fff-4b2e-859e-d6abe44d6ebd None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:29.773896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba3f327-3efe-445f-b565-07adfd93f7d1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:29.779814 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:29.812616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a73856-b95f-4357-a261-2f95a9116a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:29.813739 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a73856-b95f-4357-a261-2f95a9116a2f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:29.813739 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a73856-b95f-4357-a261-2f95a9116a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:29.813903 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a73856-b95f-4357-a261-2f95a9116a2f None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:29.814667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a73856-b95f-4357-a261-2f95a9116a2f None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:29.815244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a73856-b95f-4357-a261-2f95a9116a2f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:29.817500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a73856-b95f-4357-a261-2f95a9116a2f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:29.827472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 58/121] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:29.832362 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7f33f-69b3-4144-96f7-78e9fc46c87b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:29.832658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7f33f-69b3-4144-96f7-78e9fc46c87b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:29.832966 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7f33f-69b3-4144-96f7-78e9fc46c87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:29.856041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d4b7f33f-69b3-4144-96f7-78e9fc46c87b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:29.857265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d4b7f33f-69b3-4144-96f7-78e9fc46c87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:29.902107 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73839fd-6fff-4b2e-859e-d6abe44d6ebd None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:29.938591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 59/122] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:29.939527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7f33f-69b3-4144-96f7-78e9fc46c87b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:29.948047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1b770-0686-446f-ac5c-33b31c407145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:29.949479 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1b770-0686-446f-ac5c-33b31c407145 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:29.949964 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1b770-0686-446f-ac5c-33b31c407145 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:29.950462 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e1b770-0686-446f-ac5c-33b31c407145 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:29.951896 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1b770-0686-446f-ac5c-33b31c407145 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:29.952406 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1b770-0686-446f-ac5c-33b31c407145 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:29.954642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e1b770-0686-446f-ac5c-33b31c407145 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:29.965709 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 64/123] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:15:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:29.967110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1b770-0686-446f-ac5c-33b31c407145 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:29.978942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:30.053783 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:30.086868 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7f33f-69b3-4144-96f7-78e9fc46c87b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:30.093860 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e1b770-0686-446f-ac5c-33b31c407145 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:30.131599 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d033e07-410d-4bfa-90c1-523ba185b402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:30.132440 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d033e07-410d-4bfa-90c1-523ba185b402 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:30.132729 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d033e07-410d-4bfa-90c1-523ba185b402 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:30.133009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d033e07-410d-4bfa-90c1-523ba185b402 None admin] PATH_INFO: `/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:30.134237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d033e07-410d-4bfa-90c1-523ba185b402 None admin] RBAC: Authorizing `identity:get_user(user_id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:30.135731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d033e07-410d-4bfa-90c1-523ba185b402 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:30.136003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e68a19-9731-4baa-be42-ad9abe447baf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:30.137135 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e68a19-9731-4baa-be42-ad9abe447baf None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:30.137441 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 65/124] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:29 2022] GET /identity/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:30.137823 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e68a19-9731-4baa-be42-ad9abe447baf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:30.138222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d033e07-410d-4bfa-90c1-523ba185b402 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:30.138564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e68a19-9731-4baa-be42-ad9abe447baf None admin] PATH_INFO: `/v3/users/62e1112a8ecc4f798b846400813fbbe0` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:30.140040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e68a19-9731-4baa-be42-ad9abe447baf None admin] RBAC: Authorizing `identity:get_user(user_id=62e1112a8ecc4f798b846400813fbbe0)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:30.141757 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e68a19-9731-4baa-be42-ad9abe447baf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:30.144793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 60/125] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:29 2022] GET /identity/v3/users/62e1112a8ecc4f798b846400813fbbe0 => generated 247 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:30.145916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e68a19-9731-4baa-be42-ad9abe447baf None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:30.255940 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d033e07-410d-4bfa-90c1-523ba185b402 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:30.277420 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e68a19-9731-4baa-be42-ad9abe447baf None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:30.290152 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:30.293341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038be1f5-c7f2-474c-9c5a-af241035dc9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:30.294242 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038be1f5-c7f2-474c-9c5a-af241035dc9e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:30.294533 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038be1f5-c7f2-474c-9c5a-af241035dc9e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:30.294853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038be1f5-c7f2-474c-9c5a-af241035dc9e None admin] PATH_INFO: `/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:30.296076 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038be1f5-c7f2-474c-9c5a-af241035dc9e None admin] RBAC: Authorizing `identity:get_user(user_id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:30.297595 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038be1f5-c7f2-474c-9c5a-af241035dc9e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:30.300304 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 66/126] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:30 2022] GET /identity/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:30.307607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038be1f5-c7f2-474c-9c5a-af241035dc9e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:30.318443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:30.336238 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22539138-5c90-4c89-9254-2675d12b69d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:30.337069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22539138-5c90-4c89-9254-2675d12b69d0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:30.337349 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22539138-5c90-4c89-9254-2675d12b69d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:30.337654 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22539138-5c90-4c89-9254-2675d12b69d0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:30.349834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22539138-5c90-4c89-9254-2675d12b69d0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:30.358315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-22539138-5c90-4c89-9254-2675d12b69d0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:30.358315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:30.358315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:30.358315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:30.358315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:30.358315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:30.358315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:30.358315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:30.358315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:30.358315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:30.358315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:30.358315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:30.358315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:30.358315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:30.358315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:30.358315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:30.359272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:30.359272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:30.359272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:30.359272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:30.359272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:30.359272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:30.359272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:30.359272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:30.359272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:30.359272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:30.359272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:30.359272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:30.359272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:30.359272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:30.359272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:30.359272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:30.360060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:30.360060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:30.360060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:30.360060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:30.360060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:30.360060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:30.360060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:30.360060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:30.360060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:30.360060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:30.360060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:30.360060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:30.360060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 61/127] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:30.360691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22539138-5c90-4c89-9254-2675d12b69d0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:30.430227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038be1f5-c7f2-474c-9c5a-af241035dc9e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:30.469318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac44240-645c-41ea-9c3d-44fb2b87a814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:30.470455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac44240-645c-41ea-9c3d-44fb2b87a814 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:30.470991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac44240-645c-41ea-9c3d-44fb2b87a814 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:30.471449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac44240-645c-41ea-9c3d-44fb2b87a814 None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:30.472994 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac44240-645c-41ea-9c3d-44fb2b87a814 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:30.474624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac44240-645c-41ea-9c3d-44fb2b87a814 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:30.476704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 67/128] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:30 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:30.482502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac44240-645c-41ea-9c3d-44fb2b87a814 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:30.496783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22539138-5c90-4c89-9254-2675d12b69d0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:30.544086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80e5a4-9943-424a-95a2-9483583db70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:30.545482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e5a4-9943-424a-95a2-9483583db70d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:30.546182 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e5a4-9943-424a-95a2-9483583db70d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:30.546634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f80e5a4-9943-424a-95a2-9483583db70d None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:30.548634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80e5a4-9943-424a-95a2-9483583db70d None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:30.551500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f80e5a4-9943-424a-95a2-9483583db70d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:30.554546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 62/129] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:30 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:30.556077 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80e5a4-9943-424a-95a2-9483583db70d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:30.577789 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:30.599570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:30.613345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac44240-645c-41ea-9c3d-44fb2b87a814 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:30.660287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a2cd1-e684-4b84-ab4b-289066d9d3b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:30.661944 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a2cd1-e684-4b84-ab4b-289066d9d3b6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:30.662500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a2cd1-e684-4b84-ab4b-289066d9d3b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:30.662945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602a2cd1-e684-4b84-ab4b-289066d9d3b6 None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:30.664420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a2cd1-e684-4b84-ab4b-289066d9d3b6 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:30.666589 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602a2cd1-e684-4b84-ab4b-289066d9d3b6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:30.669270 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 68/130] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:30 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:30.670455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a2cd1-e684-4b84-ab4b-289066d9d3b6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:30.677161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f80e5a4-9943-424a-95a2-9483583db70d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:30.725218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052401fb-4c2e-4cb0-a6f0-d75edca7f59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:30.725218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052401fb-4c2e-4cb0-a6f0-d75edca7f59e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:30.725218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052401fb-4c2e-4cb0-a6f0-d75edca7f59e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:30.725218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052401fb-4c2e-4cb0-a6f0-d75edca7f59e None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:30.725606 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052401fb-4c2e-4cb0-a6f0-d75edca7f59e None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:30.725606 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052401fb-4c2e-4cb0-a6f0-d75edca7f59e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:30.725606 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-052401fb-4c2e-4cb0-a6f0-d75edca7f59e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:30.733440 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 63/131] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:30.734253 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052401fb-4c2e-4cb0-a6f0-d75edca7f59e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:30.790703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602a2cd1-e684-4b84-ab4b-289066d9d3b6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:30.826950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae263372-dca9-40b6-9804-2c3086989850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:30.828219 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae263372-dca9-40b6-9804-2c3086989850 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:30.828756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae263372-dca9-40b6-9804-2c3086989850 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:30.829226 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae263372-dca9-40b6-9804-2c3086989850 None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:30.831608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae263372-dca9-40b6-9804-2c3086989850 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0917f4477b4c16bde98021e0a84078, user_id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:30.833326 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae263372-dca9-40b6-9804-2c3086989850 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:30.835871 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:30.843208 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052401fb-4c2e-4cb0-a6f0-d75edca7f59e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:30.879256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb14f12-e0a0-49c8-9f13-4265e1b890c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:30.880136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb14f12-e0a0-49c8-9f13-4265e1b890c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:30.880427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb14f12-e0a0-49c8-9f13-4265e1b890c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:30.880713 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecb14f12-e0a0-49c8-9f13-4265e1b890c9 None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078/users/62e1112a8ecc4f798b846400813fbbe0/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:30.882729 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb14f12-e0a0-49c8-9f13-4265e1b890c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0917f4477b4c16bde98021e0a84078, user_id=62e1112a8ecc4f798b846400813fbbe0, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:30.884247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecb14f12-e0a0-49c8-9f13-4265e1b890c9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:30.899038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 69/132] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:15:30 2022] PUT /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:15:30.900274 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae263372-dca9-40b6-9804-2c3086989850 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:30.908283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:30.970959 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 64/133] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:15:30 2022] PUT /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078/users/62e1112a8ecc4f798b846400813fbbe0/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:15:30.970959 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb14f12-e0a0-49c8-9f13-4265e1b890c9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:31.090481 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae263372-dca9-40b6-9804-2c3086989850 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:31.144969 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238302b5-7fa6-4204-9589-d3a667e28f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:31.145905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238302b5-7fa6-4204-9589-d3a667e28f81 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:31.146195 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238302b5-7fa6-4204-9589-d3a667e28f81 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:31.147006 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238302b5-7fa6-4204-9589-d3a667e28f81 None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8/roles/a1dd99d822514511a82daa669061e683` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:31.149184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238302b5-7fa6-4204-9589-d3a667e28f81 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0917f4477b4c16bde98021e0a84078, user_id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8, role_id=a1dd99d822514511a82daa669061e683)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:31.150678 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238302b5-7fa6-4204-9589-d3a667e28f81 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:31.189204 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecb14f12-e0a0-49c8-9f13-4265e1b890c9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:31.233626 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe47a3f-3f14-4681-9665-b36b0802992c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:31.234516 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe47a3f-3f14-4681-9665-b36b0802992c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:31.234911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe47a3f-3f14-4681-9665-b36b0802992c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:31.235196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe47a3f-3f14-4681-9665-b36b0802992c None admin] PATH_INFO: `/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:31.236442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe47a3f-3f14-4681-9665-b36b0802992c None admin] RBAC: Authorizing `identity:get_user(user_id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:31.238457 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe47a3f-3f14-4681-9665-b36b0802992c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:31.239764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 70/134] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:15:30 2022] PUT /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8/roles/a1dd99d822514511a82daa669061e683 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:15:31.240619 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 65/135] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:30 2022] GET /identity/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8 => generated 275 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:31.241857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55772c33-75be-40bf-8767-059551941bc7 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:31.242345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55772c33-75be-40bf-8767-059551941bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:31.247005 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe47a3f-3f14-4681-9665-b36b0802992c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:31.247403 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55772c33-75be-40bf-8767-059551941bc7 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:31.249312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 71/136] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:31 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:31.257480 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b729db-7b50-4c4d-b54d-b4418312787e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:31.258080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b729db-7b50-4c4d-b54d-b4418312787e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:31.259242 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b729db-7b50-4c4d-b54d-b4418312787e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:31.281904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-e1b729db-7b50-4c4d-b54d-b4418312787e None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:31.284752 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e1b729db-7b50-4c4d-b54d-b4418312787e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:31.288868 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:31.365577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:31.377156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 72/137] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:15:31.418995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b729db-7b50-4c4d-b54d-b4418312787e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:31.512802 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe47a3f-3f14-4681-9665-b36b0802992c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:31.581217 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b729db-7b50-4c4d-b54d-b4418312787e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:31.595811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393a5796-787d-4dbe-a3f3-4895f4f91ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:31.597214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a5796-787d-4dbe-a3f3-4895f4f91ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:31.597504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a5796-787d-4dbe-a3f3-4895f4f91ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:31.597785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393a5796-787d-4dbe-a3f3-4895f4f91ea1 None admin] PATH_INFO: `/v3/projects/86252f6e16a84baf8b191fcdb0b76b18` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:31.599240 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a5796-787d-4dbe-a3f3-4895f4f91ea1 None admin] RBAC: Authorizing `identity:get_project(project_id=86252f6e16a84baf8b191fcdb0b76b18)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:31.600712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-393a5796-787d-4dbe-a3f3-4895f4f91ea1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:31.602625 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 66/138] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:31 2022] GET /identity/v3/projects/86252f6e16a84baf8b191fcdb0b76b18 => generated 312 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:31.604477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63eb16-0454-445c-a580-183d11e4a766 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:31.604773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63eb16-0454-445c-a580-183d11e4a766 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:31.605058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a63eb16-0454-445c-a580-183d11e4a766 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:31.606623 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 67/139] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:31.615303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9cfe0-10c8-4710-bb78-853f7d6b15a1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:31.615645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9cfe0-10c8-4710-bb78-853f7d6b15a1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:31.615880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9cfe0-10c8-4710-bb78-853f7d6b15a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:31.636880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9ca9cfe0-10c8-4710-bb78-853f7d6b15a1 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:31.637199 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9ca9cfe0-10c8-4710-bb78-853f7d6b15a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:31.638502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56379940-b3bd-404b-b03c-d3ef4f47120d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:31.639526 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56379940-b3bd-404b-b03c-d3ef4f47120d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:31.640238 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56379940-b3bd-404b-b03c-d3ef4f47120d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:31.640689 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56379940-b3bd-404b-b03c-d3ef4f47120d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:31.643664 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56379940-b3bd-404b-b03c-d3ef4f47120d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:31.645578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56379940-b3bd-404b-b03c-d3ef4f47120d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:31.648273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 73/140] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:15:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:31.649249 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56379940-b3bd-404b-b03c-d3ef4f47120d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:31.729476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:31.751589 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 68/141] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:31.752367 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9cfe0-10c8-4710-bb78-853f7d6b15a1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:31.779724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56379940-b3bd-404b-b03c-d3ef4f47120d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:31.803092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:31.837316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148e98a-98af-4611-be9c-165402d0eade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:31.838231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148e98a-98af-4611-be9c-165402d0eade None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:31.838516 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148e98a-98af-4611-be9c-165402d0eade None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:31.838813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c148e98a-98af-4611-be9c-165402d0eade None admin] PATH_INFO: `/v3/projects/86252f6e16a84baf8b191fcdb0b76b18/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:31.848944 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148e98a-98af-4611-be9c-165402d0eade None admin] RBAC: Authorizing `identity:create_grant(project_id=86252f6e16a84baf8b191fcdb0b76b18, user_id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:31.850492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c148e98a-98af-4611-be9c-165402d0eade None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:31.918078 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9cfe0-10c8-4710-bb78-853f7d6b15a1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:31.931018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 74/142] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:15:31 2022] PUT /identity/v3/projects/86252f6e16a84baf8b191fcdb0b76b18/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:15:31.932110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148e98a-98af-4611-be9c-165402d0eade None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:32.013517 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bfd73-8752-4230-ad3d-3e672ac81351 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:32.014212 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bfd73-8752-4230-ad3d-3e672ac81351 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:32.014502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bfd73-8752-4230-ad3d-3e672ac81351 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:32.014803 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099bfd73-8752-4230-ad3d-3e672ac81351 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:32.015537 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bfd73-8752-4230-ad3d-3e672ac81351 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:32.017034 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099bfd73-8752-4230-ad3d-3e672ac81351 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:32.092060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c148e98a-98af-4611-be9c-165402d0eade None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:32.128279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:32.130103 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 69/143] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:15:31 2022] POST /identity/v3/users => generated 283 bytes in 378 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:15:32.149171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f18c6-5602-4e73-b032-54cc9c83e28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:32.150000 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f18c6-5602-4e73-b032-54cc9c83e28c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:32.150288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f18c6-5602-4e73-b032-54cc9c83e28c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:32.150570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f18c6-5602-4e73-b032-54cc9c83e28c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:32.172509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f18c6-5602-4e73-b032-54cc9c83e28c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:32.180962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-865f18c6-5602-4e73-b032-54cc9c83e28c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:32.180962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:32.180962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:32.180962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:32.180962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:32.180962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:32.180962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:32.180962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:32.180962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:32.180962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:32.180962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:32.180962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:32.180962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:32.180962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:32.180962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:32.180962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:32.181924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:32.181924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:32.181924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:32.181924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:32.181924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:32.181924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:32.181924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:32.181924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:32.181924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:32.181924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:32.181924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:32.181924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:32.181924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:32.181924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:32.181924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:32.181924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:32.183003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:32.183003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:32.183003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:32.183003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:32.183003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:32.183003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:32.183003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:32.183003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:32.183003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:32.183003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:32.183003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:32.183003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:32.183003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 75/144] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:31 2022] GET /identity/v3/roles/reader => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:32.188680 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bfd73-8752-4230-ad3d-3e672ac81351 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:32.317146 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:32.344715 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099bfd73-8752-4230-ad3d-3e672ac81351 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:32.395963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0265b-b04e-4d87-a9b9-2800d6a1dcbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:32.396715 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0265b-b04e-4d87-a9b9-2800d6a1dcbe None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:32.397004 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0265b-b04e-4d87-a9b9-2800d6a1dcbe None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:32.397279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e0265b-b04e-4d87-a9b9-2800d6a1dcbe None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:32.398065 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0265b-b04e-4d87-a9b9-2800d6a1dcbe None admin] RBAC: Adding query filter params (name=reader) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:32.398376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0265b-b04e-4d87-a9b9-2800d6a1dcbe None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:32.399877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e0265b-b04e-4d87-a9b9-2800d6a1dcbe None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:32.416237 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 70/145] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:32.422480 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f18c6-5602-4e73-b032-54cc9c83e28c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:32.575907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f18c6-5602-4e73-b032-54cc9c83e28c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:32.625549 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647939c-518c-4f31-a264-7c2544c8493b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:32.626433 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647939c-518c-4f31-a264-7c2544c8493b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:32.626722 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647939c-518c-4f31-a264-7c2544c8493b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:32.627036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b647939c-518c-4f31-a264-7c2544c8493b None admin] PATH_INFO: `/v3/users/551bc06b95cd44708730a010b97d14ac` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:32.631516 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647939c-518c-4f31-a264-7c2544c8493b None admin] RBAC: Authorizing `identity:get_user(user_id=551bc06b95cd44708730a010b97d14ac)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:32.633009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b647939c-518c-4f31-a264-7c2544c8493b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:32.635038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 76/146] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:32 2022] GET /identity/v3/users/551bc06b95cd44708730a010b97d14ac => generated 289 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:32.640504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0265b-b04e-4d87-a9b9-2800d6a1dcbe None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:32.802710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e0265b-b04e-4d87-a9b9-2800d6a1dcbe None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:32.849522 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1aad3d-d5ec-4666-a4fb-8881980b4233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:32.850330 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aad3d-d5ec-4666-a4fb-8881980b4233 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:32.850614 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aad3d-d5ec-4666-a4fb-8881980b4233 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:32.850925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1aad3d-d5ec-4666-a4fb-8881980b4233 None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:32.852162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1aad3d-d5ec-4666-a4fb-8881980b4233 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:32.853903 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1aad3d-d5ec-4666-a4fb-8881980b4233 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:32.855949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 71/147] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:32 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:32.861984 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647939c-518c-4f31-a264-7c2544c8493b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:32.940428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:33.007563 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b647939c-518c-4f31-a264-7c2544c8493b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:33.054344 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744674f5-75f3-4951-b684-4fdc3414e083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:33.055313 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744674f5-75f3-4951-b684-4fdc3414e083 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:33.055591 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744674f5-75f3-4951-b684-4fdc3414e083 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:33.055866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744674f5-75f3-4951-b684-4fdc3414e083 None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078/users/551bc06b95cd44708730a010b97d14ac/roles/5ef1e825011442a2b31c10b82ae1b427` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:33.057861 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744674f5-75f3-4951-b684-4fdc3414e083 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0917f4477b4c16bde98021e0a84078, user_id=551bc06b95cd44708730a010b97d14ac, role_id=5ef1e825011442a2b31c10b82ae1b427)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:33.059369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744674f5-75f3-4951-b684-4fdc3414e083 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:33.156082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 77/148] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:15:32 2022] PUT /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078/users/551bc06b95cd44708730a010b97d14ac/roles/5ef1e825011442a2b31c10b82ae1b427 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:15:33.629162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ffb21-d0c9-47ff-b9fd-e2c1610234dc None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:33.629496 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ffb21-d0c9-47ff-b9fd-e2c1610234dc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:33.629682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79ffb21-d0c9-47ff-b9fd-e2c1610234dc None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:33.631465 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 72/149] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:33.636606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7acf2-86ee-4003-9941-c15bb65cfaef None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:33.637058 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7acf2-86ee-4003-9941-c15bb65cfaef None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:33.637155 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7acf2-86ee-4003-9941-c15bb65cfaef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:33.660186 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-01b7acf2-86ee-4003-9941-c15bb65cfaef None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:33.661420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-01b7acf2-86ee-4003-9941-c15bb65cfaef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:33.748539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 78/150] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:33.788515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ffb21-d0c9-47ff-b9fd-e2c1610234dc None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:33.802201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:33.888693 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3af90-b3f3-4796-8c62-6314f94088ab None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:33.888984 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3af90-b3f3-4796-8c62-6314f94088ab None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:33.889146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d3af90-b3f3-4796-8c62-6314f94088ab None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:33.890947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 79/151] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:33.905182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632fa1-2c98-420c-9dd5-20da6a603b28 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:33.905579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632fa1-2c98-420c-9dd5-20da6a603b28 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:33.905860 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c632fa1-2c98-420c-9dd5-20da6a603b28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:33.928494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79ffb21-d0c9-47ff-b9fd-e2c1610234dc None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:33.932887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5c632fa1-2c98-420c-9dd5-20da6a603b28 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:33.934078 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5c632fa1-2c98-420c-9dd5-20da6a603b28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:33.990535 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605c492-0ab1-4a32-aea6-596497281401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:33.991375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605c492-0ab1-4a32-aea6-596497281401 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:33.991662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605c492-0ab1-4a32-aea6-596497281401 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:33.991943 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8605c492-0ab1-4a32-aea6-596497281401 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:33.993255 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:34.019705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8605c492-0ab1-4a32-aea6-596497281401 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:34.027772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8605c492-0ab1-4a32-aea6-596497281401 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:34.027772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:34.027772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:34.027772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:34.027772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:34.027772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:34.027772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:34.027772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:34.027772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:34.027772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:34.027772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:34.027772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:34.027772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:34.027772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:34.027772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:34.027772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:34.028677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:34.028677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:34.028677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:34.028677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:34.028677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:34.028677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:34.028677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:34.028677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:34.028677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:34.028677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:34.028677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:34.028677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:34.028677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:34.028677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:34.028677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:34.028677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:34.029926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:34.029926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:34.029926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:34.029926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:34.029926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:34.029926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:34.029926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:34.029926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:34.029926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:34.029926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:34.029926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:34.029926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:34.029926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 73/152] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:34.035086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605c492-0ab1-4a32-aea6-596497281401 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:34.047085 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 80/153] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:34.083542 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c632fa1-2c98-420c-9dd5-20da6a603b28 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:34.174980 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:34.257358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c632fa1-2c98-420c-9dd5-20da6a603b28 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:34.260901 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8605c492-0ab1-4a32-aea6-596497281401 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:34.347876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746b0a3-c195-45e7-bdbe-95bd365a49bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:34.348688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746b0a3-c195-45e7-bdbe-95bd365a49bd None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:34.348973 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746b0a3-c195-45e7-bdbe-95bd365a49bd None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:34.349241 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0746b0a3-c195-45e7-bdbe-95bd365a49bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:34.350416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28137c05-8b65-4840-8fec-738b10f5e8d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:34.351130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28137c05-8b65-4840-8fec-738b10f5e8d1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:34.351436 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28137c05-8b65-4840-8fec-738b10f5e8d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:34.351714 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28137c05-8b65-4840-8fec-738b10f5e8d1 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:34.352490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28137c05-8b65-4840-8fec-738b10f5e8d1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:34.352799 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28137c05-8b65-4840-8fec-738b10f5e8d1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:34.354243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28137c05-8b65-4840-8fec-738b10f5e8d1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:34.383162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 74/154] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:34.384256 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0746b0a3-c195-45e7-bdbe-95bd365a49bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:34.389769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28137c05-8b65-4840-8fec-738b10f5e8d1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:34.396878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-0746b0a3-c195-45e7-bdbe-95bd365a49bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:34.396878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:34.396878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:34.396878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:34.396878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:34.396878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:34.396878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:34.396878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:34.396878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:34.396878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:34.396878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:34.396878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:34.396878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:34.396878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:34.396878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:34.396878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:34.397843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:34.397843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:34.397843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:34.397843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:34.397843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:34.397843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:34.397843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:34.397843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:34.397843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:34.397843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:34.397843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:34.397843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:34.397843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:34.397843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:34.397843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:34.397843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:34.398611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:34.398611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:34.398611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:34.398611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:34.398611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:34.398611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:34.398611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:34.398611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:34.398611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:34.398611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:34.398611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:34.398611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:34.398611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 81/155] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:15:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:34.409487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746b0a3-c195-45e7-bdbe-95bd365a49bd None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:34.494577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:34.619128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28137c05-8b65-4840-8fec-738b10f5e8d1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:34.640258 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0746b0a3-c195-45e7-bdbe-95bd365a49bd None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:34.675990 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:34.690983 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80259c-bb0f-431b-a3ff-e2fbc7010dac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:34.692110 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80259c-bb0f-431b-a3ff-e2fbc7010dac None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:34.692569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80259c-bb0f-431b-a3ff-e2fbc7010dac None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:34.693095 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f80259c-bb0f-431b-a3ff-e2fbc7010dac None admin] PATH_INFO: `/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:34.693605 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104210a-4c93-4768-a112-8e1250c87710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:34.694525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104210a-4c93-4768-a112-8e1250c87710 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:34.695028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104210a-4c93-4768-a112-8e1250c87710 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:34.695516 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0104210a-4c93-4768-a112-8e1250c87710 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:34.696526 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104210a-4c93-4768-a112-8e1250c87710 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:34.697037 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104210a-4c93-4768-a112-8e1250c87710 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:34.698605 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0104210a-4c93-4768-a112-8e1250c87710 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:34.702411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80259c-bb0f-431b-a3ff-e2fbc7010dac None admin] RBAC: Authorizing `identity:get_user(user_id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:34.702411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f80259c-bb0f-431b-a3ff-e2fbc7010dac None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:34.703415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 75/156] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:34 2022] GET /identity/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8 => generated 275 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:34.713586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 82/157] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:34.719738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80259c-bb0f-431b-a3ff-e2fbc7010dac None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:34.724169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104210a-4c93-4768-a112-8e1250c87710 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:34.834116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:34.843125 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0104210a-4c93-4768-a112-8e1250c87710 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:34.881428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e2d80-2a14-492e-b138-bfc7d83a62c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:34.882605 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e2d80-2a14-492e-b138-bfc7d83a62c8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:34.883102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e2d80-2a14-492e-b138-bfc7d83a62c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:34.883547 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6e2d80-2a14-492e-b138-bfc7d83a62c8 None admin] PATH_INFO: `/v3/users/62e1112a8ecc4f798b846400813fbbe0` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:34.884949 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e2d80-2a14-492e-b138-bfc7d83a62c8 None admin] RBAC: Authorizing `identity:get_user(user_id=62e1112a8ecc4f798b846400813fbbe0)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:34.886581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c6e2d80-2a14-492e-b138-bfc7d83a62c8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:34.888424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 83/158] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:34 2022] GET /identity/v3/users/62e1112a8ecc4f798b846400813fbbe0 => generated 247 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:34.895577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e2d80-2a14-492e-b138-bfc7d83a62c8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:34.914950 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f80259c-bb0f-431b-a3ff-e2fbc7010dac None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:34.975877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c2e8a6c-1d8f-4037-9229-9710e892e9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:34.976961 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e8a6c-1d8f-4037-9229-9710e892e9ca None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:34.977442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e8a6c-1d8f-4037-9229-9710e892e9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:34.977926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c2e8a6c-1d8f-4037-9229-9710e892e9ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:35.040762 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6e2d80-2a14-492e-b138-bfc7d83a62c8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:35.051218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:35.054737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e8a6c-1d8f-4037-9229-9710e892e9ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:35.056495 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c2e8a6c-1d8f-4037-9229-9710e892e9ca None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:35.089592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74860ff-1ebb-44b8-b3e0-cf6fadcd56f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:35.090247 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74860ff-1ebb-44b8-b3e0-cf6fadcd56f9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:35.091004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74860ff-1ebb-44b8-b3e0-cf6fadcd56f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:35.091288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74860ff-1ebb-44b8-b3e0-cf6fadcd56f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:35.128873 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:35.184291 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 76/159] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:15:35.188378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b99dee-0980-4ad3-8fca-8493d3d19a75 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:35.190123 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b99dee-0980-4ad3-8fca-8493d3d19a75 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:35.193278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b99dee-0980-4ad3-8fca-8493d3d19a75 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:35.194978 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 77/160] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:35.197243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b99dee-0980-4ad3-8fca-8493d3d19a75 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:35.200187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74860ff-1ebb-44b8-b3e0-cf6fadcd56f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:35.203989 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74860ff-1ebb-44b8-b3e0-cf6fadcd56f9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:35.316417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:35.320342 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b99dee-0980-4ad3-8fca-8493d3d19a75 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:35.372161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7bf788-7c46-439c-a163-07787d040de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:35.372943 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bf788-7c46-439c-a163-07787d040de0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:35.373228 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bf788-7c46-439c-a163-07787d040de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:35.373502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7bf788-7c46-439c-a163-07787d040de0 None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:35.378091 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bf788-7c46-439c-a163-07787d040de0 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:35.379588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7bf788-7c46-439c-a163-07787d040de0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:35.381318 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 78/161] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:35 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:35.382482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3370739-f886-4e9f-95a7-db3f88c51e39 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:35.382775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3370739-f886-4e9f-95a7-db3f88c51e39 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:35.383059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3370739-f886-4e9f-95a7-db3f88c51e39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:35.426254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e3370739-f886-4e9f-95a7-db3f88c51e39 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:35.427686 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e3370739-f886-4e9f-95a7-db3f88c51e39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:35.449931 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 84/162] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 555 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 19:15:35.451694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f13326-1731-44e0-b283-0689767fb402 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:35.452209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f13326-1731-44e0-b283-0689767fb402 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:35.452683 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f13326-1731-44e0-b283-0689767fb402 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:35.454156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 85/163] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:35.459911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f13326-1731-44e0-b283-0689767fb402 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:35.548218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 79/164] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:35.550850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a875c1-949b-4abd-af96-cfb988cb786b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:35.552827 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a875c1-949b-4abd-af96-cfb988cb786b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:35.554131 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a875c1-949b-4abd-af96-cfb988cb786b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:35.598948 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:35.603794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-28a875c1-949b-4abd-af96-cfb988cb786b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:35.605015 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-28a875c1-949b-4abd-af96-cfb988cb786b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:35.688686 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f13326-1731-44e0-b283-0689767fb402 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:35.752870 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 80/165] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:35.753745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a875c1-949b-4abd-af96-cfb988cb786b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:35.779471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be16af-a277-439d-8bc9-1e4c5906f08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:35.780636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be16af-a277-439d-8bc9-1e4c5906f08b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:35.781120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be16af-a277-439d-8bc9-1e4c5906f08b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:35.781594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6be16af-a277-439d-8bc9-1e4c5906f08b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:35.782691 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be16af-a277-439d-8bc9-1e4c5906f08b None admin] RBAC: Adding query filter params (role.id=5d20b549441d429db11d5e91f3825e86, scope.project.id=3c0917f4477b4c16bde98021e0a84078, user.id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:35.783804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be16af-a277-439d-8bc9-1e4c5906f08b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:35.785587 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6be16af-a277-439d-8bc9-1e4c5906f08b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:35.795149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:35.799769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 86/166] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:35 2022] GET /identity/v3/role_assignments?user.id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8&scope.project.id=3c0917f4477b4c16bde98021e0a84078&role.id=5d20b549441d429db11d5e91f3825e86 => generated 608 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:35.801032 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be16af-a277-439d-8bc9-1e4c5906f08b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:35.929010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a875c1-949b-4abd-af96-cfb988cb786b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:36.004975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc249f-c667-496b-bd6e-47203f3548e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:36.006196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc249f-c667-496b-bd6e-47203f3548e1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:36.006896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc249f-c667-496b-bd6e-47203f3548e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:36.008240 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36dc249f-c667-496b-bd6e-47203f3548e1 None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:36.010571 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc249f-c667-496b-bd6e-47203f3548e1 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:36.013509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36dc249f-c667-496b-bd6e-47203f3548e1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:36.015664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 81/167] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:35 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:36.017654 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc249f-c667-496b-bd6e-47203f3548e1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:36.051205 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6be16af-a277-439d-8bc9-1e4c5906f08b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:36.105541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:36.120204 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e56a6-515c-4d1f-817b-26eb2f3a1c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:36.121017 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e56a6-515c-4d1f-817b-26eb2f3a1c88 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:36.121514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e56a6-515c-4d1f-817b-26eb2f3a1c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:36.121620 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e56a6-515c-4d1f-817b-26eb2f3a1c88 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:36.144807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845e56a6-515c-4d1f-817b-26eb2f3a1c88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:36.159700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-845e56a6-515c-4d1f-817b-26eb2f3a1c88 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:15:36.159700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:36.159700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:36.159700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:36.159700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:36.159700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:36.159700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:36.159700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:36.159700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:36.159700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:36.159700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:36.159700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:36.159700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:36.159700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:36.159700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:36.159700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:36.160766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:36.160766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:36.160766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:36.160766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:36.160766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:36.160766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:36.160766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:36.160766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:36.160766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:36.160766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:36.160766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:36.160766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:36.160766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:36.160766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:36.160766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:36.160766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:36.161981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:36.161981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:36.161981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:36.161981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:36.161981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:36.161981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:36.161981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:36.161981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:36.161981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:36.161981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:36.161981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:15:36.161981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:36.161981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 87/168] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:15:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:36.161981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e56a6-515c-4d1f-817b-26eb2f3a1c88 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:36.167853 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:36.170034 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36dc249f-c667-496b-bd6e-47203f3548e1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:36.221513 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f7d65-f488-4d40-9dd0-2e7cfbd4d4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:36.222729 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f7d65-f488-4d40-9dd0-2e7cfbd4d4fb None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:36.223256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f7d65-f488-4d40-9dd0-2e7cfbd4d4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:36.223725 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f7d65-f488-4d40-9dd0-2e7cfbd4d4fb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:36.238689 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-842f7d65-f488-4d40-9dd0-2e7cfbd4d4fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:36.247109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-842f7d65-f488-4d40-9dd0-2e7cfbd4d4fb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:36.247109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:36.247109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:36.247109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:36.247109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:36.247109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:36.247109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:36.247109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:36.247109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:36.247109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:36.247109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:36.247109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:36.247109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:36.247109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:36.247109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:36.247109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:36.248012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:36.248012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:36.248012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:36.248012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:36.248012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:36.248012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:36.248012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:36.248012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:36.248012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:36.248012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:36.248012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:36.248012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:36.248012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:36.248012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:36.248012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:36.248012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:36.248814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:36.248814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:36.248814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:36.248814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:36.248814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:36.248814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:36.248814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:36.248814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:36.248814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:36.248814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:36.248814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:36.248814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:36.251662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 82/169] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:36.253022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f7d65-f488-4d40-9dd0-2e7cfbd4d4fb None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:36.309587 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e56a6-515c-4d1f-817b-26eb2f3a1c88 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:36.345014 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01763d-3b5d-4bd4-91e9-36d092d15e46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:36.345704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01763d-3b5d-4bd4-91e9-36d092d15e46 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:36.346045 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01763d-3b5d-4bd4-91e9-36d092d15e46 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:36.346280 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed01763d-3b5d-4bd4-91e9-36d092d15e46 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:36.347163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01763d-3b5d-4bd4-91e9-36d092d15e46 None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=3c0917f4477b4c16bde98021e0a84078, user.id=62e1112a8ecc4f798b846400813fbbe0) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:36.347488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01763d-3b5d-4bd4-91e9-36d092d15e46 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:36.348959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed01763d-3b5d-4bd4-91e9-36d092d15e46 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:36.355156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 88/170] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:36 2022] GET /identity/v3/role_assignments?user.id=62e1112a8ecc4f798b846400813fbbe0&scope.project.id=3c0917f4477b4c16bde98021e0a84078&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:36.355931 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01763d-3b5d-4bd4-91e9-36d092d15e46 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:36.415164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:36.467482 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed01763d-3b5d-4bd4-91e9-36d092d15e46 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:36.505443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3ce85-46b3-452d-9c4a-af5048bda1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:36.505690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f7d65-f488-4d40-9dd0-2e7cfbd4d4fb None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:36.506367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3ce85-46b3-452d-9c4a-af5048bda1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:36.506803 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3ce85-46b3-452d-9c4a-af5048bda1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:36.507187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa3ce85-46b3-452d-9c4a-af5048bda1e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:36.508058 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3ce85-46b3-452d-9c4a-af5048bda1e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:36.508472 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3ce85-46b3-452d-9c4a-af5048bda1e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:36.509975 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa3ce85-46b3-452d-9c4a-af5048bda1e4 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:36.519636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 89/171] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:36.525657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3ce85-46b3-452d-9c4a-af5048bda1e4 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:36.631584 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f79d9c-55b6-4ab1-b629-9d38ee2e9286 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:36.632201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f79d9c-55b6-4ab1-b629-9d38ee2e9286 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:36.632490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f79d9c-55b6-4ab1-b629-9d38ee2e9286 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:36.632831 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f79d9c-55b6-4ab1-b629-9d38ee2e9286 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:36.633603 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f79d9c-55b6-4ab1-b629-9d38ee2e9286 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:36.633912 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f79d9c-55b6-4ab1-b629-9d38ee2e9286 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:36.635378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f79d9c-55b6-4ab1-b629-9d38ee2e9286 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:36.655648 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa3ce85-46b3-452d-9c4a-af5048bda1e4 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:36.661119 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 83/172] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:15:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 409 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:36.666923 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f79d9c-55b6-4ab1-b629-9d38ee2e9286 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:36.675117 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:36.696869 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1e45b-7e25-4168-8358-49c55fe88d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:36.697937 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1e45b-7e25-4168-8358-49c55fe88d31 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:36.698327 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1e45b-7e25-4168-8358-49c55fe88d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:36.698688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1e45b-7e25-4168-8358-49c55fe88d31 None admin] PATH_INFO: `/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:36.700315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1e45b-7e25-4168-8358-49c55fe88d31 None admin] RBAC: Authorizing `identity:get_user(user_id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:36.702232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1e45b-7e25-4168-8358-49c55fe88d31 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:36.704077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 90/173] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:36 2022] GET /identity/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:36.707693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:36.711730 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1e45b-7e25-4168-8358-49c55fe88d31 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:36.911085 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1e45b-7e25-4168-8358-49c55fe88d31 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:36.979135 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f79d9c-55b6-4ab1-b629-9d38ee2e9286 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:36.982872 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfbfd856-a5e2-4525-96de-619e42231793 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:36.984452 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfd856-a5e2-4525-96de-619e42231793 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:36.984735 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfd856-a5e2-4525-96de-619e42231793 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:36.985013 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfbfd856-a5e2-4525-96de-619e42231793 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:37.083115 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:37.091482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c193bc9-363b-4013-8eeb-c4f61f358996 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:37.092406 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c193bc9-363b-4013-8eeb-c4f61f358996 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:37.092780 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c193bc9-363b-4013-8eeb-c4f61f358996 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:37.093209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c193bc9-363b-4013-8eeb-c4f61f358996 None admin] PATH_INFO: `/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:37.094567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c193bc9-363b-4013-8eeb-c4f61f358996 None admin] RBAC: Authorizing `identity:get_user(user_id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:37.096936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c193bc9-363b-4013-8eeb-c4f61f358996 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:37.098987 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 84/174] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:36 2022] GET /identity/v3/users/75fc1f3e3ac14ba7b551d2a7fb2ab8a8 => generated 275 bytes in 432 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:37.107723 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c193bc9-363b-4013-8eeb-c4f61f358996 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:37.140914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfd856-a5e2-4525-96de-619e42231793 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:37.142411 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfbfd856-a5e2-4525-96de-619e42231793 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:37.262491 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:37.288719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c193bc9-363b-4013-8eeb-c4f61f358996 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:37.308265 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 91/175] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 19:15:37.309435 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafff80-d6d0-4137-8653-ce3332830167 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:37.309723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafff80-d6d0-4137-8653-ce3332830167 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:37.310004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafff80-d6d0-4137-8653-ce3332830167 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:37.315999 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 92/176] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:37 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:37.318245 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131ed13-9536-4e6f-810c-5d9441da8ffa None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:37.319042 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131ed13-9536-4e6f-810c-5d9441da8ffa None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:37.319517 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2131ed13-9536-4e6f-810c-5d9441da8ffa None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:37.321798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 93/177] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:37.322914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42799f00-9bc3-466a-a4ef-0f4ccea51f73 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:37.323194 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42799f00-9bc3-466a-a4ef-0f4ccea51f73 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:37.323466 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42799f00-9bc3-466a-a4ef-0f4ccea51f73 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:37.324786 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 94/178] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:37 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:37.327527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42799f00-9bc3-466a-a4ef-0f4ccea51f73 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:37.329742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752d35f0-f385-4a2d-b567-c6fe389d5be8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:37.330621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d35f0-f385-4a2d-b567-c6fe389d5be8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:37.330936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d35f0-f385-4a2d-b567-c6fe389d5be8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:37.331213 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752d35f0-f385-4a2d-b567-c6fe389d5be8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:37.406115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d35f0-f385-4a2d-b567-c6fe389d5be8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:37.409193 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752d35f0-f385-4a2d-b567-c6fe389d5be8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:37.416764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:37.442209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42799f00-9bc3-466a-a4ef-0f4ccea51f73 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:37.479645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68c6f25-2c3e-4785-8c0b-62c7dbb5ebfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:37.480511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c6f25-2c3e-4785-8c0b-62c7dbb5ebfe None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:37.480801 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c6f25-2c3e-4785-8c0b-62c7dbb5ebfe None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:37.481074 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68c6f25-2c3e-4785-8c0b-62c7dbb5ebfe None admin] PATH_INFO: `/v3/projects/86252f6e16a84baf8b191fcdb0b76b18` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:37.482256 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c6f25-2c3e-4785-8c0b-62c7dbb5ebfe None admin] RBAC: Authorizing `identity:get_project(project_id=86252f6e16a84baf8b191fcdb0b76b18)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:37.483736 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68c6f25-2c3e-4785-8c0b-62c7dbb5ebfe None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:37.485470 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 95/179] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:37 2022] GET /identity/v3/projects/86252f6e16a84baf8b191fcdb0b76b18 => generated 312 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:37.487445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385b476-a0a2-413c-9710-0ab2b3488db4 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:37.487729 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385b476-a0a2-413c-9710-0ab2b3488db4 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:37.488003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7385b476-a0a2-413c-9710-0ab2b3488db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:37.505351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-7385b476-a0a2-413c-9710-0ab2b3488db4 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:37.505555 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:37.506960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-7385b476-a0a2-413c-9710-0ab2b3488db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:37.528696 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 85/180] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:15:37.528696 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d20e4-eef1-4b53-8b27-75dbd5d63718 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:37.528696 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d20e4-eef1-4b53-8b27-75dbd5d63718 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:37.528696 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497d20e4-eef1-4b53-8b27-75dbd5d63718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:37.542212 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-497d20e4-eef1-4b53-8b27-75dbd5d63718 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:37.543538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-497d20e4-eef1-4b53-8b27-75dbd5d63718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:37.579105 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 96/181] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:37.580618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310763-3d4a-4588-bdad-f8f86ce565a6 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:37.581646 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310763-3d4a-4588-bdad-f8f86ce565a6 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:37.581646 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50310763-3d4a-4588-bdad-f8f86ce565a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:37.603895 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-50310763-3d4a-4588-bdad-f8f86ce565a6 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:37.605083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-50310763-3d4a-4588-bdad-f8f86ce565a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:37.614289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 86/182] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:37.614289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51a357-095e-4e02-b24f-e709d0f3bb65 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:37.614289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51a357-095e-4e02-b24f-e709d0f3bb65 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:37.614289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51a357-095e-4e02-b24f-e709d0f3bb65 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:37.614289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 87/183] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:37.614289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51a357-095e-4e02-b24f-e709d0f3bb65 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:37.680556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 97/184] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:37.681407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50310763-3d4a-4588-bdad-f8f86ce565a6 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:37.689160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:37.730087 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea51a357-095e-4e02-b24f-e709d0f3bb65 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:37.744038 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:37.766283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcfdb4-9561-4f02-9b0f-bf4d4aa375cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:37.767026 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcfdb4-9561-4f02-9b0f-bf4d4aa375cf None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:37.767310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcfdb4-9561-4f02-9b0f-bf4d4aa375cf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:37.768103 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffcfdb4-9561-4f02-9b0f-bf4d4aa375cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:37.769268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcfdb4-9561-4f02-9b0f-bf4d4aa375cf None admin] RBAC: Adding query filter params (role.id=5d20b549441d429db11d5e91f3825e86, scope.project.id=86252f6e16a84baf8b191fcdb0b76b18, user.id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:37.769590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcfdb4-9561-4f02-9b0f-bf4d4aa375cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:37.771078 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffcfdb4-9561-4f02-9b0f-bf4d4aa375cf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:37.777057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 88/185] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:37 2022] GET /identity/v3/role_assignments?user.id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8&scope.project.id=86252f6e16a84baf8b191fcdb0b76b18&role.id=5d20b549441d429db11d5e91f3825e86 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:37.779373 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcfdb4-9561-4f02-9b0f-bf4d4aa375cf None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:37.786704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50310763-3d4a-4588-bdad-f8f86ce565a6 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:37.827859 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8fcf92-79c2-405d-ac82-1615c9d7b67d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:37.828840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fcf92-79c2-405d-ac82-1615c9d7b67d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:37.829127 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fcf92-79c2-405d-ac82-1615c9d7b67d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:37.829404 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8fcf92-79c2-405d-ac82-1615c9d7b67d None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:37.831266 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fcf92-79c2-405d-ac82-1615c9d7b67d None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:37.833005 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8fcf92-79c2-405d-ac82-1615c9d7b67d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:37.839865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 98/186] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:37 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:37.839865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891289c-768c-4a9c-8fd1-8b7a21f4ad18 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:37.839865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891289c-768c-4a9c-8fd1-8b7a21f4ad18 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:37.839865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c891289c-768c-4a9c-8fd1-8b7a21f4ad18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:37.857089 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c891289c-768c-4a9c-8fd1-8b7a21f4ad18 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:37.858310 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c891289c-768c-4a9c-8fd1-8b7a21f4ad18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:37.903751 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffcfdb4-9561-4f02-9b0f-bf4d4aa375cf None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:37.938087 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 99/187] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:37.939266 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891289c-768c-4a9c-8fd1-8b7a21f4ad18 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:37.943611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:37.946499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4752397-9b72-4a3e-aaa9-1c6bb2c7c386 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:37.947400 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4752397-9b72-4a3e-aaa9-1c6bb2c7c386 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:37.948857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4752397-9b72-4a3e-aaa9-1c6bb2c7c386 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:37.948857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4752397-9b72-4a3e-aaa9-1c6bb2c7c386 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:37.960719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4752397-9b72-4a3e-aaa9-1c6bb2c7c386 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:37.970116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-d4752397-9b72-4a3e-aaa9-1c6bb2c7c386 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:15:37.970116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:37.970116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:37.970116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:37.970116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:37.970116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:37.970116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:37.970116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:37.970116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:37.970116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:37.970116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:37.970116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:37.970116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:37.970116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:37.970116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:37.970116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:37.971239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:37.971239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:37.971239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:37.971239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:37.971239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:37.971239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:37.971239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:37.971239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:37.971239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:37.971239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:37.971239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:37.971239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:37.971239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:37.971239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:37.971239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:37.971239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:37.972154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:37.972154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:37.972154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:37.972154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:37.972154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:37.972154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:37.972154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:37.972154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:37.972154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:37.972154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:37.972154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:15:37.972154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:37.972154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 89/188] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:15:37 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:37.972154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4752397-9b72-4a3e-aaa9-1c6bb2c7c386 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:38.022334 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:38.057615 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c891289c-768c-4a9c-8fd1-8b7a21f4ad18 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:38.094914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf6348-0212-4b8d-b740-93707ca7b864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:38.095888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf6348-0212-4b8d-b740-93707ca7b864 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:38.096098 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4752397-9b72-4a3e-aaa9-1c6bb2c7c386 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:38.096235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf6348-0212-4b8d-b740-93707ca7b864 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:38.096471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecbf6348-0212-4b8d-b740-93707ca7b864 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:38.106366 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecbf6348-0212-4b8d-b740-93707ca7b864 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:38.114338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-ecbf6348-0212-4b8d-b740-93707ca7b864 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:38.114338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:38.114338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:38.114338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:38.114338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:38.114338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:38.114338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:38.114338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:38.114338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:38.114338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:38.114338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:38.114338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:38.114338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:38.114338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:38.114338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:38.114338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:38.115455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:38.115455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:38.115455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:38.115455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:38.115455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:38.115455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:38.115455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:38.115455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:38.115455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:38.115455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:38.115455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:38.115455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:38.115455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:38.115455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:38.115455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:38.115455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:38.116259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:38.116259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:38.116259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:38.116259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:38.116259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:38.116259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:38.116259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:38.116259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:38.116259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:38.116259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:38.116259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:38.116259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:38.116259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 100/189] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:15:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:38.116920 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf6348-0212-4b8d-b740-93707ca7b864 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:38.132489 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18485b13-585d-4267-abcb-7a74dbe04ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:38.133277 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18485b13-585d-4267-abcb-7a74dbe04ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:38.133559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18485b13-585d-4267-abcb-7a74dbe04ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:38.133834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18485b13-585d-4267-abcb-7a74dbe04ce6 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:38.144360 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18485b13-585d-4267-abcb-7a74dbe04ce6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:38.152111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-18485b13-585d-4267-abcb-7a74dbe04ce6 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:38.152111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:38.152111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:38.152111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:38.152111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:38.152111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:38.152111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:38.152111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:38.152111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:38.152111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:38.152111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:38.152111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:38.152111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:38.152111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:38.152111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:38.152111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:38.153186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:38.153186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:38.153186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:38.153186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:38.153186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:38.153186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:38.153186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:38.153186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:38.153186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:38.153186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:38.153186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:38.153186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:38.153186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:38.153186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:38.153186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:38.153186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:38.154136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:38.154136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:38.154136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:38.154136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:38.154136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:38.154136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:38.154136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:38.154136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:38.154136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:38.154136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:38.154136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:38.154136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:38.154136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 90/190] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:38.155582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18485b13-585d-4267-abcb-7a74dbe04ce6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:38.179356 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:38.217869 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecbf6348-0212-4b8d-b740-93707ca7b864 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:38.252288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e277f1b-67cf-4349-b9b1-d6b3467c0273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:38.252941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e277f1b-67cf-4349-b9b1-d6b3467c0273 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:38.253219 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e277f1b-67cf-4349-b9b1-d6b3467c0273 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:38.253487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e277f1b-67cf-4349-b9b1-d6b3467c0273 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:38.254316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e277f1b-67cf-4349-b9b1-d6b3467c0273 None admin] RBAC: Adding query filter params (role.id=a1dd99d822514511a82daa669061e683, scope.project.id=3c0917f4477b4c16bde98021e0a84078, user.id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:38.254631 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e277f1b-67cf-4349-b9b1-d6b3467c0273 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:38.255162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:38.256123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e277f1b-67cf-4349-b9b1-d6b3467c0273 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:38.260918 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18485b13-585d-4267-abcb-7a74dbe04ce6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:38.265633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 101/191] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:38 2022] GET /identity/v3/role_assignments?user.id=75fc1f3e3ac14ba7b551d2a7fb2ab8a8&scope.project.id=3c0917f4477b4c16bde98021e0a84078&role.id=a1dd99d822514511a82daa669061e683 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:38.265633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e277f1b-67cf-4349-b9b1-d6b3467c0273 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:38.307728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02990e45-2f7a-4de7-8332-c4e76fce408a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:38.308450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02990e45-2f7a-4de7-8332-c4e76fce408a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:38.308733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02990e45-2f7a-4de7-8332-c4e76fce408a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:38.309009 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02990e45-2f7a-4de7-8332-c4e76fce408a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:38.310281 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02990e45-2f7a-4de7-8332-c4e76fce408a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:38.311856 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02990e45-2f7a-4de7-8332-c4e76fce408a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:38.313616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 91/192] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:15:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:38.315111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02990e45-2f7a-4de7-8332-c4e76fce408a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:38.387296 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e277f1b-67cf-4349-b9b1-d6b3467c0273 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:38.417693 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:38.427131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6ddc9-35c8-4466-a5fc-c40b92359bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:38.428233 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ddc9-35c8-4466-a5fc-c40b92359bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:38.428233 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ddc9-35c8-4466-a5fc-c40b92359bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:38.433103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b6ddc9-35c8-4466-a5fc-c40b92359bb0 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:38.433103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6ddc9-35c8-4466-a5fc-c40b92359bb0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:38.433103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6ddc9-35c8-4466-a5fc-c40b92359bb0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:38.433103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b6ddc9-35c8-4466-a5fc-c40b92359bb0 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:38.433377 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02990e45-2f7a-4de7-8332-c4e76fce408a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:38.445057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 102/193] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:15:38 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:38.446176 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6ddc9-35c8-4466-a5fc-c40b92359bb0 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:38.478224 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b6e47-1b6e-4d62-b3c5-41dcd33db8e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:38.478922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6e47-1b6e-4d62-b3c5-41dcd33db8e2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:38.479355 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6e47-1b6e-4d62-b3c5-41dcd33db8e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:38.479651 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-094b6e47-1b6e-4d62-b3c5-41dcd33db8e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:38.480340 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b6e47-1b6e-4d62-b3c5-41dcd33db8e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:38.480753 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b6e47-1b6e-4d62-b3c5-41dcd33db8e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:38.482044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-094b6e47-1b6e-4d62-b3c5-41dcd33db8e2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:38.493076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 92/194] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:38.493715 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b6e47-1b6e-4d62-b3c5-41dcd33db8e2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:38.523485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:38.553604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b6ddc9-35c8-4466-a5fc-c40b92359bb0 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:38.588241 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537b20f-d2f0-43f4-a40d-81faed47045b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:38.588837 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537b20f-d2f0-43f4-a40d-81faed47045b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:38.589363 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537b20f-d2f0-43f4-a40d-81faed47045b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:38.589363 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1537b20f-d2f0-43f4-a40d-81faed47045b None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:38.590167 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537b20f-d2f0-43f4-a40d-81faed47045b None admin] RBAC: Adding query filter params (name=reader) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:38.590476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537b20f-d2f0-43f4-a40d-81faed47045b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:38.591882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1537b20f-d2f0-43f4-a40d-81faed47045b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:38.598155 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-094b6e47-1b6e-4d62-b3c5-41dcd33db8e2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:38.600932 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 103/195] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:38.601727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537b20f-d2f0-43f4-a40d-81faed47045b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:38.637659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a914091-f9fe-4f37-aea8-cad1afb0a987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:38.638334 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a914091-f9fe-4f37-aea8-cad1afb0a987 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:38.638614 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a914091-f9fe-4f37-aea8-cad1afb0a987 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:38.638928 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a914091-f9fe-4f37-aea8-cad1afb0a987 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:38.639644 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a914091-f9fe-4f37-aea8-cad1afb0a987 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:38.641075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a914091-f9fe-4f37-aea8-cad1afb0a987 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:38.655890 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:38.701335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1537b20f-d2f0-43f4-a40d-81faed47045b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:38.734019 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8164962-09a5-4cd4-898e-02a6b5effd7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:38.734922 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8164962-09a5-4cd4-898e-02a6b5effd7c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:38.735214 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8164962-09a5-4cd4-898e-02a6b5effd7c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:38.735471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8164962-09a5-4cd4-898e-02a6b5effd7c None admin] PATH_INFO: `/v3/users/bf4344a9576c4a7eb81ead703a9d4acd` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:38.738098 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 93/196] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:15:38 2022] POST /identity/v3/users => generated 297 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:15:38.738999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a914091-f9fe-4f37-aea8-cad1afb0a987 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:38.750252 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8164962-09a5-4cd4-898e-02a6b5effd7c None admin] RBAC: Authorizing `identity:get_user(user_id=bf4344a9576c4a7eb81ead703a9d4acd)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:38.752819 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8164962-09a5-4cd4-898e-02a6b5effd7c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:38.755156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 104/197] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:38 2022] GET /identity/v3/users/bf4344a9576c4a7eb81ead703a9d4acd => generated 283 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:38.759934 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8164962-09a5-4cd4-898e-02a6b5effd7c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:38.839469 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:38.859252 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a914091-f9fe-4f37-aea8-cad1afb0a987 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:38.876714 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8164962-09a5-4cd4-898e-02a6b5effd7c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:38.894453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:38.905676 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a586ac0-726f-4533-abe7-8f554cf2931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:38.907197 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a586ac0-726f-4533-abe7-8f554cf2931a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:38.907197 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a586ac0-726f-4533-abe7-8f554cf2931a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:38.907197 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a586ac0-726f-4533-abe7-8f554cf2931a None admin] PATH_INFO: `/v3/users/bf4344a9576c4a7eb81ead703a9d4acd` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:38.908932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a586ac0-726f-4533-abe7-8f554cf2931a None admin] RBAC: Authorizing `identity:get_user(user_id=bf4344a9576c4a7eb81ead703a9d4acd)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:38.910415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a586ac0-726f-4533-abe7-8f554cf2931a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:38.912868 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 94/198] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:38 2022] GET /identity/v3/users/bf4344a9576c4a7eb81ead703a9d4acd => generated 283 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:38.913016 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a586ac0-726f-4533-abe7-8f554cf2931a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:38.920498 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397aad1a-364a-4f69-b7b7-367b087c429f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:38.921602 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397aad1a-364a-4f69-b7b7-367b087c429f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:38.921892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397aad1a-364a-4f69-b7b7-367b087c429f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:38.922173 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397aad1a-364a-4f69-b7b7-367b087c429f None admin] PATH_INFO: `/v3/users/551bc06b95cd44708730a010b97d14ac` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:38.923604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397aad1a-364a-4f69-b7b7-367b087c429f None admin] RBAC: Authorizing `identity:get_user(user_id=551bc06b95cd44708730a010b97d14ac)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:38.925931 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397aad1a-364a-4f69-b7b7-367b087c429f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:38.927728 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 105/199] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:38 2022] GET /identity/v3/users/551bc06b95cd44708730a010b97d14ac => generated 289 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:38.928498 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397aad1a-364a-4f69-b7b7-367b087c429f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:39.048527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a586ac0-726f-4533-abe7-8f554cf2931a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:39.059267 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397aad1a-364a-4f69-b7b7-367b087c429f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:39.105843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350870b-245e-4dc1-a638-4ac16a896899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:39.106935 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350870b-245e-4dc1-a638-4ac16a896899 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:39.107549 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350870b-245e-4dc1-a638-4ac16a896899 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:39.108039 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e711b5-5965-4221-b944-968055b7b602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:39.108252 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a350870b-245e-4dc1-a638-4ac16a896899 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:39.108745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e711b5-5965-4221-b944-968055b7b602 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:39.109031 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e711b5-5965-4221-b944-968055b7b602 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:39.109308 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e711b5-5965-4221-b944-968055b7b602 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:39.134672 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:39.164523 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:39.190449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350870b-245e-4dc1-a638-4ac16a896899 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:39.192489 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a350870b-245e-4dc1-a638-4ac16a896899 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:39.201595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e711b5-5965-4221-b944-968055b7b602 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:39.202956 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e711b5-5965-4221-b944-968055b7b602 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:39.306219 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 106/201] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:15:39.310257 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 95/201] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:15:39.311658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e711b5-5965-4221-b944-968055b7b602 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:39.312466 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350870b-245e-4dc1-a638-4ac16a896899 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:39.370739 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:39.402045 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:39.426925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a350870b-245e-4dc1-a638-4ac16a896899 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:39.428825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e711b5-5965-4221-b944-968055b7b602 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:39.466204 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a16e9-359e-4d76-9359-17c7a1f0a317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:39.467275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7f167-7f4a-4a9f-9df6-5eb0f8751dad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:39.467596 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a16e9-359e-4d76-9359-17c7a1f0a317 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:39.468080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a16e9-359e-4d76-9359-17c7a1f0a317 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:39.468185 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7f167-7f4a-4a9f-9df6-5eb0f8751dad None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:39.468400 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7f167-7f4a-4a9f-9df6-5eb0f8751dad None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:39.468676 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce7f167-7f4a-4a9f-9df6-5eb0f8751dad None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:39.469303 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3a16e9-359e-4d76-9359-17c7a1f0a317 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:39.469890 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7f167-7f4a-4a9f-9df6-5eb0f8751dad None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:39.471452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce7f167-7f4a-4a9f-9df6-5eb0f8751dad None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:39.473312 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 96/202] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:39 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:39.474782 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7f167-7f4a-4a9f-9df6-5eb0f8751dad None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:39.546094 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a16e9-359e-4d76-9359-17c7a1f0a317 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:39.549221 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c3a16e9-359e-4d76-9359-17c7a1f0a317 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:39.585327 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce7f167-7f4a-4a9f-9df6-5eb0f8751dad None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:39.604624 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:39.623349 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8443dd0-8b3d-406f-8212-3e4752617b99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:39.624126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8443dd0-8b3d-406f-8212-3e4752617b99 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:39.624414 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8443dd0-8b3d-406f-8212-3e4752617b99 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:39.624692 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8443dd0-8b3d-406f-8212-3e4752617b99 None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:39.625975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8443dd0-8b3d-406f-8212-3e4752617b99 None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:39.627602 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8443dd0-8b3d-406f-8212-3e4752617b99 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:39.634493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 97/203] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:39 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:39.634493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8443dd0-8b3d-406f-8212-3e4752617b99 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:39.645965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:39.672267 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 107/204] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:15:39.673547 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a16e9-359e-4d76-9359-17c7a1f0a317 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:39.748023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8443dd0-8b3d-406f-8212-3e4752617b99 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:39.786578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2594268-6f4a-4800-ad23-896d0e6eec7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:39.787377 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2594268-6f4a-4800-ad23-896d0e6eec7c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:39.787671 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2594268-6f4a-4800-ad23-896d0e6eec7c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:39.787953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2594268-6f4a-4800-ad23-896d0e6eec7c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:39.788905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2594268-6f4a-4800-ad23-896d0e6eec7c None admin] RBAC: Adding query filter params (role.id=a1dd99d822514511a82daa669061e683, scope.project.id=7543fca6f3a747199a7adba87590509d, user.id=bf4344a9576c4a7eb81ead703a9d4acd) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:39.789224 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2594268-6f4a-4800-ad23-896d0e6eec7c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:39.790680 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2594268-6f4a-4800-ad23-896d0e6eec7c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:39.792165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c3a16e9-359e-4d76-9359-17c7a1f0a317 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:39.797074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 98/205] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:39 2022] GET /identity/v3/role_assignments?user.id=bf4344a9576c4a7eb81ead703a9d4acd&scope.project.id=7543fca6f3a747199a7adba87590509d&role.id=a1dd99d822514511a82daa669061e683 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:39.797923 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2594268-6f4a-4800-ad23-896d0e6eec7c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:39.834104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e905f-3f4a-4d34-b643-a990757bf046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:39.843477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e905f-3f4a-4d34-b643-a990757bf046 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:39.844120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e905f-3f4a-4d34-b643-a990757bf046 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:39.844605 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e905f-3f4a-4d34-b643-a990757bf046 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:39.846417 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e905f-3f4a-4d34-b643-a990757bf046 None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=7543fca6f3a747199a7adba87590509d, user.id=bf4344a9576c4a7eb81ead703a9d4acd) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:39.846990 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e905f-3f4a-4d34-b643-a990757bf046 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:39.848819 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e905f-3f4a-4d34-b643-a990757bf046 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:39.859009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 108/206] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:39 2022] GET /identity/v3/role_assignments?user.id=bf4344a9576c4a7eb81ead703a9d4acd&scope.project.id=7543fca6f3a747199a7adba87590509d&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:39.862617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:39.946001 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2594268-6f4a-4800-ad23-896d0e6eec7c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:40.002963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca2119c-59d5-4ec6-bd1d-f56063140909 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:40.005216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2119c-59d5-4ec6-bd1d-f56063140909 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:40.006373 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2119c-59d5-4ec6-bd1d-f56063140909 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:40.006373 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca2119c-59d5-4ec6-bd1d-f56063140909 None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:40.011786 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2119c-59d5-4ec6-bd1d-f56063140909 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:40.013378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca2119c-59d5-4ec6-bd1d-f56063140909 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:40.015359 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 99/207] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:39 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:40.021877 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e905f-3f4a-4d34-b643-a990757bf046 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:40.083300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:40.160209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e905f-3f4a-4d34-b643-a990757bf046 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:40.200235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9dab1-37c9-46d5-a0f5-bad852b2f2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:40.200814 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9dab1-37c9-46d5-a0f5-bad852b2f2bf None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:40.201111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9dab1-37c9-46d5-a0f5-bad852b2f2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:40.201383 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9dab1-37c9-46d5-a0f5-bad852b2f2bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:40.202237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9dab1-37c9-46d5-a0f5-bad852b2f2bf None admin] RBAC: Adding query filter params (role.id=5ef1e825011442a2b31c10b82ae1b427, scope.project.id=3c0917f4477b4c16bde98021e0a84078, user.id=551bc06b95cd44708730a010b97d14ac) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:40.202554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9dab1-37c9-46d5-a0f5-bad852b2f2bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:40.204129 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ea9dab1-37c9-46d5-a0f5-bad852b2f2bf None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:40.211575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 109/208] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:40 2022] GET /identity/v3/role_assignments?user.id=551bc06b95cd44708730a010b97d14ac&scope.project.id=3c0917f4477b4c16bde98021e0a84078&role.id=5ef1e825011442a2b31c10b82ae1b427 => generated 608 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:40.993687 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf76155-8dd4-431b-b585-9a510f06a2a9 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:40.994575 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf76155-8dd4-431b-b585-9a510f06a2a9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:40.995023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf76155-8dd4-431b-b585-9a510f06a2a9 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:40.996775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 100/209] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:41.003566 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97941b4c-eb95-4d44-93e1-67f86b1a08f0 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:41.003978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97941b4c-eb95-4d44-93e1-67f86b1a08f0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:41.004362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97941b4c-eb95-4d44-93e1-67f86b1a08f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:41.022181 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-97941b4c-eb95-4d44-93e1-67f86b1a08f0 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:41.023541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-97941b4c-eb95-4d44-93e1-67f86b1a08f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:41.074350 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7210935-ed0f-47d8-a904-83bc294b96e1 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:41.074661 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7210935-ed0f-47d8-a904-83bc294b96e1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:41.074951 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7210935-ed0f-47d8-a904-83bc294b96e1 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:41.076339 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 101/210] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:41.081810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d42e0-b2b8-4f9e-97d3-5c62e1f06bee None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:41.082209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d42e0-b2b8-4f9e-97d3-5c62e1f06bee None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:41.082499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c4d42e0-b2b8-4f9e-97d3-5c62e1f06bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:41.100201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1c4d42e0-b2b8-4f9e-97d3-5c62e1f06bee None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:41.101500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1c4d42e0-b2b8-4f9e-97d3-5c62e1f06bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:41.105525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 110/211] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:41.130470 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97941b4c-eb95-4d44-93e1-67f86b1a08f0 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:41.170086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:41.178134 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 102/212] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:15:41.202372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d42e0-b2b8-4f9e-97d3-5c62e1f06bee None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:41.245745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97941b4c-eb95-4d44-93e1-67f86b1a08f0 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:41.270911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:41.284056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab53267-8ca1-44d4-837b-7d491e63e412 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:41.284948 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab53267-8ca1-44d4-837b-7d491e63e412 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:41.285235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab53267-8ca1-44d4-837b-7d491e63e412 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:41.285514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab53267-8ca1-44d4-837b-7d491e63e412 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:41.297159 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab53267-8ca1-44d4-837b-7d491e63e412 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:41.306553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-9ab53267-8ca1-44d4-837b-7d491e63e412 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:41.306553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:41.306553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:41.306553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:41.306553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:41.306553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:41.306553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:41.306553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:41.306553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:41.306553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:41.306553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:41.306553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:41.306553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:41.306553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:41.306553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:41.306553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:41.307771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:41.307771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:41.307771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:41.307771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:41.307771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:41.307771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:41.307771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:41.307771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:41.307771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:41.307771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:41.307771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:41.307771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:41.307771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:41.307771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:41.307771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:41.307771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:41.308700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:41.308700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:41.308700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:41.308700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:41.308700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:41.308700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:41.308700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:41.308700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:41.308700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:41.308700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:41.308700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:41.308700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:41.312365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 111/213] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:41.313370 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab53267-8ca1-44d4-837b-7d491e63e412 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:41.341907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c4d42e0-b2b8-4f9e-97d3-5c62e1f06bee None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:41.390014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695dcc8-e7bb-4a6f-8144-0f0ac31bf7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:41.391083 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695dcc8-e7bb-4a6f-8144-0f0ac31bf7a1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:41.391657 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695dcc8-e7bb-4a6f-8144-0f0ac31bf7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:41.392079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695dcc8-e7bb-4a6f-8144-0f0ac31bf7a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:41.394195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695dcc8-e7bb-4a6f-8144-0f0ac31bf7a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:41.396269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695dcc8-e7bb-4a6f-8144-0f0ac31bf7a1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:41.398793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 103/214] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:15:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:41.404465 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695dcc8-e7bb-4a6f-8144-0f0ac31bf7a1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:41.421527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:41.428623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab53267-8ca1-44d4-837b-7d491e63e412 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:41.465419 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64554cb-64da-46f0-8042-8cc5ae554990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:41.466197 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64554cb-64da-46f0-8042-8cc5ae554990 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:41.466613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64554cb-64da-46f0-8042-8cc5ae554990 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:41.467009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64554cb-64da-46f0-8042-8cc5ae554990 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:41.467988 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64554cb-64da-46f0-8042-8cc5ae554990 None admin] RBAC: Adding query filter params (name=member) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:41.468301 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64554cb-64da-46f0-8042-8cc5ae554990 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:41.469755 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64554cb-64da-46f0-8042-8cc5ae554990 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:41.480496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 112/215] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:41.486321 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64554cb-64da-46f0-8042-8cc5ae554990 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:41.540997 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695dcc8-e7bb-4a6f-8144-0f0ac31bf7a1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:41.563199 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:41.584534 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e76b3b-2a7f-4f3a-aef7-c403c4a0c3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:41.585477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e76b3b-2a7f-4f3a-aef7-c403c4a0c3d3 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:41.585905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e76b3b-2a7f-4f3a-aef7-c403c4a0c3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:41.586326 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e76b3b-2a7f-4f3a-aef7-c403c4a0c3d3 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:41.587661 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e76b3b-2a7f-4f3a-aef7-c403c4a0c3d3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:41.589699 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e76b3b-2a7f-4f3a-aef7-c403c4a0c3d3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:41.605251 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64554cb-64da-46f0-8042-8cc5ae554990 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:41.643147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe01ed6-24e8-4b45-9714-fecf6876c3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:41.644401 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe01ed6-24e8-4b45-9714-fecf6876c3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:41.644689 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe01ed6-24e8-4b45-9714-fecf6876c3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:41.644962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe01ed6-24e8-4b45-9714-fecf6876c3f3 None admin] PATH_INFO: `/v3/users/b39bdc66824a44298386c567afb76ebb` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:41.660174 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe01ed6-24e8-4b45-9714-fecf6876c3f3 None admin] RBAC: Authorizing `identity:get_user(user_id=b39bdc66824a44298386c567afb76ebb)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:41.661738 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe01ed6-24e8-4b45-9714-fecf6876c3f3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:41.663699 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 113/216] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:41 2022] GET /identity/v3/users/b39bdc66824a44298386c567afb76ebb => generated 297 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:41.669026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe01ed6-24e8-4b45-9714-fecf6876c3f3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:41.695176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 104/217] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:15:41 2022] POST /identity/v3/users => generated 297 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:15:41.699925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:41.790313 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe01ed6-24e8-4b45-9714-fecf6876c3f3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:41.828834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83468ce8-2043-416e-b4e2-2afa3105f45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:41.829415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83468ce8-2043-416e-b4e2-2afa3105f45b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:41.829738 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83468ce8-2043-416e-b4e2-2afa3105f45b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:41.830033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83468ce8-2043-416e-b4e2-2afa3105f45b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:41.906642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83468ce8-2043-416e-b4e2-2afa3105f45b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:41.908896 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83468ce8-2043-416e-b4e2-2afa3105f45b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:41.928824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:42.019001 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 114/218] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 19:15:42.024606 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e76b3b-2a7f-4f3a-aef7-c403c4a0c3d3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:42.150475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e76b3b-2a7f-4f3a-aef7-c403c4a0c3d3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:42.193893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea40f158-3488-4c7d-8798-e1b935fcd4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:42.194889 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40f158-3488-4c7d-8798-e1b935fcd4ad None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:42.195168 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40f158-3488-4c7d-8798-e1b935fcd4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:42.195439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea40f158-3488-4c7d-8798-e1b935fcd4ad None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:42.199504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40f158-3488-4c7d-8798-e1b935fcd4ad None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:42.200995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea40f158-3488-4c7d-8798-e1b935fcd4ad None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:42.203107 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 105/219] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:42 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:42.209519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83468ce8-2043-416e-b4e2-2afa3105f45b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:42.224615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb88f8-e609-4b83-b1aa-6adc3614ad3e None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:42.224914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb88f8-e609-4b83-b1aa-6adc3614ad3e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:42.225132 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfdb88f8-e609-4b83-b1aa-6adc3614ad3e None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:42.226842 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 106/220] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:15:42.234490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e732d7f-b37c-4ef5-ade5-5347683699a3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:42.234820 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e732d7f-b37c-4ef5-ade5-5347683699a3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:42.235086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e732d7f-b37c-4ef5-ade5-5347683699a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:42.264957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3e732d7f-b37c-4ef5-ade5-5347683699a3 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:42.266203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3e732d7f-b37c-4ef5-ade5-5347683699a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:42.309666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:42.326320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83468ce8-2043-416e-b4e2-2afa3105f45b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:42.344514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:42.358773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 107/221] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:42.358773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52fafd-5812-4661-9802-185a61ccc3bc None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:42.358773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52fafd-5812-4661-9802-185a61ccc3bc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:42.358773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b52fafd-5812-4661-9802-185a61ccc3bc None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:42.358773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 108/222] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:42.362511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721951e-8f35-47cf-9b84-a0bcd12306b7 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:42.362821 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721951e-8f35-47cf-9b84-a0bcd12306b7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:42.363332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c721951e-8f35-47cf-9b84-a0bcd12306b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:42.382434 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c721951e-8f35-47cf-9b84-a0bcd12306b7 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:42.383715 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c721951e-8f35-47cf-9b84-a0bcd12306b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:42.387511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92a5ed-5211-4418-a1c6-9491a72e8531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:42.388435 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92a5ed-5211-4418-a1c6-9491a72e8531 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:42.388943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92a5ed-5211-4418-a1c6-9491a72e8531 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:42.389418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a92a5ed-5211-4418-a1c6-9491a72e8531 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:42.390467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92a5ed-5211-4418-a1c6-9491a72e8531 None admin] RBAC: Adding query filter params (role.id=5d20b549441d429db11d5e91f3825e86, scope.project.id=7543fca6f3a747199a7adba87590509d, user.id=b39bdc66824a44298386c567afb76ebb) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:42.391081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92a5ed-5211-4418-a1c6-9491a72e8531 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:42.393012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a92a5ed-5211-4418-a1c6-9491a72e8531 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:42.401741 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 115/223] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:42 2022] GET /identity/v3/role_assignments?user.id=b39bdc66824a44298386c567afb76ebb&scope.project.id=7543fca6f3a747199a7adba87590509d&role.id=5d20b549441d429db11d5e91f3825e86 => generated 259 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:42.402947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92a5ed-5211-4418-a1c6-9491a72e8531 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:42.468243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 109/224] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:15:42.503268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721951e-8f35-47cf-9b84-a0bcd12306b7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:42.533744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a92a5ed-5211-4418-a1c6-9491a72e8531 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:42.577971 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bc9e3-279c-4e70-9e10-855ba4c0e74b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:42.578922 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bc9e3-279c-4e70-9e10-855ba4c0e74b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:42.579271 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bc9e3-279c-4e70-9e10-855ba4c0e74b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:42.579625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2bc9e3-279c-4e70-9e10-855ba4c0e74b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:42.591744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2bc9e3-279c-4e70-9e10-855ba4c0e74b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:42.601991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-6b2bc9e3-279c-4e70-9e10-855ba4c0e74b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:42.601991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:42.601991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:42.601991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:42.601991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:42.601991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:42.601991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:42.601991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:42.601991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:42.601991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:42.601991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:42.601991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:42.601991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:42.601991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:42.601991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:42.601991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:42.602972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:42.602972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:42.602972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:42.602972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:42.602972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:42.602972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:42.602972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:42.602972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:42.602972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:42.602972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:42.602972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:42.602972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:42.602972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:42.602972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:42.602972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:42.602972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:42.603798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:42.603798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:42.603798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:42.603798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:42.603798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:42.603798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:42.603798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:42.603798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:42.603798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:42.603798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:42.603798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:42.603798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:42.603798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 116/225] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:15:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:42.614001 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bc9e3-279c-4e70-9e10-855ba4c0e74b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:42.698772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:42.699118 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:42.701725 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c721951e-8f35-47cf-9b84-a0bcd12306b7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:42.765365 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e9c6-8028-4220-8ee5-d8d2bd2ea1f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:42.766176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e9c6-8028-4220-8ee5-d8d2bd2ea1f5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:42.766454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e9c6-8028-4220-8ee5-d8d2bd2ea1f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:42.766724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b0e9c6-8028-4220-8ee5-d8d2bd2ea1f5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:42.779001 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b0e9c6-8028-4220-8ee5-d8d2bd2ea1f5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:42.787401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-a9b0e9c6-8028-4220-8ee5-d8d2bd2ea1f5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:15:42.787401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:42.787401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:42.787401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:42.787401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:42.787401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:42.787401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:42.787401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:42.787401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:42.787401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:42.787401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:42.787401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:42.787401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:42.787401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:42.787401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:42.787401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:42.788343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:42.788343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:42.788343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:42.788343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:42.788343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:42.788343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:42.788343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:42.788343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:42.788343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:42.788343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:42.788343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:42.788343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:42.788343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:42.788343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:42.788343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:42.788343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:42.789164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:42.789164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:42.789164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:42.789164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:42.789164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:42.789164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:42.789164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:42.789164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:42.789164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:42.789164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:42.789164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:15:42.789164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:42.789164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 110/226] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:15:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:42.800860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e9c6-8028-4220-8ee5-d8d2bd2ea1f5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:42.869124 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2bc9e3-279c-4e70-9e10-855ba4c0e74b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:42.944595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b0e9c6-8028-4220-8ee5-d8d2bd2ea1f5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:42.956873 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d5154-4c39-49cf-a4c9-89cb19e6bcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:42.957471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d5154-4c39-49cf-a4c9-89cb19e6bcf0 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:42.957752 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d5154-4c39-49cf-a4c9-89cb19e6bcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:42.958022 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d5154-4c39-49cf-a4c9-89cb19e6bcf0 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:42.958804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d5154-4c39-49cf-a4c9-89cb19e6bcf0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:42.959115 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d5154-4c39-49cf-a4c9-89cb19e6bcf0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:42.960496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d5154-4c39-49cf-a4c9-89cb19e6bcf0 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:42.978131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 117/227] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:42.983771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d5154-4c39-49cf-a4c9-89cb19e6bcf0 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:42.995072 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff323e-42ee-4d69-a326-8e6587701201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:42.995759 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff323e-42ee-4d69-a326-8e6587701201 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:42.996398 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff323e-42ee-4d69-a326-8e6587701201 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:42.996692 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ff323e-42ee-4d69-a326-8e6587701201 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:42.997457 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff323e-42ee-4d69-a326-8e6587701201 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:42.998079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff323e-42ee-4d69-a326-8e6587701201 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:42.999802 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ff323e-42ee-4d69-a326-8e6587701201 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:43.021137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 111/228] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:15:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:43.027531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff323e-42ee-4d69-a326-8e6587701201 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:43.072826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:43.185758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d5154-4c39-49cf-a4c9-89cb19e6bcf0 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:43.187544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:43.197359 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ff323e-42ee-4d69-a326-8e6587701201 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:43.235439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0422bf3-1b42-400f-a7da-380b4f0d44ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:43.236817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0422bf3-1b42-400f-a7da-380b4f0d44ee None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:43.237105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0422bf3-1b42-400f-a7da-380b4f0d44ee None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:43.237387 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0422bf3-1b42-400f-a7da-380b4f0d44ee None admin] PATH_INFO: `/v3/users/bf4344a9576c4a7eb81ead703a9d4acd` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:43.238670 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0422bf3-1b42-400f-a7da-380b4f0d44ee None admin] RBAC: Authorizing `identity:get_user(user_id=bf4344a9576c4a7eb81ead703a9d4acd)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:43.240263 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0422bf3-1b42-400f-a7da-380b4f0d44ee None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:43.242311 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 112/229] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:43 2022] GET /identity/v3/users/bf4344a9576c4a7eb81ead703a9d4acd => generated 283 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:43.248222 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0422bf3-1b42-400f-a7da-380b4f0d44ee None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:43.258456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c3ba2-8e63-4676-b632-0ff07bc380bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:43.259379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c3ba2-8e63-4676-b632-0ff07bc380bd None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:43.259663 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c3ba2-8e63-4676-b632-0ff07bc380bd None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:43.259938 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40c3ba2-8e63-4676-b632-0ff07bc380bd None admin] PATH_INFO: `/v3/users/bf4344a9576c4a7eb81ead703a9d4acd` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:43.261283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c3ba2-8e63-4676-b632-0ff07bc380bd None admin] RBAC: Authorizing `identity:get_user(user_id=bf4344a9576c4a7eb81ead703a9d4acd)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:43.262744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40c3ba2-8e63-4676-b632-0ff07bc380bd None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:43.269805 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 118/230] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:42 2022] GET /identity/v3/users/bf4344a9576c4a7eb81ead703a9d4acd => generated 283 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:43.270706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c3ba2-8e63-4676-b632-0ff07bc380bd None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:43.404065 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40c3ba2-8e63-4676-b632-0ff07bc380bd None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:43.443402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:43.448439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0422bf3-1b42-400f-a7da-380b4f0d44ee None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:43.456414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25884a3-6c70-4a7d-8d40-8d8df1c132c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:43.457300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25884a3-6c70-4a7d-8d40-8d8df1c132c4 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:43.457578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25884a3-6c70-4a7d-8d40-8d8df1c132c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:43.457853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25884a3-6c70-4a7d-8d40-8d8df1c132c4 None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:43.459077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25884a3-6c70-4a7d-8d40-8d8df1c132c4 None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:43.460541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25884a3-6c70-4a7d-8d40-8d8df1c132c4 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:43.465260 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 119/231] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:43 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:43.471053 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25884a3-6c70-4a7d-8d40-8d8df1c132c4 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:43.490370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdcae82-4792-4ea7-88ba-c8c2a23ffae8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:43.491245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcae82-4792-4ea7-88ba-c8c2a23ffae8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:43.491534 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcae82-4792-4ea7-88ba-c8c2a23ffae8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:43.491859 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdcae82-4792-4ea7-88ba-c8c2a23ffae8 None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:43.497256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdcae82-4792-4ea7-88ba-c8c2a23ffae8 None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:43.499046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdcae82-4792-4ea7-88ba-c8c2a23ffae8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:43.502612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 113/232] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:43 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:43.508547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdcae82-4792-4ea7-88ba-c8c2a23ffae8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:43.556743 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:43.642930 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdcae82-4792-4ea7-88ba-c8c2a23ffae8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:43.700393 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25884a3-6c70-4a7d-8d40-8d8df1c132c4 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:43.702770 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e063c74-a284-4ab1-b0d6-627936820fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:43.703681 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e063c74-a284-4ab1-b0d6-627936820fcd None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:43.703964 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e063c74-a284-4ab1-b0d6-627936820fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:43.704243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e063c74-a284-4ab1-b0d6-627936820fcd None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d/users/bf4344a9576c4a7eb81ead703a9d4acd/roles/a1dd99d822514511a82daa669061e683` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:43.707318 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e063c74-a284-4ab1-b0d6-627936820fcd None admin] RBAC: Authorizing `identity:create_grant(project_id=7543fca6f3a747199a7adba87590509d, user_id=bf4344a9576c4a7eb81ead703a9d4acd, role_id=a1dd99d822514511a82daa669061e683)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:43.708868 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e063c74-a284-4ab1-b0d6-627936820fcd None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:43.745934 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25b07b7f-7ab9-47af-9302-5678cad70810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:43.746887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b07b7f-7ab9-47af-9302-5678cad70810 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:43.747218 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b07b7f-7ab9-47af-9302-5678cad70810 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:43.747499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25b07b7f-7ab9-47af-9302-5678cad70810 None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d/users/bf4344a9576c4a7eb81ead703a9d4acd/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:43.749539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b07b7f-7ab9-47af-9302-5678cad70810 None admin] RBAC: Authorizing `identity:create_grant(project_id=7543fca6f3a747199a7adba87590509d, user_id=bf4344a9576c4a7eb81ead703a9d4acd, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:43.751069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25b07b7f-7ab9-47af-9302-5678cad70810 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:43.766345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 114/233] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:15:43 2022] PUT /identity/v3/projects/7543fca6f3a747199a7adba87590509d/users/bf4344a9576c4a7eb81ead703a9d4acd/roles/a1dd99d822514511a82daa669061e683 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:15:43.864294 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 120/234] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:15:43 2022] PUT /identity/v3/projects/7543fca6f3a747199a7adba87590509d/users/bf4344a9576c4a7eb81ead703a9d4acd/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 394 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:15:44.308276 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8157-daf0-4075-b4fa-1b9ae4431276 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:44.309011 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8157-daf0-4075-b4fa-1b9ae4431276 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:44.309011 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac0c8157-daf0-4075-b4fa-1b9ae4431276 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:44.310216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 115/235] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:44.316375 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da91186-1ad5-45b9-8c3c-91693325693b None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:44.316908 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da91186-1ad5-45b9-8c3c-91693325693b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:44.316908 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da91186-1ad5-45b9-8c3c-91693325693b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:44.339567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5da91186-1ad5-45b9-8c3c-91693325693b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:44.340758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5da91186-1ad5-45b9-8c3c-91693325693b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:44.388550 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aadf7-face-4dcb-b5f8-0a5d308e114d None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:44.388872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aadf7-face-4dcb-b5f8-0a5d308e114d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:44.389084 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54aadf7-face-4dcb-b5f8-0a5d308e114d None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:44.391870 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 116/236] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:44.397069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d448fcb-9ccc-4bad-a854-3058cbc951de None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:44.397336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d448fcb-9ccc-4bad-a854-3058cbc951de None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:44.397615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d448fcb-9ccc-4bad-a854-3058cbc951de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:44.425980 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2d448fcb-9ccc-4bad-a854-3058cbc951de None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:44.427208 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2d448fcb-9ccc-4bad-a854-3058cbc951de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:44.434450 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 121/237] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:44.456732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:44.487891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da91186-1ad5-45b9-8c3c-91693325693b None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:44.541101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:44.570382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 117/238] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:44.593179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d448fcb-9ccc-4bad-a854-3058cbc951de None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:44.650807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da91186-1ad5-45b9-8c3c-91693325693b None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:44.688740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36657e9e-30e8-4e1e-aa48-944a64d2fc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:44.689714 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36657e9e-30e8-4e1e-aa48-944a64d2fc54 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:44.690004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36657e9e-30e8-4e1e-aa48-944a64d2fc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:44.690279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36657e9e-30e8-4e1e-aa48-944a64d2fc54 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:44.716672 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36657e9e-30e8-4e1e-aa48-944a64d2fc54 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:44.721562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d448fcb-9ccc-4bad-a854-3058cbc951de None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:44.729044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-36657e9e-30e8-4e1e-aa48-944a64d2fc54 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:44.729044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:44.729044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:44.729044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:44.729044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:44.729044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:44.729044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:44.729044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:44.729044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:44.729044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:44.729044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:44.729044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:44.729044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:44.729044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:44.729044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:44.729044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:44.729951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:44.729951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:44.729951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:44.729951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:44.729951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:44.729951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:44.729951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:44.729951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:44.729951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:44.729951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:44.729951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:44.729951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:44.729951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:44.729951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:44.729951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:44.729951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:44.730768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:44.730768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:44.730768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:44.730768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:44.730768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:44.730768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:44.730768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:44.730768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:44.730768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:44.730768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:44.730768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:44.730768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:44.733151 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 122/239] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:44.734665 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9cb85-3743-4019-8b2d-cd1d9b6da18c None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:44.735168 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9cb85-3743-4019-8b2d-cd1d9b6da18c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:44.735652 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e9cb85-3743-4019-8b2d-cd1d9b6da18c None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:44.738134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 123/240] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:44.743058 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9cb85-3743-4019-8b2d-cd1d9b6da18c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:44.759973 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37824a78-7fdd-4426-93d5-48a01175ee82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:44.760765 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37824a78-7fdd-4426-93d5-48a01175ee82 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:44.761055 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37824a78-7fdd-4426-93d5-48a01175ee82 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:44.761330 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37824a78-7fdd-4426-93d5-48a01175ee82 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:44.762621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37824a78-7fdd-4426-93d5-48a01175ee82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:44.764333 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37824a78-7fdd-4426-93d5-48a01175ee82 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:44.766420 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 118/241] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:15:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:44.767890 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78354742-04f9-46c7-806d-73d7735b5a56 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:44.768172 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78354742-04f9-46c7-806d-73d7735b5a56 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:44.768820 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78354742-04f9-46c7-806d-73d7735b5a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:44.788266 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-78354742-04f9-46c7-806d-73d7735b5a56 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:44.789465 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-78354742-04f9-46c7-806d-73d7735b5a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:44.802484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:44.862473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:44.862851 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 119/242] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:44.871008 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78354742-04f9-46c7-806d-73d7735b5a56 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:44.897250 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e9cb85-3743-4019-8b2d-cd1d9b6da18c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:44.949273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3120da-b429-4875-8823-c7d13816d377 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:44.950274 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3120da-b429-4875-8823-c7d13816d377 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:44.950772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3120da-b429-4875-8823-c7d13816d377 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:44.951449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3120da-b429-4875-8823-c7d13816d377 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:44.952946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3120da-b429-4875-8823-c7d13816d377 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:44.953413 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3120da-b429-4875-8823-c7d13816d377 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:44.955747 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3120da-b429-4875-8823-c7d13816d377 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:44.967974 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 124/243] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:44.969539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3120da-b429-4875-8823-c7d13816d377 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:44.989513 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78354742-04f9-46c7-806d-73d7735b5a56 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:45.034437 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af9d05-b93e-44e3-8b0b-343a2b126ac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:45.035811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af9d05-b93e-44e3-8b0b-343a2b126ac7 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:45.036247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af9d05-b93e-44e3-8b0b-343a2b126ac7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:45.036671 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7af9d05-b93e-44e3-8b0b-343a2b126ac7 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:45.037529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af9d05-b93e-44e3-8b0b-343a2b126ac7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:45.040000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7af9d05-b93e-44e3-8b0b-343a2b126ac7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:45.089127 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3120da-b429-4875-8823-c7d13816d377 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:45.124986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615caf5-b10c-4381-9caa-c37eda4f98e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:45.125696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615caf5-b10c-4381-9caa-c37eda4f98e8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:45.125984 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615caf5-b10c-4381-9caa-c37eda4f98e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:45.126243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c615caf5-b10c-4381-9caa-c37eda4f98e8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:45.134337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 120/244] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:15:44 2022] POST /identity/v3/users => generated 293 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:15:45.135952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af9d05-b93e-44e3-8b0b-343a2b126ac7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:45.138062 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c615caf5-b10c-4381-9caa-c37eda4f98e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:45.139576 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:45.147768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-c615caf5-b10c-4381-9caa-c37eda4f98e8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:45.147768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:45.147768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:45.147768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:45.147768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:45.147768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:45.147768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:45.147768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:45.147768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:45.147768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:45.147768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:45.147768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:45.147768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:45.147768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:45.147768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:45.147768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:45.148777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:45.148777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:45.148777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:45.148777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:45.148777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:45.148777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:45.148777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:45.148777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:45.148777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:45.148777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:45.148777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:45.148777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:45.148777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:45.148777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:45.148777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:45.148777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:45.149584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:45.149584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:45.149584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:45.149584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:45.149584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:45.149584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:45.149584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:45.149584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:45.149584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:45.149584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:45.149584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:45.149584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:45.149584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 125/245] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:45.157077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615caf5-b10c-4381-9caa-c37eda4f98e8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:45.180929 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:45.283248 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7af9d05-b93e-44e3-8b0b-343a2b126ac7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:45.327876 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa854478-f326-4850-836e-045a7dede0df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:45.330194 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa854478-f326-4850-836e-045a7dede0df None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:45.330693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa854478-f326-4850-836e-045a7dede0df None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:45.331200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa854478-f326-4850-836e-045a7dede0df None admin] PATH_INFO: `/v3/users/2d6f4e21dda546dfa398fddda520cb3b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:45.349441 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa854478-f326-4850-836e-045a7dede0df None admin] RBAC: Authorizing `identity:get_user(user_id=2d6f4e21dda546dfa398fddda520cb3b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:45.351349 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa854478-f326-4850-836e-045a7dede0df None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:45.353684 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 121/246] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:45 2022] GET /identity/v3/users/2d6f4e21dda546dfa398fddda520cb3b => generated 297 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:45.360051 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa854478-f326-4850-836e-045a7dede0df None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:45.399811 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c615caf5-b10c-4381-9caa-c37eda4f98e8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:45.445941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:45.449139 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a6726-c5cc-4f94-a9b0-49ea06bb07af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:45.449921 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6726-c5cc-4f94-a9b0-49ea06bb07af None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:45.450303 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6726-c5cc-4f94-a9b0-49ea06bb07af None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:45.450791 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3a6726-c5cc-4f94-a9b0-49ea06bb07af None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:45.451639 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a6726-c5cc-4f94-a9b0-49ea06bb07af None admin] RBAC: Adding query filter params (name=member) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:45.452046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a6726-c5cc-4f94-a9b0-49ea06bb07af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:45.453507 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f3a6726-c5cc-4f94-a9b0-49ea06bb07af None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:45.464165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 126/247] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:45.469870 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a6726-c5cc-4f94-a9b0-49ea06bb07af None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:45.495627 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa854478-f326-4850-836e-045a7dede0df None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:45.538039 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d248b4d-7a9e-4b91-9bc5-9caee27d6956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:45.539056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d248b4d-7a9e-4b91-9bc5-9caee27d6956 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:45.539489 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d248b4d-7a9e-4b91-9bc5-9caee27d6956 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:45.539912 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d248b4d-7a9e-4b91-9bc5-9caee27d6956 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:45.546061 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:45.581044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f3a6726-c5cc-4f94-a9b0-49ea06bb07af None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:45.625839 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5ecbf-ccd8-4813-8a54-93046234e7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:45.627702 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5ecbf-ccd8-4813-8a54-93046234e7bd None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:45.628635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d248b4d-7a9e-4b91-9bc5-9caee27d6956 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:45.629205 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5ecbf-ccd8-4813-8a54-93046234e7bd None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:45.629559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5ecbf-ccd8-4813-8a54-93046234e7bd None admin] PATH_INFO: `/v3/users/b39bdc66824a44298386c567afb76ebb` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:45.630866 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d248b4d-7a9e-4b91-9bc5-9caee27d6956 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:45.630975 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5ecbf-ccd8-4813-8a54-93046234e7bd None admin] RBAC: Authorizing `identity:get_user(user_id=b39bdc66824a44298386c567afb76ebb)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:45.632468 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5ecbf-ccd8-4813-8a54-93046234e7bd None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:45.634239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 127/248] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:45 2022] GET /identity/v3/users/b39bdc66824a44298386c567afb76ebb => generated 297 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:45.639961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5ecbf-ccd8-4813-8a54-93046234e7bd None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:45.714590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:45.765977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 122/249] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:15:45.773431 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d248b4d-7a9e-4b91-9bc5-9caee27d6956 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:45.792270 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5ecbf-ccd8-4813-8a54-93046234e7bd None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:45.852472 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d8f7b-ead5-4548-8606-b93b7cac18a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:45.853376 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d8f7b-ead5-4548-8606-b93b7cac18a0 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:45.853655 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d8f7b-ead5-4548-8606-b93b7cac18a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:45.853934 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138d8f7b-ead5-4548-8606-b93b7cac18a0 None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:45.855230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d8f7b-ead5-4548-8606-b93b7cac18a0 None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:45.856681 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138d8f7b-ead5-4548-8606-b93b7cac18a0 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:45.858426 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 128/250] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:45 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:45.864782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d8f7b-ead5-4548-8606-b93b7cac18a0 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:45.880452 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:45.916857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d248b4d-7a9e-4b91-9bc5-9caee27d6956 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:45.955990 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43177b-b226-49ab-b83d-82a6cc708b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:45.956866 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43177b-b226-49ab-b83d-82a6cc708b93 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:45.957198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43177b-b226-49ab-b83d-82a6cc708b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:45.957483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c43177b-b226-49ab-b83d-82a6cc708b93 None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:45.958723 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43177b-b226-49ab-b83d-82a6cc708b93 None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:45.960238 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c43177b-b226-49ab-b83d-82a6cc708b93 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:45.962357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 123/251] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:45 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:45.971942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43177b-b226-49ab-b83d-82a6cc708b93 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:46.011057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:46.025224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138d8f7b-ead5-4548-8606-b93b7cac18a0 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:46.090198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fbf32d6-ba26-4eba-b913-9c85984cfac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:46.091756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf32d6-ba26-4eba-b913-9c85984cfac6 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:46.092367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf32d6-ba26-4eba-b913-9c85984cfac6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:46.092830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fbf32d6-ba26-4eba-b913-9c85984cfac6 None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d/users/b39bdc66824a44298386c567afb76ebb/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:46.096551 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf32d6-ba26-4eba-b913-9c85984cfac6 None admin] RBAC: Authorizing `identity:create_grant(project_id=7543fca6f3a747199a7adba87590509d, user_id=b39bdc66824a44298386c567afb76ebb, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:46.099422 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fbf32d6-ba26-4eba-b913-9c85984cfac6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:46.149857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c43177b-b226-49ab-b83d-82a6cc708b93 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:46.197888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 129/252] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:15:45 2022] PUT /identity/v3/projects/7543fca6f3a747199a7adba87590509d/users/b39bdc66824a44298386c567afb76ebb/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 330 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:15:46.207127 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61abc2d-2052-4cd3-b398-494c735719af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:46.207807 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61abc2d-2052-4cd3-b398-494c735719af None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:46.208090 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61abc2d-2052-4cd3-b398-494c735719af None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:46.208366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61abc2d-2052-4cd3-b398-494c735719af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:46.209221 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61abc2d-2052-4cd3-b398-494c735719af None admin] RBAC: Adding query filter params (role.id=5ef1e825011442a2b31c10b82ae1b427, scope.project.id=7543fca6f3a747199a7adba87590509d, user.id=2d6f4e21dda546dfa398fddda520cb3b) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:46.209533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61abc2d-2052-4cd3-b398-494c735719af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:46.211038 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61abc2d-2052-4cd3-b398-494c735719af None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:46.217760 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 124/253] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:45 2022] GET /identity/v3/role_assignments?user.id=2d6f4e21dda546dfa398fddda520cb3b&scope.project.id=7543fca6f3a747199a7adba87590509d&role.id=5ef1e825011442a2b31c10b82ae1b427 => generated 259 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:46.405283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48716cb-3e02-467f-99aa-faf06b53043a None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:46.405790 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48716cb-3e02-467f-99aa-faf06b53043a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:46.406229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48716cb-3e02-467f-99aa-faf06b53043a None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:46.410206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 130/254] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:46.416765 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5c19f-f8d8-47f8-a713-d61d571b60a0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:46.417257 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5c19f-f8d8-47f8-a713-d61d571b60a0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:46.417330 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c5c19f-f8d8-47f8-a713-d61d571b60a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:46.440550 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-08c5c19f-f8d8-47f8-a713-d61d571b60a0 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:46.441801 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-08c5c19f-f8d8-47f8-a713-d61d571b60a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:46.540209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 125/255] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:15:46.575742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48716cb-3e02-467f-99aa-faf06b53043a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:46.621284 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55be9b8-b68d-4e8b-9480-10ab328a14a7 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:46.621919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55be9b8-b68d-4e8b-9480-10ab328a14a7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:46.622583 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55be9b8-b68d-4e8b-9480-10ab328a14a7 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:46.625405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 126/256] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:46.631330 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4737b-5af8-4aa7-88ef-05a258d34007 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:46.632291 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4737b-5af8-4aa7-88ef-05a258d34007 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:46.632776 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba4737b-5af8-4aa7-88ef-05a258d34007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:46.664849 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fba4737b-5af8-4aa7-88ef-05a258d34007 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:46.666398 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fba4737b-5af8-4aa7-88ef-05a258d34007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:46.699140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:46.699872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:46.769481 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48716cb-3e02-467f-99aa-faf06b53043a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:46.846788 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 127/257] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:15:46.856310 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373933c5-6a1d-41f4-b4db-f072b0fbce7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:46.857152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373933c5-6a1d-41f4-b4db-f072b0fbce7e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:46.857429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373933c5-6a1d-41f4-b4db-f072b0fbce7e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:46.857702 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-373933c5-6a1d-41f4-b4db-f072b0fbce7e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:46.879860 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-373933c5-6a1d-41f4-b4db-f072b0fbce7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:46.888207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-373933c5-6a1d-41f4-b4db-f072b0fbce7e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:15:46.888207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:46.888207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:46.888207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:46.888207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:46.888207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:46.888207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:46.888207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:46.888207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:46.888207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:46.888207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:46.888207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:46.888207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:46.888207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:46.888207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:46.888207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:46.889112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:46.889112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:46.889112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:46.889112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:46.889112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:46.889112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:46.889112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:46.889112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:46.889112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:46.889112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:46.889112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:46.889112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:46.889112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:46.889112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:46.889112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:46.889112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:46.889905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:46.889905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:46.889905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:46.889905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:46.889905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:46.889905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:46.889905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:46.889905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:46.889905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:46.889905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:46.889905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:15:46.889905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:46.889905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 131/258] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:15:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:46.895827 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4737b-5af8-4aa7-88ef-05a258d34007 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:46.899389 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373933c5-6a1d-41f4-b4db-f072b0fbce7e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:47.116659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba4737b-5af8-4aa7-88ef-05a258d34007 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:47.165580 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-373933c5-6a1d-41f4-b4db-f072b0fbce7e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:47.224154 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:47.235500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee28bf-2931-4575-8b6d-fbf7b5381d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:47.236418 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee28bf-2931-4575-8b6d-fbf7b5381d34 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:47.236704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee28bf-2931-4575-8b6d-fbf7b5381d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:47.247250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ee28bf-2931-4575-8b6d-fbf7b5381d34 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:47.247372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e559b82-76fc-4d06-a459-1c6112e0da4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:47.247372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559b82-76fc-4d06-a459-1c6112e0da4d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:47.247372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559b82-76fc-4d06-a459-1c6112e0da4d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:47.247372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e559b82-76fc-4d06-a459-1c6112e0da4d None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:47.247791 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e559b82-76fc-4d06-a459-1c6112e0da4d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:47.248143 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e559b82-76fc-4d06-a459-1c6112e0da4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:47.249811 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e559b82-76fc-4d06-a459-1c6112e0da4d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:47.271765 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ee28bf-2931-4575-8b6d-fbf7b5381d34 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:47.273199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 132/259] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:15:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:47.285079 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e559b82-76fc-4d06-a459-1c6112e0da4d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:47.287648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-96ee28bf-2931-4575-8b6d-fbf7b5381d34 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:47.287648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:47.287648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:47.287648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:47.287648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:47.287648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:47.287648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:47.287648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:47.287648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:47.287648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:47.287648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:47.287648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:47.287648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:47.287648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:47.287648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:47.287648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:47.288527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:47.288527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:47.288527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:47.288527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:47.288527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:47.288527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:47.288527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:47.288527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:47.288527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:47.288527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:47.288527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:47.288527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:47.288527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:47.288527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:47.288527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:47.288527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:47.289341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:47.289341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:47.289341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:47.289341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:47.289341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:47.289341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:47.289341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:47.289341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:47.289341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:47.289341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:47.289341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:15:47.289341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:47.289341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 128/260] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:15:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:47.296239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee28bf-2931-4575-8b6d-fbf7b5381d34 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:47.334017 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:47.486466 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e559b82-76fc-4d06-a459-1c6112e0da4d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:47.529906 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935b3cf-0d26-4ce8-b062-38114a53f913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:47.530813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935b3cf-0d26-4ce8-b062-38114a53f913 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:47.531094 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935b3cf-0d26-4ce8-b062-38114a53f913 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:47.531366 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935b3cf-0d26-4ce8-b062-38114a53f913 None admin] PATH_INFO: `/v3/users/bf4344a9576c4a7eb81ead703a9d4acd` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:47.533282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935b3cf-0d26-4ce8-b062-38114a53f913 None admin] RBAC: Authorizing `identity:get_user(user_id=bf4344a9576c4a7eb81ead703a9d4acd)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:47.534729 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935b3cf-0d26-4ce8-b062-38114a53f913 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:47.536693 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 133/261] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:47 2022] GET /identity/v3/users/bf4344a9576c4a7eb81ead703a9d4acd => generated 283 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:47.546205 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935b3cf-0d26-4ce8-b062-38114a53f913 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:47.584811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ee28bf-2931-4575-8b6d-fbf7b5381d34 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:47.631201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:47.662853 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388253b-b5af-4036-9de7-64599b61ad63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:47.663539 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388253b-b5af-4036-9de7-64599b61ad63 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:47.663826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388253b-b5af-4036-9de7-64599b61ad63 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:47.664102 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2388253b-b5af-4036-9de7-64599b61ad63 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:47.664858 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388253b-b5af-4036-9de7-64599b61ad63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:47.665169 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388253b-b5af-4036-9de7-64599b61ad63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:47.666561 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2388253b-b5af-4036-9de7-64599b61ad63 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:47.671557 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935b3cf-0d26-4ce8-b062-38114a53f913 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:47.683775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 129/262] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:47.690023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388253b-b5af-4036-9de7-64599b61ad63 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:47.708405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08027f-2b11-46af-a8bc-d85f838321cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:47.709119 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08027f-2b11-46af-a8bc-d85f838321cd None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:47.709398 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08027f-2b11-46af-a8bc-d85f838321cd None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:47.709672 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c08027f-2b11-46af-a8bc-d85f838321cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:47.785810 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08027f-2b11-46af-a8bc-d85f838321cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:47.787588 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c08027f-2b11-46af-a8bc-d85f838321cd None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:47.833443 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:47.859218 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:47.882405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2388253b-b5af-4036-9de7-64599b61ad63 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:47.895951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 134/263] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 19:15:47.906597 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08027f-2b11-46af-a8bc-d85f838321cd None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:47.950286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1710e2b-0d2f-4292-8cc4-5c8725ac6263 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:47.951193 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1710e2b-0d2f-4292-8cc4-5c8725ac6263 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:47.951478 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1710e2b-0d2f-4292-8cc4-5c8725ac6263 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:47.951755 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1710e2b-0d2f-4292-8cc4-5c8725ac6263 None admin] PATH_INFO: `/v3/users/bf4344a9576c4a7eb81ead703a9d4acd` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:47.954088 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1710e2b-0d2f-4292-8cc4-5c8725ac6263 None admin] RBAC: Authorizing `identity:get_user(user_id=bf4344a9576c4a7eb81ead703a9d4acd)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:47.955948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1710e2b-0d2f-4292-8cc4-5c8725ac6263 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:47.959005 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 130/264] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:47 2022] GET /identity/v3/users/bf4344a9576c4a7eb81ead703a9d4acd => generated 283 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:47.964387 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1710e2b-0d2f-4292-8cc4-5c8725ac6263 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:48.114870 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c08027f-2b11-46af-a8bc-d85f838321cd None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:48.172796 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caa69e-bc0e-493c-b7e5-48873fe7d45c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:48.174203 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa69e-bc0e-493c-b7e5-48873fe7d45c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:48.174682 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa69e-bc0e-493c-b7e5-48873fe7d45c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:48.175174 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44caa69e-bc0e-493c-b7e5-48873fe7d45c None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:48.176954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44caa69e-bc0e-493c-b7e5-48873fe7d45c None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:48.178925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44caa69e-bc0e-493c-b7e5-48873fe7d45c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:48.186629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 135/265] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:47 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:48.188050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caa69e-bc0e-493c-b7e5-48873fe7d45c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:48.232043 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:48.269738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1710e2b-0d2f-4292-8cc4-5c8725ac6263 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:48.346006 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44caa69e-bc0e-493c-b7e5-48873fe7d45c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:48.372158 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25c951-05a9-4b7c-a088-b12c411bff6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:48.372747 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25c951-05a9-4b7c-a088-b12c411bff6b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:48.373032 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25c951-05a9-4b7c-a088-b12c411bff6b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:48.373309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f25c951-05a9-4b7c-a088-b12c411bff6b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:48.390445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0880e525-6744-491e-8ce3-8910e4235b38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:48.391486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880e525-6744-491e-8ce3-8910e4235b38 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:48.392606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880e525-6744-491e-8ce3-8910e4235b38 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:48.393097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0880e525-6744-491e-8ce3-8910e4235b38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:48.394380 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880e525-6744-491e-8ce3-8910e4235b38 None admin] RBAC: Adding query filter params (role.id=a1dd99d822514511a82daa669061e683, scope.project.id=7543fca6f3a747199a7adba87590509d, user.id=bf4344a9576c4a7eb81ead703a9d4acd) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:48.394932 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880e525-6744-491e-8ce3-8910e4235b38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:48.396575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0880e525-6744-491e-8ce3-8910e4235b38 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:48.402909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:48.404138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 136/266] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:48 2022] GET /identity/v3/role_assignments?user.id=bf4344a9576c4a7eb81ead703a9d4acd&scope.project.id=7543fca6f3a747199a7adba87590509d&role.id=a1dd99d822514511a82daa669061e683 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:48.513865 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25c951-05a9-4b7c-a088-b12c411bff6b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:48.515395 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f25c951-05a9-4b7c-a088-b12c411bff6b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:48.565372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8e91b-5c00-4fb9-bab1-e46b9200ad31 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:48.566329 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8e91b-5c00-4fb9-bab1-e46b9200ad31 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:48.566833 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b8e91b-5c00-4fb9-bab1-e46b9200ad31 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:48.570942 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 137/267] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:15:48.574894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e48c-3f0c-4f74-998a-e77ee86af50d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:48.575459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e48c-3f0c-4f74-998a-e77ee86af50d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:48.575929 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c651e48c-3f0c-4f74-998a-e77ee86af50d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:48.593720 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c651e48c-3f0c-4f74-998a-e77ee86af50d None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:48.596119 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c651e48c-3f0c-4f74-998a-e77ee86af50d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:48.678864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 138/268] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:15:48.696879 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651e48c-3f0c-4f74-998a-e77ee86af50d None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:48.703806 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 131/269] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 740 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:15:48.709888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25c951-05a9-4b7c-a088-b12c411bff6b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:48.723080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:48.808848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c651e48c-3f0c-4f74-998a-e77ee86af50d None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:48.815401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:48.845891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cb60b-e5bf-4fd4-b712-7dd5a0063843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:48.846866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cb60b-e5bf-4fd4-b712-7dd5a0063843 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:48.847240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cb60b-e5bf-4fd4-b712-7dd5a0063843 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:48.847604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28cb60b-e5bf-4fd4-b712-7dd5a0063843 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:48.848895 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cb60b-e5bf-4fd4-b712-7dd5a0063843 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:48.850428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28cb60b-e5bf-4fd4-b712-7dd5a0063843 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:48.855008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 139/270] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:15:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:48.858180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cb60b-e5bf-4fd4-b712-7dd5a0063843 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:48.955824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:48.958216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f25c951-05a9-4b7c-a088-b12c411bff6b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:48.968650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28cb60b-e5bf-4fd4-b712-7dd5a0063843 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:49.005865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc5d57a-6061-41e8-b1bd-828e81e95bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:49.006544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5d57a-6061-41e8-b1bd-828e81e95bd4 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:49.006848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5d57a-6061-41e8-b1bd-828e81e95bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:49.007123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc5d57a-6061-41e8-b1bd-828e81e95bd4 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:49.007837 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5d57a-6061-41e8-b1bd-828e81e95bd4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:49.009282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc5d57a-6061-41e8-b1bd-828e81e95bd4 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:49.027293 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc9592c9-6406-4c26-8c64-4aec1a74f6cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:49.033171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9592c9-6406-4c26-8c64-4aec1a74f6cd None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:49.033171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9592c9-6406-4c26-8c64-4aec1a74f6cd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:49.033171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc9592c9-6406-4c26-8c64-4aec1a74f6cd None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:49.033171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9592c9-6406-4c26-8c64-4aec1a74f6cd None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:49.033171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc9592c9-6406-4c26-8c64-4aec1a74f6cd None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:49.034722 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 132/271] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:48 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:49.035855 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca19b-cba3-4e1d-b18c-699b6f7b612e None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:49.036143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca19b-cba3-4e1d-b18c-699b6f7b612e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:49.036416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59aca19b-cba3-4e1d-b18c-699b6f7b612e None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:49.037695 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 133/272] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:49.042475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aca19b-cba3-4e1d-b18c-699b6f7b612e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:49.131161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 140/273] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:15:48 2022] POST /identity/v3/users => generated 293 bytes in 273 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:15:49.136223 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3f9c2-b126-420a-8e6d-70eae3826cc5 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:49.136533 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3f9c2-b126-420a-8e6d-70eae3826cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:49.136765 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e3f9c2-b126-420a-8e6d-70eae3826cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:49.168776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a6e3f9c2-b126-420a-8e6d-70eae3826cc5 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:49.169994 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a6e3f9c2-b126-420a-8e6d-70eae3826cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:49.183922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59aca19b-cba3-4e1d-b18c-699b6f7b612e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:49.202840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:49.246588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abe9ae-c825-48ff-a6e3-05a8da7004af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:49.247191 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abe9ae-c825-48ff-a6e3-05a8da7004af None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:49.247475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abe9ae-c825-48ff-a6e3-05a8da7004af None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:49.247880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10abe9ae-c825-48ff-a6e3-05a8da7004af None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:49.248602 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abe9ae-c825-48ff-a6e3-05a8da7004af None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=7543fca6f3a747199a7adba87590509d, user.id=bf4344a9576c4a7eb81ead703a9d4acd) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:49.248914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abe9ae-c825-48ff-a6e3-05a8da7004af None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:49.250390 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10abe9ae-c825-48ff-a6e3-05a8da7004af None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:49.257169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 141/274] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:49.259026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11d014-69f9-494b-8f77-ca3a9677c717 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:49.259584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11d014-69f9-494b-8f77-ca3a9677c717 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:49.260072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b11d014-69f9-494b-8f77-ca3a9677c717 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:49.261762 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 142/275] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:49.263247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 134/276] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:49 2022] GET /identity/v3/role_assignments?user.id=bf4344a9576c4a7eb81ead703a9d4acd&scope.project.id=7543fca6f3a747199a7adba87590509d&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 608 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:49.280627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040cc91-389c-4d27-9725-da90deef11f7 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:49.280951 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abe9ae-c825-48ff-a6e3-05a8da7004af None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:49.281781 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040cc91-389c-4d27-9725-da90deef11f7 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:49.282285 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a040cc91-389c-4d27-9725-da90deef11f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:49.312562 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a040cc91-389c-4d27-9725-da90deef11f7 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:49.314375 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a040cc91-389c-4d27-9725-da90deef11f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:49.417990 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 143/277] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:49.439285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10abe9ae-c825-48ff-a6e3-05a8da7004af None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:49.443614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040cc91-389c-4d27-9725-da90deef11f7 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:49.446681 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:49.483957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31634ea-030b-4ef1-9361-32d5f6215a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:49.484769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31634ea-030b-4ef1-9361-32d5f6215a19 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:49.485061 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31634ea-030b-4ef1-9361-32d5f6215a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:49.485342 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31634ea-030b-4ef1-9361-32d5f6215a19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:49.497371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31634ea-030b-4ef1-9361-32d5f6215a19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:49.506047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-d31634ea-030b-4ef1-9361-32d5f6215a19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:49.506047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:49.506047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:49.506047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:49.506047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:49.506047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:49.506047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:49.506047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:49.506047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:49.506047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:49.506047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:49.506047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:49.506047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:49.506047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:49.506047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:49.506047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:49.507125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:49.507125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:49.507125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:49.507125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:49.507125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:49.507125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:49.507125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:49.507125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:49.507125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:49.507125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:49.507125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:49.507125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:49.507125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:49.507125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:49.507125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:49.507125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:49.508126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:49.508126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:49.508126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:49.508126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:49.508126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:49.508126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:49.508126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:49.508126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:49.508126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:49.508126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:49.508126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:49.508126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:49.508126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 135/278] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:15:49.509021 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7287b32-8c58-43d5-8998-7ddd2472762c None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:49.509021 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7287b32-8c58-43d5-8998-7ddd2472762c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:49.509247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7287b32-8c58-43d5-8998-7ddd2472762c None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:49.510924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 136/279] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:49.516986 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7287b32-8c58-43d5-8998-7ddd2472762c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:49.564115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:49.580576 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a040cc91-389c-4d27-9725-da90deef11f7 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:49.630330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ea31af-37a9-4c3d-ad14-2e157c866d2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:49.631342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea31af-37a9-4c3d-ad14-2e157c866d2d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:49.631626 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea31af-37a9-4c3d-ad14-2e157c866d2d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:49.632216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ea31af-37a9-4c3d-ad14-2e157c866d2d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:49.648283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ea31af-37a9-4c3d-ad14-2e157c866d2d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:49.652449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7287b32-8c58-43d5-8998-7ddd2472762c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:49.658225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-e3ea31af-37a9-4c3d-ad14-2e157c866d2d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:49.658225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:49.658225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:49.658225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:49.658225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:49.658225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:49.658225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:49.658225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:49.658225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:49.658225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:49.658225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:49.658225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:49.658225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:49.658225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:49.658225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:49.658225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:49.659184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:49.659184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:49.659184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:49.659184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:49.659184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:49.659184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:49.659184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:49.659184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:49.659184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:49.659184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:49.659184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:49.659184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:49.659184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:49.659184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:49.659184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:49.659184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:49.660400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:49.660400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:49.660400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:49.660400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:49.660400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:49.660400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:49.660400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:49.660400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:49.660400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:49.660400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:49.660400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:49.660400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:49.660400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 144/280] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:49.661243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b43579-1429-4674-82b5-a485cfd96b72 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:49.661482 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b43579-1429-4674-82b5-a485cfd96b72 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:49.661647 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b43579-1429-4674-82b5-a485cfd96b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:49.683841 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-36b43579-1429-4674-82b5-a485cfd96b72 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:49.685531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-36b43579-1429-4674-82b5-a485cfd96b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:49.703931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ed5c8-9a80-41a2-9c56-bf1221b2478d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:49.708740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ed5c8-9a80-41a2-9c56-bf1221b2478d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:49.708740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ed5c8-9a80-41a2-9c56-bf1221b2478d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:49.708740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ed5c8-9a80-41a2-9c56-bf1221b2478d None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:49.708740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ed5c8-9a80-41a2-9c56-bf1221b2478d None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:49.708740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ed5c8-9a80-41a2-9c56-bf1221b2478d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:49.708740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af6ed5c8-9a80-41a2-9c56-bf1221b2478d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:49.721047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 137/281] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:49.722853 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ed5c8-9a80-41a2-9c56-bf1221b2478d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:49.771733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:49.782096 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 145/282] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:49.785352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b43579-1429-4674-82b5-a485cfd96b72 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:49.848220 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:49.855193 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af6ed5c8-9a80-41a2-9c56-bf1221b2478d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:49.895877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ef046-1e79-42a4-8241-fc26f3171a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:49.897056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ef046-1e79-42a4-8241-fc26f3171a4d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:49.897532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ef046-1e79-42a4-8241-fc26f3171a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:49.898016 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55ef046-1e79-42a4-8241-fc26f3171a4d None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:49.898978 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ef046-1e79-42a4-8241-fc26f3171a4d None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:49.899579 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ef046-1e79-42a4-8241-fc26f3171a4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:49.901281 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55ef046-1e79-42a4-8241-fc26f3171a4d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:49.910397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b43579-1429-4674-82b5-a485cfd96b72 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:49.912457 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 138/283] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:49.913755 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ef046-1e79-42a4-8241-fc26f3171a4d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:49.961278 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3fc90-38ff-4daa-a301-7776c7bd84ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:49.962169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3fc90-38ff-4daa-a301-7776c7bd84ab None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:49.962451 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3fc90-38ff-4daa-a301-7776c7bd84ab None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:49.962728 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c3fc90-38ff-4daa-a301-7776c7bd84ab None admin] PATH_INFO: `/v3/users/202fecdabb034418b309f6c39405c290` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:49.987460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3fc90-38ff-4daa-a301-7776c7bd84ab None admin] RBAC: Authorizing `identity:get_user(user_id=202fecdabb034418b309f6c39405c290)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:49.989572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c3fc90-38ff-4daa-a301-7776c7bd84ab None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:49.992257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 146/284] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:49 2022] GET /identity/v3/users/202fecdabb034418b309f6c39405c290 => generated 293 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:49.993828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3fc90-38ff-4daa-a301-7776c7bd84ab None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:50.039452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55ef046-1e79-42a4-8241-fc26f3171a4d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:50.073772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:50.084834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b37c7-88b5-44ba-bc35-9ee83c655c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:50.085750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b37c7-88b5-44ba-bc35-9ee83c655c88 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:50.086140 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b37c7-88b5-44ba-bc35-9ee83c655c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:50.086665 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98b37c7-88b5-44ba-bc35-9ee83c655c88 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:50.098962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98b37c7-88b5-44ba-bc35-9ee83c655c88 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:50.107444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-c98b37c7-88b5-44ba-bc35-9ee83c655c88 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:50.107444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:50.107444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:50.107444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:50.107444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:50.107444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:50.107444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:50.107444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:50.107444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:50.107444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:50.107444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:50.107444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:50.107444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:50.107444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:50.107444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:50.107444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:50.108567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:50.108567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:50.108567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:50.108567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:50.108567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:50.108567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:50.108567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:50.108567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:50.108567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:50.108567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:50.108567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:50.108567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:50.108567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:50.108567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:50.108567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:50.108567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:50.109572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:50.109572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:50.109572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:50.109572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:50.109572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:50.109572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:50.109572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:50.109572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:50.109572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:50.109572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:50.109572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:50.109572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:50.112141 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 139/285] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:49 2022] GET /identity/v3/roles/reader => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:50.118285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b37c7-88b5-44ba-bc35-9ee83c655c88 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:50.137861 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c3fc90-38ff-4daa-a301-7776c7bd84ab None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:50.144171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:50.179300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6822bd0-4931-4af7-a8e7-ead232157957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:50.180513 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6822bd0-4931-4af7-a8e7-ead232157957 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:50.180835 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6822bd0-4931-4af7-a8e7-ead232157957 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:50.181213 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6822bd0-4931-4af7-a8e7-ead232157957 None admin] PATH_INFO: `/v3/users/b39bdc66824a44298386c567afb76ebb` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:50.182604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6822bd0-4931-4af7-a8e7-ead232157957 None admin] RBAC: Authorizing `identity:get_user(user_id=b39bdc66824a44298386c567afb76ebb)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:50.184328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6822bd0-4931-4af7-a8e7-ead232157957 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:50.186215 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 147/286] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:49 2022] GET /identity/v3/users/b39bdc66824a44298386c567afb76ebb => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:50.187138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6822bd0-4931-4af7-a8e7-ead232157957 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:50.261429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98b37c7-88b5-44ba-bc35-9ee83c655c88 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:50.301317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6822bd0-4931-4af7-a8e7-ead232157957 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:50.307637 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68807b87-d78b-4aa0-b7aa-abe7acf76c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:50.308500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68807b87-d78b-4aa0-b7aa-abe7acf76c26 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:50.308930 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68807b87-d78b-4aa0-b7aa-abe7acf76c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:50.309859 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68807b87-d78b-4aa0-b7aa-abe7acf76c26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:50.310880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68807b87-d78b-4aa0-b7aa-abe7acf76c26 None admin] RBAC: Adding query filter params (role.id=5d20b549441d429db11d5e91f3825e86, user.id=202fecdabb034418b309f6c39405c290, scope.system=all) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:50.311339 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68807b87-d78b-4aa0-b7aa-abe7acf76c26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:50.314981 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68807b87-d78b-4aa0-b7aa-abe7acf76c26 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:50.322524 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 140/287] 10.222.0.40 () {56 vars in 1308 bytes} [Fri Jul 15 19:15:50 2022] GET /identity/v3/role_assignments?user.id=202fecdabb034418b309f6c39405c290&scope.system=all&role.id=5d20b549441d429db11d5e91f3825e86 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:50.323614 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68807b87-d78b-4aa0-b7aa-abe7acf76c26 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:50.325072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:50.362308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76112f4-37fd-420f-846a-d0fab03f085c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:50.364227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76112f4-37fd-420f-846a-d0fab03f085c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:50.364518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76112f4-37fd-420f-846a-d0fab03f085c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:50.364795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76112f4-37fd-420f-846a-d0fab03f085c None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:50.365570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76112f4-37fd-420f-846a-d0fab03f085c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:50.368721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76112f4-37fd-420f-846a-d0fab03f085c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:50.372271 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e76112f4-37fd-420f-846a-d0fab03f085c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:50.390653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 148/288] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:50 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:50.408375 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76112f4-37fd-420f-846a-d0fab03f085c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:50.502887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:50.526026 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68807b87-d78b-4aa0-b7aa-abe7acf76c26 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:50.554609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e76112f4-37fd-420f-846a-d0fab03f085c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:50.569493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc67e9e-1155-40a0-8c0b-21b120bcc16b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:50.570216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc67e9e-1155-40a0-8c0b-21b120bcc16b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:50.570500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc67e9e-1155-40a0-8c0b-21b120bcc16b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:50.570811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc67e9e-1155-40a0-8c0b-21b120bcc16b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:50.628575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a769d15-14cf-4287-af0e-5c42c14e10b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:50.629487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a769d15-14cf-4287-af0e-5c42c14e10b5 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:50.629748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a769d15-14cf-4287-af0e-5c42c14e10b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:50.630023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a769d15-14cf-4287-af0e-5c42c14e10b5 None admin] PATH_INFO: `/v3/users/2d6f4e21dda546dfa398fddda520cb3b` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:50.634652 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a769d15-14cf-4287-af0e-5c42c14e10b5 None admin] RBAC: Authorizing `identity:get_user(user_id=2d6f4e21dda546dfa398fddda520cb3b)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:50.636296 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a769d15-14cf-4287-af0e-5c42c14e10b5 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:50.638416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 149/289] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:50 2022] GET /identity/v3/users/2d6f4e21dda546dfa398fddda520cb3b => generated 297 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:50.644635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a769d15-14cf-4287-af0e-5c42c14e10b5 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:50.655530 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc67e9e-1155-40a0-8c0b-21b120bcc16b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:50.657025 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc67e9e-1155-40a0-8c0b-21b120bcc16b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:50.752471 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:50.776236 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 141/290] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:15:50.783510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc67e9e-1155-40a0-8c0b-21b120bcc16b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:50.803121 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:50.900069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc67e9e-1155-40a0-8c0b-21b120bcc16b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:50.926002 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a769d15-14cf-4287-af0e-5c42c14e10b5 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:50.969366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b537ec-a0bd-4c57-a765-4af81f0e40d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:50.970892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b537ec-a0bd-4c57-a765-4af81f0e40d0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:50.971178 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b537ec-a0bd-4c57-a765-4af81f0e40d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:50.971453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b537ec-a0bd-4c57-a765-4af81f0e40d0 None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:50.974105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b537ec-a0bd-4c57-a765-4af81f0e40d0 None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:50.975600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b537ec-a0bd-4c57-a765-4af81f0e40d0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:50.977350 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 142/291] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:50 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:50.989883 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b537ec-a0bd-4c57-a765-4af81f0e40d0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:51.002116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9078ca9-4bb2-4ae5-834e-e3919d5d3138 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:51.003117 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078ca9-4bb2-4ae5-834e-e3919d5d3138 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:51.003404 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078ca9-4bb2-4ae5-834e-e3919d5d3138 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:51.003705 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9078ca9-4bb2-4ae5-834e-e3919d5d3138 None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:51.007062 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9078ca9-4bb2-4ae5-834e-e3919d5d3138 None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:51.008539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9078ca9-4bb2-4ae5-834e-e3919d5d3138 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:51.010279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 150/292] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:50 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 366 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:51.016567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9078ca9-4bb2-4ae5-834e-e3919d5d3138 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:51.125587 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:51.196633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9078ca9-4bb2-4ae5-834e-e3919d5d3138 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:51.197061 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b537ec-a0bd-4c57-a765-4af81f0e40d0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:51.233299 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:51.243511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbba29e-1b04-40cd-afb6-41ccf161b0ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:51.244148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbba29e-1b04-40cd-afb6-41ccf161b0ea None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:51.244431 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbba29e-1b04-40cd-afb6-41ccf161b0ea None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:51.244705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbba29e-1b04-40cd-afb6-41ccf161b0ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:51.245551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbba29e-1b04-40cd-afb6-41ccf161b0ea None admin] RBAC: Adding query filter params (role.id=5d20b549441d429db11d5e91f3825e86, scope.project.id=7543fca6f3a747199a7adba87590509d, user.id=b39bdc66824a44298386c567afb76ebb) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:51.245863 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbba29e-1b04-40cd-afb6-41ccf161b0ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:51.247356 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbba29e-1b04-40cd-afb6-41ccf161b0ea None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:51.249325 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d4b01d-596e-44e3-9fbc-fd0652ea8c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:51.250289 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4b01d-596e-44e3-9fbc-fd0652ea8c56 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:51.250633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4b01d-596e-44e3-9fbc-fd0652ea8c56 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:51.252194 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d4b01d-596e-44e3-9fbc-fd0652ea8c56 None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d/users/2d6f4e21dda546dfa398fddda520cb3b/roles/5ef1e825011442a2b31c10b82ae1b427` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:51.253478 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4b01d-596e-44e3-9fbc-fd0652ea8c56 None admin] RBAC: Authorizing `identity:create_grant(project_id=7543fca6f3a747199a7adba87590509d, user_id=2d6f4e21dda546dfa398fddda520cb3b, role_id=5ef1e825011442a2b31c10b82ae1b427)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:51.255165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d4b01d-596e-44e3-9fbc-fd0652ea8c56 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:51.266539 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 143/293] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:50 2022] GET /identity/v3/role_assignments?user.id=b39bdc66824a44298386c567afb76ebb&scope.project.id=7543fca6f3a747199a7adba87590509d&role.id=5d20b549441d429db11d5e91f3825e86 => generated 608 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:51.332641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 151/294] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:15:51 2022] PUT /identity/v3/projects/7543fca6f3a747199a7adba87590509d/users/2d6f4e21dda546dfa398fddda520cb3b/roles/5ef1e825011442a2b31c10b82ae1b427 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:15:51.611098 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb894ff-d5f3-42c5-9588-5a2277c8b5bc None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:51.611601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb894ff-d5f3-42c5-9588-5a2277c8b5bc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:51.611601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb894ff-d5f3-42c5-9588-5a2277c8b5bc None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:51.613255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 144/295] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:51.619105 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805da1d5-0b35-4556-bf3b-dce7de277d32 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:51.619397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805da1d5-0b35-4556-bf3b-dce7de277d32 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:51.619677 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805da1d5-0b35-4556-bf3b-dce7de277d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:51.639491 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-805da1d5-0b35-4556-bf3b-dce7de277d32 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:51.641437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-805da1d5-0b35-4556-bf3b-dce7de277d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:51.683368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d31a20-990e-4db8-9738-ab47e3a506e3 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:51.683698 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d31a20-990e-4db8-9738-ab47e3a506e3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:51.684059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d31a20-990e-4db8-9738-ab47e3a506e3 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:51.685469 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 145/296] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:51.691462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b910c4-1ef2-4fc5-92a4-28788db798ea None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:51.692027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b910c4-1ef2-4fc5-92a4-28788db798ea None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:51.692533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b910c4-1ef2-4fc5-92a4-28788db798ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:51.711818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-85b910c4-1ef2-4fc5-92a4-28788db798ea None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:51.713337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-85b910c4-1ef2-4fc5-92a4-28788db798ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:51.736441 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 152/297] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:51.759612 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805da1d5-0b35-4556-bf3b-dce7de277d32 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:51.789289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 146/298] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:15:51.814669 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b910c4-1ef2-4fc5-92a4-28788db798ea None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:51.872472 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805da1d5-0b35-4556-bf3b-dce7de277d32 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:51.873114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:51.883709 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:51.911075 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89371429-c94a-4b9c-aea2-e9e0ff695bb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:51.912214 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89371429-c94a-4b9c-aea2-e9e0ff695bb2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:51.912675 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89371429-c94a-4b9c-aea2-e9e0ff695bb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:51.913136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89371429-c94a-4b9c-aea2-e9e0ff695bb2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:51.914667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89371429-c94a-4b9c-aea2-e9e0ff695bb2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:51.920367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89371429-c94a-4b9c-aea2-e9e0ff695bb2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:51.920367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 153/299] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:15:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:51.923718 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89371429-c94a-4b9c-aea2-e9e0ff695bb2 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:51.956579 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b910c4-1ef2-4fc5-92a4-28788db798ea None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:52.008319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fb652-ede1-4a5b-b4d0-790009066965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:52.009415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb652-ede1-4a5b-b4d0-790009066965 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:52.009910 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb652-ede1-4a5b-b4d0-790009066965 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:52.010363 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0fb652-ede1-4a5b-b4d0-790009066965 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:52.027542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b0fb652-ede1-4a5b-b4d0-790009066965 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:52.039254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8b0fb652-ede1-4a5b-b4d0-790009066965 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:52.039254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:52.039254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:52.039254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:52.039254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:52.039254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:52.039254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:52.039254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:52.039254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:52.039254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:52.039254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:52.039254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:52.039254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:52.039254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:52.039254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:52.039254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:52.040234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:52.040234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:52.040234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:52.040234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:52.040234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:52.040234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:52.040234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:52.040234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:52.040234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:52.040234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:52.040234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:52.040234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:52.040234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:52.040234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:52.040234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:52.040234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:52.041052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:52.041052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:52.041052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:52.041052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:52.041052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:52.041052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:52.041052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:52.041052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:52.041052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:52.041052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:52.041052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:52.041052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:52.041670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89371429-c94a-4b9c-aea2-e9e0ff695bb2 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:52.044963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 147/300] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:15:52.057294 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fb652-ede1-4a5b-b4d0-790009066965 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:52.088041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba4654-ed81-40b8-8708-d3922a1382e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:52.088901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba4654-ed81-40b8-8708-d3922a1382e8 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:52.089278 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba4654-ed81-40b8-8708-d3922a1382e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:52.089779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efba4654-ed81-40b8-8708-d3922a1382e8 None admin] PATH_INFO: `/v3/groups` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:52.090780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba4654-ed81-40b8-8708-d3922a1382e8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:52.092249 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efba4654-ed81-40b8-8708-d3922a1382e8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:52.179127 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0fb652-ede1-4a5b-b4d0-790009066965 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:52.179498 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 154/301] 10.222.0.40 () {60 vars in 1134 bytes} [Fri Jul 15 19:15:51 2022] POST /identity/v3/groups => generated 229 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:15:52.184537 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:52.225468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f4390-1917-4c58-b458-108f0ea4201d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:52.226161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f4390-1917-4c58-b458-108f0ea4201d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:52.226495 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f4390-1917-4c58-b458-108f0ea4201d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:52.226792 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8f4390-1917-4c58-b458-108f0ea4201d None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:52.227661 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f4390-1917-4c58-b458-108f0ea4201d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:52.227987 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f4390-1917-4c58-b458-108f0ea4201d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:52.229439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8f4390-1917-4c58-b458-108f0ea4201d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:52.240714 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 148/302] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:52 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:52.246710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba4654-ed81-40b8-8708-d3922a1382e8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:52.293050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:52.365957 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efba4654-ed81-40b8-8708-d3922a1382e8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:52.401930 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa26877-8762-43d7-909b-aca464c360be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:52.403079 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa26877-8762-43d7-909b-aca464c360be None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:52.403533 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa26877-8762-43d7-909b-aca464c360be None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:52.403950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa26877-8762-43d7-909b-aca464c360be None admin] PATH_INFO: `/v3/users/55a18048dec44c798cb54a81b87a92b8` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:52.419279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa26877-8762-43d7-909b-aca464c360be None admin] RBAC: Authorizing `identity:get_user(user_id=55a18048dec44c798cb54a81b87a92b8)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:52.421012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa26877-8762-43d7-909b-aca464c360be None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:52.423731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 155/303] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:52 2022] GET /identity/v3/users/55a18048dec44c798cb54a81b87a92b8 => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:52.429365 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f4390-1917-4c58-b458-108f0ea4201d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:52.540552 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8f4390-1917-4c58-b458-108f0ea4201d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:52.578313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29300363-751e-4f70-9a0b-729677c412e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:52.579453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29300363-751e-4f70-9a0b-729677c412e3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:52.579918 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29300363-751e-4f70-9a0b-729677c412e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:52.580398 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29300363-751e-4f70-9a0b-729677c412e3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:52.581427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29300363-751e-4f70-9a0b-729677c412e3 None admin] RBAC: Adding query filter params (role.id=5ef1e825011442a2b31c10b82ae1b427, user.id=55a18048dec44c798cb54a81b87a92b8, scope.system=all) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:52.581921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29300363-751e-4f70-9a0b-729677c412e3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:52.583574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29300363-751e-4f70-9a0b-729677c412e3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:52.590002 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 149/304] 10.222.0.40 () {56 vars in 1308 bytes} [Fri Jul 15 19:15:52 2022] GET /identity/v3/role_assignments?user.id=55a18048dec44c798cb54a81b87a92b8&scope.system=all&role.id=5ef1e825011442a2b31c10b82ae1b427 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:52.624410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c6849-00e6-4d44-9b88-5cbfb136f87e None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:52.624769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c6849-00e6-4d44-9b88-5cbfb136f87e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:52.624969 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c6849-00e6-4d44-9b88-5cbfb136f87e None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:52.626738 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 156/305] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:52.634066 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c812fa-a927-4201-90e4-eb63ca9a4508 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:52.634452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c812fa-a927-4201-90e4-eb63ca9a4508 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:52.634727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c812fa-a927-4201-90e4-eb63ca9a4508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:52.655874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-78c812fa-a927-4201-90e4-eb63ca9a4508 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:52.657108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-78c812fa-a927-4201-90e4-eb63ca9a4508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:52.686816 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:52.736741 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 150/306] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:52.759069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c6849-00e6-4d44-9b88-5cbfb136f87e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:52.858815 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:52.867819 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c6849-00e6-4d44-9b88-5cbfb136f87e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:52.906430 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6feac-7f7a-4b42-8168-70107c15fc1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:52.907442 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6feac-7f7a-4b42-8168-70107c15fc1a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:52.907867 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6feac-7f7a-4b42-8168-70107c15fc1a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:52.908155 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d6feac-7f7a-4b42-8168-70107c15fc1a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:52.920021 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d6feac-7f7a-4b42-8168-70107c15fc1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:52.928552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-77d6feac-7f7a-4b42-8168-70107c15fc1a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:52.928552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:52.928552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:52.928552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:52.928552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:52.928552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:52.928552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:52.928552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:52.928552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:52.928552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:52.928552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:52.928552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:52.928552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:52.928552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:52.928552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:52.928552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:52.929726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:52.929726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:52.929726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:52.929726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:52.929726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:52.929726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:52.929726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:52.929726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:52.929726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:52.929726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:52.929726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:52.929726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:52.929726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:52.929726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:52.929726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:52.929726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:52.930583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:52.930583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:52.930583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:52.930583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:52.930583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:52.930583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:52.930583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:52.930583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:52.930583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:52.930583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:52.930583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:52.930583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:52.930583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 157/307] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:52.968409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c812fa-a927-4201-90e4-eb63ca9a4508 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:53.055243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c812fa-a927-4201-90e4-eb63ca9a4508 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:53.092175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fe28b-df3f-418b-94f3-49fc6a6a5509 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:53.092901 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fe28b-df3f-418b-94f3-49fc6a6a5509 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:53.093183 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fe28b-df3f-418b-94f3-49fc6a6a5509 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:53.093457 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475fe28b-df3f-418b-94f3-49fc6a6a5509 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:53.094219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fe28b-df3f-418b-94f3-49fc6a6a5509 None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:53.094528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fe28b-df3f-418b-94f3-49fc6a6a5509 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:53.096777 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475fe28b-df3f-418b-94f3-49fc6a6a5509 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:53.106374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 151/308] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:53.115860 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6feac-7f7a-4b42-8168-70107c15fc1a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:53.225907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d6feac-7f7a-4b42-8168-70107c15fc1a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:53.264423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713e0e27-6284-4361-aa14-283f6b60e40d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:53.265931 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e0e27-6284-4361-aa14-283f6b60e40d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:53.266422 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e0e27-6284-4361-aa14-283f6b60e40d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:53.268506 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713e0e27-6284-4361-aa14-283f6b60e40d None admin] PATH_INFO: `/v3/users/202fecdabb034418b309f6c39405c290` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:53.270172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e0e27-6284-4361-aa14-283f6b60e40d None admin] RBAC: Authorizing `identity:get_user(user_id=202fecdabb034418b309f6c39405c290)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:53.272280 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713e0e27-6284-4361-aa14-283f6b60e40d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:53.274361 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 158/309] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:53 2022] GET /identity/v3/users/202fecdabb034418b309f6c39405c290 => generated 293 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:53.284344 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fe28b-df3f-418b-94f3-49fc6a6a5509 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:53.307204 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:53.386549 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475fe28b-df3f-418b-94f3-49fc6a6a5509 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:53.425049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3e1b0-5f74-4d2a-837d-c5d46d06d478 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:53.425925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3e1b0-5f74-4d2a-837d-c5d46d06d478 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:53.426210 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3e1b0-5f74-4d2a-837d-c5d46d06d478 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:53.426485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3e1b0-5f74-4d2a-837d-c5d46d06d478 None admin] PATH_INFO: `/v3/system/users/202fecdabb034418b309f6c39405c290/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:53.428103 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3e1b0-5f74-4d2a-837d-c5d46d06d478 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=202fecdabb034418b309f6c39405c290, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:53.429485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc3e1b0-5f74-4d2a-837d-c5d46d06d478 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:53.526410 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 152/310] 10.222.0.40 () {58 vars in 1334 bytes} [Fri Jul 15 19:15:53 2022] PUT /identity/v3/system/users/202fecdabb034418b309f6c39405c290/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:15:53.621774 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be708497-45ae-475d-a935-03ac0d67efb0 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:53.622129 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be708497-45ae-475d-a935-03ac0d67efb0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:53.622330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be708497-45ae-475d-a935-03ac0d67efb0 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:53.624099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 159/311] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:53.630379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f02278-4732-446f-b827-985664d76123 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:53.630684 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f02278-4732-446f-b827-985664d76123 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:53.630975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f02278-4732-446f-b827-985664d76123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:53.649869 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-15f02278-4732-446f-b827-985664d76123 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:53.651129 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-15f02278-4732-446f-b827-985664d76123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:53.731450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 153/312] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:53.756387 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be708497-45ae-475d-a935-03ac0d67efb0 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:53.784467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:53.871597 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be708497-45ae-475d-a935-03ac0d67efb0 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:53.911017 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e66ff-593d-4fa5-9599-02a9ab936806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:53.911840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e66ff-593d-4fa5-9599-02a9ab936806 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:53.912120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e66ff-593d-4fa5-9599-02a9ab936806 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:53.912394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e66ff-593d-4fa5-9599-02a9ab936806 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:53.925489 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e66ff-593d-4fa5-9599-02a9ab936806 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:53.933590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-b41e66ff-593d-4fa5-9599-02a9ab936806 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:53.933590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:53.933590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:53.933590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:53.933590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:53.933590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:53.933590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:53.933590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:53.933590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:53.933590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:53.933590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:53.933590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:53.933590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:53.933590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:53.933590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:53.933590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:53.934538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:53.934538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:53.934538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:53.934538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:53.934538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:53.934538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:53.934538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:53.934538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:53.934538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:53.934538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:53.934538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:53.934538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:53.934538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:53.934538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:53.934538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:53.934538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:53.935407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:53.935407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:53.935407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:53.935407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:53.935407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:53.935407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:53.935407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:53.935407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:53.935407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:53.935407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:53.935407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:53.935407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:53.935407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 160/313] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:53 2022] GET /identity/v3/roles/reader => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:15:53.941040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f02278-4732-446f-b827-985664d76123 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:53.959392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:54.055297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f02278-4732-446f-b827-985664d76123 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:54.092788 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300db153-af81-4a8d-8b7a-f63d236faec1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:54.093451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300db153-af81-4a8d-8b7a-f63d236faec1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:54.093734 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300db153-af81-4a8d-8b7a-f63d236faec1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:54.094009 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300db153-af81-4a8d-8b7a-f63d236faec1 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:54.095320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300db153-af81-4a8d-8b7a-f63d236faec1 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:54.095627 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300db153-af81-4a8d-8b7a-f63d236faec1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:54.097005 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300db153-af81-4a8d-8b7a-f63d236faec1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:54.105826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 154/314] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:53 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:54.112111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e66ff-593d-4fa5-9599-02a9ab936806 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:54.205292 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:54.225153 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e66ff-593d-4fa5-9599-02a9ab936806 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:54.261344 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77a66199-fb08-4e77-a767-c881e28c767b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:54.262219 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a66199-fb08-4e77-a767-c881e28c767b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:54.262496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a66199-fb08-4e77-a767-c881e28c767b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:54.262788 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77a66199-fb08-4e77-a767-c881e28c767b None admin] PATH_INFO: `/v3/users/2d6f4e21dda546dfa398fddda520cb3b` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:54.263997 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a66199-fb08-4e77-a767-c881e28c767b None admin] RBAC: Authorizing `identity:get_user(user_id=2d6f4e21dda546dfa398fddda520cb3b)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:54.265449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77a66199-fb08-4e77-a767-c881e28c767b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:54.268365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 161/315] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:54 2022] GET /identity/v3/users/2d6f4e21dda546dfa398fddda520cb3b => generated 297 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:54.274086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300db153-af81-4a8d-8b7a-f63d236faec1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:54.305413 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3be4d-06cc-4d90-9e9a-65cd3ed30e04 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:54.305596 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3be4d-06cc-4d90-9e9a-65cd3ed30e04 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:54.305867 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff3be4d-06cc-4d90-9e9a-65cd3ed30e04 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:54.308491 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 162/316] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:15:54.312572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd4518-bd46-4b82-8624-f3f82b7bc174 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:54.312860 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd4518-bd46-4b82-8624-f3f82b7bc174 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:54.313129 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fd4518-bd46-4b82-8624-f3f82b7bc174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:54.330216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-37fd4518-bd46-4b82-8624-f3f82b7bc174 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:54.331437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-37fd4518-bd46-4b82-8624-f3f82b7bc174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:54.368129 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:54.393671 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300db153-af81-4a8d-8b7a-f63d236faec1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:54.406870 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 163/317] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:15:54.425640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd4518-bd46-4b82-8624-f3f82b7bc174 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:54.429637 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8860-b72a-4a8b-bc2d-96b15c532959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:54.430143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8860-b72a-4a8b-bc2d-96b15c532959 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:54.430427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8860-b72a-4a8b-bc2d-96b15c532959 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:54.430813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cb8860-b72a-4a8b-bc2d-96b15c532959 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:54.502066 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb8860-b72a-4a8b-bc2d-96b15c532959 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:54.503414 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cb8860-b72a-4a8b-bc2d-96b15c532959 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:54.534264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37fd4518-bd46-4b82-8624-f3f82b7bc174 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:54.551213 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:54.573408 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d404d6e-97dd-4ccb-a221-cdd81868c4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:54.574527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d404d6e-97dd-4ccb-a221-cdd81868c4af None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:54.575183 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d404d6e-97dd-4ccb-a221-cdd81868c4af None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:54.575753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d404d6e-97dd-4ccb-a221-cdd81868c4af None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:54.577122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d404d6e-97dd-4ccb-a221-cdd81868c4af None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:54.578778 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d404d6e-97dd-4ccb-a221-cdd81868c4af None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:54.585288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 164/318] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:15:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:54.586993 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d404d6e-97dd-4ccb-a221-cdd81868c4af None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:54.587620 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:54.608420 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 155/319] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:15:54.614274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8860-b72a-4a8b-bc2d-96b15c532959 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:54.699612 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d404d6e-97dd-4ccb-a221-cdd81868c4af None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:54.725042 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cb8860-b72a-4a8b-bc2d-96b15c532959 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:54.737990 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5d61e4-05fb-43c6-8844-2871f57409e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:54.739101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d61e4-05fb-43c6-8844-2871f57409e8 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:54.739596 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d61e4-05fb-43c6-8844-2871f57409e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:54.740077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5d61e4-05fb-43c6-8844-2871f57409e8 None admin] PATH_INFO: `/v3/groups` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:54.741005 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d61e4-05fb-43c6-8844-2871f57409e8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:54.742699 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5d61e4-05fb-43c6-8844-2871f57409e8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:54.800187 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efde44a-ee14-4c2d-bbcc-33655da369fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:54.801098 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efde44a-ee14-4c2d-bbcc-33655da369fc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:54.801382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efde44a-ee14-4c2d-bbcc-33655da369fc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:54.801656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efde44a-ee14-4c2d-bbcc-33655da369fc None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:54.802869 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efde44a-ee14-4c2d-bbcc-33655da369fc None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:54.804427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efde44a-ee14-4c2d-bbcc-33655da369fc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:54.810371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 156/320] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:54 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:54.810371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15217c6b-f2e2-4af2-a175-58a6af2ca4f7 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:54.810371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15217c6b-f2e2-4af2-a175-58a6af2ca4f7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:54.810371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15217c6b-f2e2-4af2-a175-58a6af2ca4f7 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:54.810371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 157/321] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:54.812342 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15217c6b-f2e2-4af2-a175-58a6af2ca4f7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:54.840996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 165/322] 10.222.0.40 () {60 vars in 1134 bytes} [Fri Jul 15 19:15:54 2022] POST /identity/v3/groups => generated 226 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:15:54.840996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48984c3f-91fc-43bd-9a0e-8bffb2395d53 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:54.840996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48984c3f-91fc-43bd-9a0e-8bffb2395d53 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:54.840996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48984c3f-91fc-43bd-9a0e-8bffb2395d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:54.864591 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-48984c3f-91fc-43bd-9a0e-8bffb2395d53 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:54.865814 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-48984c3f-91fc-43bd-9a0e-8bffb2395d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:54.868380 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:54.886178 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:54.948639 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 166/323] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:54.966108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15217c6b-f2e2-4af2-a175-58a6af2ca4f7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:54.970890 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48984c3f-91fc-43bd-9a0e-8bffb2395d53 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:55.013910 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c8343-91b6-4bc9-ba3d-a594e9595fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:55.014861 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c8343-91b6-4bc9-ba3d-a594e9595fea None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:55.015314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c8343-91b6-4bc9-ba3d-a594e9595fea None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:55.015734 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20c8343-91b6-4bc9-ba3d-a594e9595fea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:55.017251 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c8343-91b6-4bc9-ba3d-a594e9595fea None admin] RBAC: Adding query filter params (role.id=5ef1e825011442a2b31c10b82ae1b427, scope.project.id=7543fca6f3a747199a7adba87590509d, user.id=2d6f4e21dda546dfa398fddda520cb3b) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:55.017717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c8343-91b6-4bc9-ba3d-a594e9595fea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:55.019637 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20c8343-91b6-4bc9-ba3d-a594e9595fea None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:55.027873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 158/324] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:15:54 2022] GET /identity/v3/role_assignments?user.id=2d6f4e21dda546dfa398fddda520cb3b&scope.project.id=7543fca6f3a747199a7adba87590509d&role.id=5ef1e825011442a2b31c10b82ae1b427 => generated 608 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:55.096659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48984c3f-91fc-43bd-9a0e-8bffb2395d53 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:55.142403 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b3bb3-f712-4e66-83eb-b33f69442cc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:55.143511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b3bb3-f712-4e66-83eb-b33f69442cc1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:55.143795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b3bb3-f712-4e66-83eb-b33f69442cc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:55.144070 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b3bb3-f712-4e66-83eb-b33f69442cc1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:55.152814 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:55.157468 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b3bb3-f712-4e66-83eb-b33f69442cc1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:55.165641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-c64b3bb3-f712-4e66-83eb-b33f69442cc1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:55.165641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:55.165641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:55.165641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:55.165641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:55.165641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:55.165641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:55.165641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:55.165641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:55.165641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:55.165641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:55.165641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:55.165641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:55.165641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:55.165641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:55.165641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:55.173594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:55.173594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:55.173594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:55.173594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:55.173594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:55.173594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:55.173594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:55.173594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:55.173594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:55.173594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:55.173594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:55.173594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:55.173594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:55.173594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:55.173594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:55.173594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:55.174606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:55.174606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:55.174606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:55.174606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:55.174606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:55.174606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:55.174606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:55.174606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:55.174606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:55.174606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:55.174606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:55.174606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:55.174606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 167/325] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:15:55.176689 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c8343-91b6-4bc9-ba3d-a594e9595fea None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:55.312815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20c8343-91b6-4bc9-ba3d-a594e9595fea None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:55.325024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:55.350546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a0322-9949-460f-ba62-be7fcfec856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:55.351180 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a0322-9949-460f-ba62-be7fcfec856f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:55.351630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a0322-9949-460f-ba62-be7fcfec856f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:55.351913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101a0322-9949-460f-ba62-be7fcfec856f None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:55.352672 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a0322-9949-460f-ba62-be7fcfec856f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:55.352984 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a0322-9949-460f-ba62-be7fcfec856f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:55.354382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101a0322-9949-460f-ba62-be7fcfec856f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:55.364750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 159/326] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:55 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:55.370489 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b3bb3-f712-4e66-83eb-b33f69442cc1 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:55.492125 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b3bb3-f712-4e66-83eb-b33f69442cc1 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:55.536028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-053d2cd4-4283-4915-a00f-09785ab543b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:55.537280 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d2cd4-4283-4915-a00f-09785ab543b1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:55.537763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d2cd4-4283-4915-a00f-09785ab543b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:55.538251 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-053d2cd4-4283-4915-a00f-09785ab543b1 None admin] PATH_INFO: `/v3/users/55a18048dec44c798cb54a81b87a92b8` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:55.539778 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d2cd4-4283-4915-a00f-09785ab543b1 None admin] RBAC: Authorizing `identity:get_user(user_id=55a18048dec44c798cb54a81b87a92b8)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:55.541464 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-053d2cd4-4283-4915-a00f-09785ab543b1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:55.543746 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 168/327] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:55 2022] GET /identity/v3/users/55a18048dec44c798cb54a81b87a92b8 => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:55.549289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a0322-9949-460f-ba62-be7fcfec856f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:55.667912 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101a0322-9949-460f-ba62-be7fcfec856f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:55.707494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8578f4f-f8d0-40f0-9e78-7aecb2a482a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:55.708360 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8578f4f-f8d0-40f0-9e78-7aecb2a482a5 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:55.708645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8578f4f-f8d0-40f0-9e78-7aecb2a482a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:55.708922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8578f4f-f8d0-40f0-9e78-7aecb2a482a5 None admin] PATH_INFO: `/v3/system/users/55a18048dec44c798cb54a81b87a92b8/roles/5ef1e825011442a2b31c10b82ae1b427` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:55.710437 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8578f4f-f8d0-40f0-9e78-7aecb2a482a5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=55a18048dec44c798cb54a81b87a92b8, role_id=5ef1e825011442a2b31c10b82ae1b427)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:55.711899 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8578f4f-f8d0-40f0-9e78-7aecb2a482a5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:55.732007 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff79dd3-2e3a-4196-be33-aa5edcfdc629 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:55.732332 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff79dd3-2e3a-4196-be33-aa5edcfdc629 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:55.732572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff79dd3-2e3a-4196-be33-aa5edcfdc629 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:55.734217 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 169/328] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:15:55.740147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8013bb4-4291-4fb4-b4b0-5b0a6cc1c067 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:55.740498 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8013bb4-4291-4fb4-b4b0-5b0a6cc1c067 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:55.740838 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8013bb4-4291-4fb4-b4b0-5b0a6cc1c067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:55.777425 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 160/329] 10.222.0.40 () {58 vars in 1334 bytes} [Fri Jul 15 19:15:55 2022] PUT /identity/v3/system/users/55a18048dec44c798cb54a81b87a92b8/roles/5ef1e825011442a2b31c10b82ae1b427 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:15:55.824033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f8013bb4-4291-4fb4-b4b0-5b0a6cc1c067 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:55.825273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f8013bb4-4291-4fb4-b4b0-5b0a6cc1c067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:55.910534 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:55.924298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 170/330] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:15:55.968965 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8578f4f-f8d0-40f0-9e78-7aecb2a482a5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:56.010914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:56.089073 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8578f4f-f8d0-40f0-9e78-7aecb2a482a5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:56.128393 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acae53-8a04-4688-a48e-89a3712ff09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:56.129199 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acae53-8a04-4688-a48e-89a3712ff09a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:56.129480 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acae53-8a04-4688-a48e-89a3712ff09a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:56.129752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67acae53-8a04-4688-a48e-89a3712ff09a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:56.143222 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67acae53-8a04-4688-a48e-89a3712ff09a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:56.151022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-67acae53-8a04-4688-a48e-89a3712ff09a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:56.151022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:56.151022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:56.151022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:56.151022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:56.151022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:56.151022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:56.151022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:56.151022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:56.151022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:56.151022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:56.151022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:56.151022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:56.151022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:56.151022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:56.151022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:56.151905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:56.151905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:56.151905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:56.151905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:56.151905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:56.151905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:56.151905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:56.151905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:56.151905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:56.151905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:56.151905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:56.151905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:56.151905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:56.151905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:56.151905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:56.151905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:56.152727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:56.152727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:56.152727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:56.152727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:56.152727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:56.152727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:56.152727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:56.152727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:56.152727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:56.152727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:56.152727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:56.152727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:56.152727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 161/331] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:56.160218 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8013bb4-4291-4fb4-b4b0-5b0a6cc1c067 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:56.284323 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8013bb4-4291-4fb4-b4b0-5b0a6cc1c067 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:56.324793 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cf269-36da-4140-a6fc-312a5fd77c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:56.325468 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cf269-36da-4140-a6fc-312a5fd77c26 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:56.325749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cf269-36da-4140-a6fc-312a5fd77c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:56.326028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341cf269-36da-4140-a6fc-312a5fd77c26 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:56.326798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cf269-36da-4140-a6fc-312a5fd77c26 None admin] RBAC: Adding query filter params (name=member) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:56.327112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cf269-36da-4140-a6fc-312a5fd77c26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:56.328478 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-341cf269-36da-4140-a6fc-312a5fd77c26 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:56.340814 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 171/332] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:56.347267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acae53-8a04-4688-a48e-89a3712ff09a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:56.453513 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:56.463784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67acae53-8a04-4688-a48e-89a3712ff09a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:56.504503 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff48d7ea-a2dc-4752-ba9c-0196d04fe5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:56.505383 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48d7ea-a2dc-4752-ba9c-0196d04fe5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:56.505665 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48d7ea-a2dc-4752-ba9c-0196d04fe5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:56.505938 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff48d7ea-a2dc-4752-ba9c-0196d04fe5d9 None admin] PATH_INFO: `/v3/users/202fecdabb034418b309f6c39405c290` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:56.507182 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48d7ea-a2dc-4752-ba9c-0196d04fe5d9 None admin] RBAC: Authorizing `identity:get_user(user_id=202fecdabb034418b309f6c39405c290)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:56.508628 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff48d7ea-a2dc-4752-ba9c-0196d04fe5d9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:56.510623 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 162/333] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:15:56 2022] GET /identity/v3/users/202fecdabb034418b309f6c39405c290 => generated 293 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:56.516074 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cf269-36da-4140-a6fc-312a5fd77c26 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:56.661701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:56.755159 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341cf269-36da-4140-a6fc-312a5fd77c26 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:56.828949 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad7824-9717-4ecd-9aa2-8d5683286450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:56.829612 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad7824-9717-4ecd-9aa2-8d5683286450 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:56.830059 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad7824-9717-4ecd-9aa2-8d5683286450 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:56.830338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad7824-9717-4ecd-9aa2-8d5683286450 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:56.831271 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad7824-9717-4ecd-9aa2-8d5683286450 None admin] RBAC: Adding query filter params (role.id=5d20b549441d429db11d5e91f3825e86, user.id=202fecdabb034418b309f6c39405c290, scope.system=all) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:56.831587 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad7824-9717-4ecd-9aa2-8d5683286450 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:56.833012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad7824-9717-4ecd-9aa2-8d5683286450 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:56.854108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 172/334] 10.222.0.40 () {56 vars in 1308 bytes} [Fri Jul 15 19:15:56 2022] GET /identity/v3/role_assignments?user.id=202fecdabb034418b309f6c39405c290&scope.system=all&role.id=5d20b549441d429db11d5e91f3825e86 => generated 510 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:57.845485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69360f7c-1015-4b39-8934-3c7ffb1d86ec None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:57.846038 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69360f7c-1015-4b39-8934-3c7ffb1d86ec None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:57.846038 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69360f7c-1015-4b39-8934-3c7ffb1d86ec None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:57.847767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 163/335] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:57.853871 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b1fe9-5617-436a-97d4-04d0c9152d85 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:57.854765 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b1fe9-5617-436a-97d4-04d0c9152d85 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:57.855268 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585b1fe9-5617-436a-97d4-04d0c9152d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:57.879315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-585b1fe9-5617-436a-97d4-04d0c9152d85 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:57.880880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-585b1fe9-5617-436a-97d4-04d0c9152d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:57.967220 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 173/336] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:15:58.002347 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69360f7c-1015-4b39-8934-3c7ffb1d86ec None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:58.139627 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69360f7c-1015-4b39-8934-3c7ffb1d86ec None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:58.160786 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9f6bc-bd2c-4eb5-b1d3-5ff7a7b9c5f3 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:58.161085 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9f6bc-bd2c-4eb5-b1d3-5ff7a7b9c5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:58.161341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b9f6bc-bd2c-4eb5-b1d3-5ff7a7b9c5f3 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:58.162703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 174/337] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:15:58.168068 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be787b-2ef5-457a-bf01-8c947b798366 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:58.168354 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be787b-2ef5-457a-bf01-8c947b798366 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:58.168633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85be787b-2ef5-457a-bf01-8c947b798366 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:58.199099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-85be787b-2ef5-457a-bf01-8c947b798366 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:58.200415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-85be787b-2ef5-457a-bf01-8c947b798366 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:58.208409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16635f-8587-4061-b697-8c51e080f102 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:58.209217 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16635f-8587-4061-b697-8c51e080f102 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:58.209499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16635f-8587-4061-b697-8c51e080f102 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:58.209800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db16635f-8587-4061-b697-8c51e080f102 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:58.239712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db16635f-8587-4061-b697-8c51e080f102 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:58.247450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-db16635f-8587-4061-b697-8c51e080f102 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:58.247450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:58.247450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:58.247450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:58.247450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:58.247450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:58.247450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:58.247450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:58.247450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:58.247450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:58.247450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:58.247450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:58.247450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:58.247450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:58.247450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:58.247450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:58.248364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:58.248364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:58.248364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:58.248364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:58.248364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:58.248364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:58.248364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:58.248364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:58.248364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:58.248364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:58.248364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:58.248364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:58.248364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:58.248364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:58.248364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:58.248364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:58.249174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:58.249174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:58.249174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:58.249174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:58.249174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:58.249174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:58.249174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:58.249174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:58.249174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:58.249174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:58.249174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:58.249174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:58.251515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 164/338] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:58.256627 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16635f-8587-4061-b697-8c51e080f102 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:58.269233 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:58.320978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 175/339] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:58.324143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:58.357051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be787b-2ef5-457a-bf01-8c947b798366 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:58.458836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db16635f-8587-4061-b697-8c51e080f102 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:58.531386 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85be787b-2ef5-457a-bf01-8c947b798366 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:58.537518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5b61b-1578-4925-9207-07aebab9692e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:58.538189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5b61b-1578-4925-9207-07aebab9692e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:58.538473 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5b61b-1578-4925-9207-07aebab9692e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:58.538780 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5b61b-1578-4925-9207-07aebab9692e None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:58.539530 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5b61b-1578-4925-9207-07aebab9692e None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:58.539839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5b61b-1578-4925-9207-07aebab9692e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:58.541275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5b61b-1578-4925-9207-07aebab9692e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:58.558565 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 165/340] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:58.565289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5b61b-1578-4925-9207-07aebab9692e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:58.590375 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a246a-edd0-4612-84b0-e93a78d5c43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:58.591236 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a246a-edd0-4612-84b0-e93a78d5c43a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:58.591572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a246a-edd0-4612-84b0-e93a78d5c43a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:58.591847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966a246a-edd0-4612-84b0-e93a78d5c43a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:58.608652 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-966a246a-edd0-4612-84b0-e93a78d5c43a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:58.618072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-966a246a-edd0-4612-84b0-e93a78d5c43a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:15:58.618072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:58.618072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:58.618072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:58.618072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:58.618072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:58.618072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:58.618072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:58.618072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:58.618072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:58.618072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:58.618072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:58.618072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:58.618072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:58.618072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:58.618072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:58.619779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:58.619779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:58.619779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:58.619779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:58.619779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:58.619779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:58.619779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:58.619779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:58.619779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:58.619779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:58.619779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:58.619779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:58.619779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:58.619779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:58.619779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:58.619779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:58.621231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:58.621231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:58.621231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:58.621231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:58.621231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:58.621231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:58.621231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:58.621231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:58.621231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:58.621231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:58.621231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:15:58.621231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:58.626816 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 176/341] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:15:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:15:58.631397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a246a-edd0-4612-84b0-e93a78d5c43a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:58.699485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:58.739430 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:58.760598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5b61b-1578-4925-9207-07aebab9692e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:58.811460 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26010218-d136-46a5-90af-6c2416365477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:58.812391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26010218-d136-46a5-90af-6c2416365477 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:58.812814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26010218-d136-46a5-90af-6c2416365477 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:58.813329 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26010218-d136-46a5-90af-6c2416365477 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:58.849094 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966a246a-edd0-4612-84b0-e93a78d5c43a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:58.933504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26010218-d136-46a5-90af-6c2416365477 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:58.935360 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12927394-8a98-428f-b59e-9c4ca5ff93d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:58.936040 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927394-8a98-428f-b59e-9c4ca5ff93d7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:58.936325 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927394-8a98-428f-b59e-9c4ca5ff93d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:58.936599 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12927394-8a98-428f-b59e-9c4ca5ff93d7 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:58.936923 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26010218-d136-46a5-90af-6c2416365477 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:58.937353 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12927394-8a98-428f-b59e-9c4ca5ff93d7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:58.937664 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12927394-8a98-428f-b59e-9c4ca5ff93d7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:58.939112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12927394-8a98-428f-b59e-9c4ca5ff93d7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:58.960945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 177/342] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:15:58 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:15:58.960945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497e375-e65f-4089-9594-35319f3558ae None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:58.960945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497e375-e65f-4089-9594-35319f3558ae None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:58.960945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4497e375-e65f-4089-9594-35319f3558ae None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:58.960945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 178/343] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:58.963460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497e375-e65f-4089-9594-35319f3558ae None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:59.043223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:59.081366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 166/344] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 516 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 19:15:59.082971 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1898-a343-4f8f-ab53-4f46d844349b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:59.083400 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1898-a343-4f8f-ab53-4f46d844349b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:59.083834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b1898-a343-4f8f-ab53-4f46d844349b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:59.106390 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-de5b1898-a343-4f8f-ab53-4f46d844349b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:59.108146 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-de5b1898-a343-4f8f-ab53-4f46d844349b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:59.116880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4497e375-e65f-4089-9594-35319f3558ae None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:59.118491 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:59.161685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b52e4c-d1b0-4942-981e-0a8a3765a7e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:59.162582 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b52e4c-d1b0-4942-981e-0a8a3765a7e6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:59.163070 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b52e4c-d1b0-4942-981e-0a8a3765a7e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:59.163493 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b52e4c-d1b0-4942-981e-0a8a3765a7e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:59.199341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 167/345] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:59.208287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66121315-e8b6-4bbf-9d65-9ea46049b80c None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:59.208763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66121315-e8b6-4bbf-9d65-9ea46049b80c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:59.209209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66121315-e8b6-4bbf-9d65-9ea46049b80c None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:59.210783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 168/346] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:59 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:59.211929 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66121315-e8b6-4bbf-9d65-9ea46049b80c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:59.274605 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b52e4c-d1b0-4942-981e-0a8a3765a7e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:59.276461 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b52e4c-d1b0-4942-981e-0a8a3765a7e6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:59.340299 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66121315-e8b6-4bbf-9d65-9ea46049b80c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:59.374240 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:59.390733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b96f4bb-c5ff-4eb2-b579-95901fb40c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:59.392484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96f4bb-c5ff-4eb2-b579-95901fb40c7b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:59.393904 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96f4bb-c5ff-4eb2-b579-95901fb40c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:59.394337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b96f4bb-c5ff-4eb2-b579-95901fb40c7b None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:59.396316 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96f4bb-c5ff-4eb2-b579-95901fb40c7b None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:59.398623 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b96f4bb-c5ff-4eb2-b579-95901fb40c7b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:59.401733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 169/347] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:59 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:59.403118 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:59.404330 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8e7f0-19d6-4b4f-8b49-f125d14a645b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:59.404626 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8e7f0-19d6-4b4f-8b49-f125d14a645b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:59.404907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d8e7f0-19d6-4b4f-8b49-f125d14a645b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:59.409223 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 179/348] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:15:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 19:15:59.410367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b52e4c-d1b0-4942-981e-0a8a3765a7e6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:59.425471 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b8d8e7f0-19d6-4b4f-8b49-f125d14a645b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:15:59.427120 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b8d8e7f0-19d6-4b4f-8b49-f125d14a645b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:15:59.526263 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 170/349] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:15:59.527068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8e7f0-19d6-4b4f-8b49-f125d14a645b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:59.538993 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b52e4c-d1b0-4942-981e-0a8a3765a7e6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:59.584823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccefc5-ce07-4a87-8ac6-8d914dbfe5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:59.585637 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccefc5-ce07-4a87-8ac6-8d914dbfe5fa None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:59.585919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccefc5-ce07-4a87-8ac6-8d914dbfe5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:59.586193 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1ccefc5-ce07-4a87-8ac6-8d914dbfe5fa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:59.601875 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1ccefc5-ce07-4a87-8ac6-8d914dbfe5fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:59.607850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-c1ccefc5-ce07-4a87-8ac6-8d914dbfe5fa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:59.607850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:59.607850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:59.607850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:59.607850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:59.607850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:59.607850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:59.607850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:59.607850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:59.607850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:59.607850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:59.607850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:59.607850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:59.607850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:59.607850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:59.607850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:59.608868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:59.608868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:59.608868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:59.608868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:59.608868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:59.608868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:59.608868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:59.608868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:59.608868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:59.608868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:59.608868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:59.608868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:59.608868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:59.608868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:59.608868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:59.608868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:59.609703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:59.609703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:59.609703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:59.609703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:59.609703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:59.609703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:59.609703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:59.609703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:59.609703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:59.609703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:59.609703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:15:59.609703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:15:59.609703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 180/350] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:59.612305 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccefc5-ce07-4a87-8ac6-8d914dbfe5fa None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:59.655605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d8e7f0-19d6-4b4f-8b49-f125d14a645b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:59.672277 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:59.682736 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:59.697991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fd6c2f-843f-46d2-bf96-0944b4c53f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:59.698955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6c2f-843f-46d2-bf96-0944b4c53f4d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:59.699245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6c2f-843f-46d2-bf96-0944b4c53f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:59.699525 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fd6c2f-843f-46d2-bf96-0944b4c53f4d None admin] PATH_INFO: `/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:59.710611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd6c2f-843f-46d2-bf96-0944b4c53f4d None admin] RBAC: Authorizing `identity:get_group(group_id=f1d6bb2ceb0c4baf86a46bdc48400e30)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:59.712251 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fd6c2f-843f-46d2-bf96-0944b4c53f4d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:59.715160 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 171/351] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Jul 15 19:15:59 2022] GET /identity/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:59.716498 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53024c-d0d3-49e4-81d5-bd6d54550951 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:59.718051 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53024c-d0d3-49e4-81d5-bd6d54550951 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:59.718051 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b53024c-d0d3-49e4-81d5-bd6d54550951 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:59.718786 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 172/352] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:15:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:15:59.719471 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53024c-d0d3-49e4-81d5-bd6d54550951 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:59.743146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1ccefc5-ce07-4a87-8ac6-8d914dbfe5fa None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:59.789705 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335409a9-409e-472e-a572-aa7db9f39f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:59.791054 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335409a9-409e-472e-a572-aa7db9f39f8d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:59.791342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335409a9-409e-472e-a572-aa7db9f39f8d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:59.791623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335409a9-409e-472e-a572-aa7db9f39f8d None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:59.792914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335409a9-409e-472e-a572-aa7db9f39f8d None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:59.795227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335409a9-409e-472e-a572-aa7db9f39f8d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:59.797478 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 181/353] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:15:59 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:59.798481 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335409a9-409e-472e-a572-aa7db9f39f8d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:59.858433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b53024c-d0d3-49e4-81d5-bd6d54550951 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:59.923145 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9b88f-ffab-49df-b254-bbb2ad20ed2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:59.923974 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9b88f-ffab-49df-b254-bbb2ad20ed2c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:59.924259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9b88f-ffab-49df-b254-bbb2ad20ed2c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:59.924535 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e9b88f-ffab-49df-b254-bbb2ad20ed2c None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:59.929698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335409a9-409e-472e-a572-aa7db9f39f8d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:15:59.937439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e9b88f-ffab-49df-b254-bbb2ad20ed2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:15:59.947014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-d2e9b88f-ffab-49df-b254-bbb2ad20ed2c None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:59.947014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:15:59.947014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:15:59.947014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:15:59.947014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:15:59.947014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:15:59.947014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:15:59.947014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:15:59.947014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:15:59.947014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:15:59.947014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:15:59.947014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:15:59.947014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:15:59.947014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:15:59.947014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:15:59.947014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:15:59.947924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:15:59.947924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:15:59.947924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:15:59.947924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:15:59.947924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:15:59.947924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:15:59.947924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:15:59.947924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:15:59.947924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:15:59.947924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:15:59.947924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:15:59.947924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:15:59.947924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:15:59.947924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:15:59.947924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:15:59.947924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:15:59.948742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:15:59.948742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:15:59.948742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:15:59.948742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:15:59.948742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:15:59.948742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:15:59.948742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:15:59.948742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:15:59.948742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:15:59.948742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:15:59.948742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 15 19:15:59.948742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:15:59.951266 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 173/354] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:15:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:15:59.952468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9b88f-ffab-49df-b254-bbb2ad20ed2c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:15:59.963569 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:15:59.974859 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7832cc-b9ea-4348-944a-940504be0540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:15:59.976480 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7832cc-b9ea-4348-944a-940504be0540 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:59.976480 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7832cc-b9ea-4348-944a-940504be0540 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:59.976480 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7832cc-b9ea-4348-944a-940504be0540 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:15:59.976827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7832cc-b9ea-4348-944a-940504be0540 None admin] RBAC: Adding query filter params (name=member) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:15:59.978018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7832cc-b9ea-4348-944a-940504be0540 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:15:59.978492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7832cc-b9ea-4348-944a-940504be0540 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:15:59.992079 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 182/355] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:15:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:15:59.993268 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92cce0-e069-4c48-939d-6b91e3eec5ef None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:15:59.993555 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92cce0-e069-4c48-939d-6b91e3eec5ef None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:15:59.993893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e92cce0-e069-4c48-939d-6b91e3eec5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:00.010584 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:00.011882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-2e92cce0-e069-4c48-939d-6b91e3eec5ef None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:00.013118 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2e92cce0-e069-4c48-939d-6b91e3eec5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:00.090616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e9b88f-ffab-49df-b254-bbb2ad20ed2c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:00.104433 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 183/356] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:15:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:00.105285 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92cce0-e069-4c48-939d-6b91e3eec5ef None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:00.137637 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d960f-d692-4744-9225-9376532cc3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:00.138212 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d960f-d692-4744-9225-9376532cc3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:00.138496 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d960f-d692-4744-9225-9376532cc3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:00.138797 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d960f-d692-4744-9225-9376532cc3a0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:00.140203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d960f-d692-4744-9225-9376532cc3a0 None admin] RBAC: Adding query filter params (group.id=f1d6bb2ceb0c4baf86a46bdc48400e30, role.id=5d20b549441d429db11d5e91f3825e86, scope.project.id=3c0917f4477b4c16bde98021e0a84078) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:00.140203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d960f-d692-4744-9225-9376532cc3a0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:00.142435 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1d960f-d692-4744-9225-9376532cc3a0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:00.155169 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 174/357] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Jul 15 19:15:59 2022] GET /identity/v3/role_assignments?group.id=f1d6bb2ceb0c4baf86a46bdc48400e30&scope.project.id=3c0917f4477b4c16bde98021e0a84078&role.id=5d20b549441d429db11d5e91f3825e86 => generated 260 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:00.159769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fdb94-5c28-4a72-bea3-5b24f2e7dfee None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:00.160366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fdb94-5c28-4a72-bea3-5b24f2e7dfee None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:00.160850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10fdb94-5c28-4a72-bea3-5b24f2e7dfee None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:00.162562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 175/358] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:00.165529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fdb94-5c28-4a72-bea3-5b24f2e7dfee None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:00.257107 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e92cce0-e069-4c48-939d-6b91e3eec5ef None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:00.283334 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:00.308372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0e759-a74f-4990-865e-ef781510cabe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:00.309256 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0e759-a74f-4990-865e-ef781510cabe None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:00.309544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0e759-a74f-4990-865e-ef781510cabe None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:00.314369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de0e759-a74f-4990-865e-ef781510cabe None admin] PATH_INFO: `/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:00.314369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0e759-a74f-4990-865e-ef781510cabe None admin] RBAC: Authorizing `identity:get_group(group_id=f1d6bb2ceb0c4baf86a46bdc48400e30)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:00.314369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de0e759-a74f-4990-865e-ef781510cabe None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:00.317086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 184/359] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Jul 15 19:16:00 2022] GET /identity/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30 => generated 226 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:00.318101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0e759-a74f-4990-865e-ef781510cabe None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:00.320466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10fdb94-5c28-4a72-bea3-5b24f2e7dfee None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:00.322531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:00.365825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac42f9-4edc-4879-aa6f-8bb17ec99289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:00.366864 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac42f9-4edc-4879-aa6f-8bb17ec99289 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:00.367269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac42f9-4edc-4879-aa6f-8bb17ec99289 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:00.367552 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac42f9-4edc-4879-aa6f-8bb17ec99289 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:00.368305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac42f9-4edc-4879-aa6f-8bb17ec99289 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:00.368617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac42f9-4edc-4879-aa6f-8bb17ec99289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:00.370002 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac42f9-4edc-4879-aa6f-8bb17ec99289 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:00.381900 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 176/360] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:16:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:00.384174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac42f9-4edc-4879-aa6f-8bb17ec99289 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:00.460964 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de0e759-a74f-4990-865e-ef781510cabe None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:00.502199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a34e4-6cae-4aa8-b765-3114ebef6a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:00.502896 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a34e4-6cae-4aa8-b765-3114ebef6a68 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:00.503176 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a34e4-6cae-4aa8-b765-3114ebef6a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:00.503448 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79a34e4-6cae-4aa8-b765-3114ebef6a68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:00.518491 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac42f9-4edc-4879-aa6f-8bb17ec99289 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:00.561465 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8903aa7e-a012-4bac-b220-cb14c3ba036d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:00.562278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903aa7e-a012-4bac-b220-cb14c3ba036d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:00.562621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903aa7e-a012-4bac-b220-cb14c3ba036d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:00.562964 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8903aa7e-a012-4bac-b220-cb14c3ba036d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:00.564839 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:00.577961 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8903aa7e-a012-4bac-b220-cb14c3ba036d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:00.592144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a34e4-6cae-4aa8-b765-3114ebef6a68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:00.592144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79a34e4-6cae-4aa8-b765-3114ebef6a68 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:00.592357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8903aa7e-a012-4bac-b220-cb14c3ba036d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:00.592357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:00.592357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:00.592357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:00.592357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:00.592357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:00.592357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:00.592357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:00.592357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:00.592357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:00.592357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:00.592357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:00.592357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:00.592357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:00.592357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:00.592357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:00.593310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:00.593310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:00.593310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:00.593310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:00.593310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:00.593310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:00.593310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:00.593310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:00.593310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:00.593310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:00.593310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:00.593310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:00.593310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:00.593310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:00.593310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:00.593310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:00.594954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:00.594954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:00.594954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:00.594954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:00.594954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:00.594954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:00.594954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:00.594954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:00.594954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:00.594954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:00.594954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:00.594954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:00.594954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 177/361] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:16:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:00.594954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1da01-1d22-4508-8af6-7e204d366ec7 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:00.596057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1da01-1d22-4508-8af6-7e204d366ec7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:00.596057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62c1da01-1d22-4508-8af6-7e204d366ec7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:00.610296 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-62c1da01-1d22-4508-8af6-7e204d366ec7 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:00.611554 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-62c1da01-1d22-4508-8af6-7e204d366ec7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:00.637102 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:00.703815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 178/362] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:00.705972 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1da01-1d22-4508-8af6-7e204d366ec7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:00.738819 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 185/363] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 421 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:00.739767 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a34e4-6cae-4aa8-b765-3114ebef6a68 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:00.833642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62c1da01-1d22-4508-8af6-7e204d366ec7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:00.863517 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:00.881811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdae36f-d6ab-4e88-8a21-8f99e2d8344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:00.886653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae36f-d6ab-4e88-8a21-8f99e2d8344a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:00.886653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae36f-d6ab-4e88-8a21-8f99e2d8344a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:00.886653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdae36f-d6ab-4e88-8a21-8f99e2d8344a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:00.886653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdae36f-d6ab-4e88-8a21-8f99e2d8344a None admin] RBAC: Adding query filter params (group.id=f1d6bb2ceb0c4baf86a46bdc48400e30, role.id=a1dd99d822514511a82daa669061e683, scope.project.id=3c0917f4477b4c16bde98021e0a84078) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:00.886653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdae36f-d6ab-4e88-8a21-8f99e2d8344a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:00.887073 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79a34e4-6cae-4aa8-b765-3114ebef6a68 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:00.887149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdae36f-d6ab-4e88-8a21-8f99e2d8344a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:00.892477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 179/364] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Jul 15 19:16:00 2022] GET /identity/v3/role_assignments?group.id=f1d6bb2ceb0c4baf86a46bdc48400e30&scope.project.id=3c0917f4477b4c16bde98021e0a84078&role.id=a1dd99d822514511a82daa669061e683 => generated 260 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:00.899773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdae36f-d6ab-4e88-8a21-8f99e2d8344a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:00.929592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:00.932019 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046114b-f89f-44b8-aea5-72b450a01f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:00.933102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046114b-f89f-44b8-aea5-72b450a01f93 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:00.934147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046114b-f89f-44b8-aea5-72b450a01f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:00.934650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b046114b-f89f-44b8-aea5-72b450a01f93 None admin] PATH_INFO: `/v3/users/55a18048dec44c798cb54a81b87a92b8` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:00.936535 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046114b-f89f-44b8-aea5-72b450a01f93 None admin] RBAC: Authorizing `identity:get_user(user_id=55a18048dec44c798cb54a81b87a92b8)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:00.942911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b046114b-f89f-44b8-aea5-72b450a01f93 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:00.942911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 186/365] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:16:00 2022] GET /identity/v3/users/55a18048dec44c798cb54a81b87a92b8 => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:00.942911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046114b-f89f-44b8-aea5-72b450a01f93 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:01.052061 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdae36f-d6ab-4e88-8a21-8f99e2d8344a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:01.086525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b046114b-f89f-44b8-aea5-72b450a01f93 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:01.100004 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287932c-2ee4-44ac-8b73-21bcf1f9fd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:01.101016 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287932c-2ee4-44ac-8b73-21bcf1f9fd65 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:01.101494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287932c-2ee4-44ac-8b73-21bcf1f9fd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:01.102364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9287932c-2ee4-44ac-8b73-21bcf1f9fd65 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:01.103164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287932c-2ee4-44ac-8b73-21bcf1f9fd65 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:01.103472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287932c-2ee4-44ac-8b73-21bcf1f9fd65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:01.104860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9287932c-2ee4-44ac-8b73-21bcf1f9fd65 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:01.114925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 180/366] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:01.116055 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287932c-2ee4-44ac-8b73-21bcf1f9fd65 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:01.145684 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a63961-f530-4dd3-ac5b-c5abfa8edaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:01.146492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a63961-f530-4dd3-ac5b-c5abfa8edaaa None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:01.146905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a63961-f530-4dd3-ac5b-c5abfa8edaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:01.147086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a63961-f530-4dd3-ac5b-c5abfa8edaaa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:01.163106 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a63961-f530-4dd3-ac5b-c5abfa8edaaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:01.170850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-c5a63961-f530-4dd3-ac5b-c5abfa8edaaa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:01.170850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:01.170850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:01.170850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:01.170850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:01.170850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:01.170850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:01.170850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:01.170850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:01.170850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:01.170850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:01.170850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:01.170850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:01.170850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:01.170850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:01.170850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:01.171759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:01.171759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:01.171759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:01.171759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:01.171759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:01.171759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:01.171759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:01.171759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:01.171759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:01.171759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:01.171759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:01.171759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:01.171759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:01.171759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:01.171759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:01.171759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:01.173122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:01.173122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:01.173122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:01.173122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:01.173122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:01.173122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:01.173122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:01.173122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:01.173122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:01.173122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:01.173122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:01.173122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:01.173122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 187/367] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:01.173970 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a63961-f530-4dd3-ac5b-c5abfa8edaaa None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:01.191978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:01.247714 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:01.272692 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9287932c-2ee4-44ac-8b73-21bcf1f9fd65 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:01.289750 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a63961-f530-4dd3-ac5b-c5abfa8edaaa None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:01.324635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b694e-6464-424e-8b12-fe6b5983c01d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:01.325429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b694e-6464-424e-8b12-fe6b5983c01d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:01.325712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b694e-6464-424e-8b12-fe6b5983c01d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:01.325989 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804b694e-6464-424e-8b12-fe6b5983c01d None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:01.327940 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b694e-6464-424e-8b12-fe6b5983c01d None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:01.329768 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804b694e-6464-424e-8b12-fe6b5983c01d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:01.331711 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 181/368] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:01 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:01.332329 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b694e-6464-424e-8b12-fe6b5983c01d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:01.341335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1b955-485f-4768-876b-7273b11d20b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:01.342411 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1b955-485f-4768-876b-7273b11d20b8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:01.342411 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1b955-485f-4768-876b-7273b11d20b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:01.342578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1b955-485f-4768-876b-7273b11d20b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:01.343458 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1b955-485f-4768-876b-7273b11d20b8 None admin] RBAC: Adding query filter params (role.id=5ef1e825011442a2b31c10b82ae1b427, user.id=55a18048dec44c798cb54a81b87a92b8, scope.system=all) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:01.343775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1b955-485f-4768-876b-7273b11d20b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:01.346032 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1b955-485f-4768-876b-7273b11d20b8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:01.368174 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 188/369] 10.222.0.40 () {56 vars in 1308 bytes} [Fri Jul 15 19:16:01 2022] GET /identity/v3/role_assignments?user.id=55a18048dec44c798cb54a81b87a92b8&scope.system=all&role.id=5ef1e825011442a2b31c10b82ae1b427 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:01.369042 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1b955-485f-4768-876b-7273b11d20b8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:01.542122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:01.560179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804b694e-6464-424e-8b12-fe6b5983c01d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:01.588309 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1b955-485f-4768-876b-7273b11d20b8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:01.600653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b0b78-f8b2-4346-90d4-25abe0be1b5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:01.601319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b0b78-f8b2-4346-90d4-25abe0be1b5b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:01.601606 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b0b78-f8b2-4346-90d4-25abe0be1b5b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:01.601884 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9b0b78-f8b2-4346-90d4-25abe0be1b5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:01.627691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:01.634854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c420f-c324-4e64-bbe6-1a8ef20f278d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:01.640685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c420f-c324-4e64-bbe6-1a8ef20f278d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:01.640685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c420f-c324-4e64-bbe6-1a8ef20f278d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:01.640685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2c420f-c324-4e64-bbe6-1a8ef20f278d None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:01.640685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c420f-c324-4e64-bbe6-1a8ef20f278d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:01.640685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c420f-c324-4e64-bbe6-1a8ef20f278d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:01.640685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2c420f-c324-4e64-bbe6-1a8ef20f278d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:01.648901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 189/370] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:01.650976 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c420f-c324-4e64-bbe6-1a8ef20f278d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:01.692676 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b0b78-f8b2-4346-90d4-25abe0be1b5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:01.694193 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9b0b78-f8b2-4346-90d4-25abe0be1b5b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:01.780228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2c420f-c324-4e64-bbe6-1a8ef20f278d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:01.820494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 182/371] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 488 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:01.821485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b0b78-f8b2-4346-90d4-25abe0be1b5b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:01.824470 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c31f6-7be7-4a58-8e62-7a18cfe4168d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:01.826035 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c31f6-7be7-4a58-8e62-7a18cfe4168d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:01.826528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c31f6-7be7-4a58-8e62-7a18cfe4168d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:01.827091 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7c31f6-7be7-4a58-8e62-7a18cfe4168d None admin] PATH_INFO: `/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:01.828738 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c31f6-7be7-4a58-8e62-7a18cfe4168d None admin] RBAC: Authorizing `identity:get_group(group_id=f1d6bb2ceb0c4baf86a46bdc48400e30)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:01.830725 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7c31f6-7be7-4a58-8e62-7a18cfe4168d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:01.832886 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 190/372] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Jul 15 19:16:01 2022] GET /identity/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30 => generated 226 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:01.833950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c31f6-7be7-4a58-8e62-7a18cfe4168d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:01.838736 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:01.883663 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:01.947421 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9b0b78-f8b2-4346-90d4-25abe0be1b5b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:01.951353 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7c31f6-7be7-4a58-8e62-7a18cfe4168d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:01.989516 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a862b-7147-4e40-984d-4ef718070b59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:01.990186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a862b-7147-4e40-984d-4ef718070b59 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:01.990466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a862b-7147-4e40-984d-4ef718070b59 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:01.990784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a862b-7147-4e40-984d-4ef718070b59 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:01.993351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecd40a-eb49-4eb5-b308-6e90ae45d9c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:01.994697 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecd40a-eb49-4eb5-b308-6e90ae45d9c8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:01.995150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecd40a-eb49-4eb5-b308-6e90ae45d9c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:01.995571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daecd40a-eb49-4eb5-b308-6e90ae45d9c8 None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:01.997061 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecd40a-eb49-4eb5-b308-6e90ae45d9c8 None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:01.998667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daecd40a-eb49-4eb5-b308-6e90ae45d9c8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:02.001333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 191/373] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:01 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:02.002325 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecd40a-eb49-4eb5-b308-6e90ae45d9c8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:02.079575 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a862b-7147-4e40-984d-4ef718070b59 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:02.083659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939a862b-7147-4e40-984d-4ef718070b59 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:02.096835 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:02.132890 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daecd40a-eb49-4eb5-b308-6e90ae45d9c8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:02.141825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:02.171907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdeaf6-f998-486d-9354-54ff2ad5355e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:02.173397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdeaf6-f998-486d-9354-54ff2ad5355e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:02.173824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdeaf6-f998-486d-9354-54ff2ad5355e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:02.174241 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbdeaf6-f998-486d-9354-54ff2ad5355e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:02.175354 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdeaf6-f998-486d-9354-54ff2ad5355e None admin] RBAC: Adding query filter params (group.id=f1d6bb2ceb0c4baf86a46bdc48400e30, role.id=5d20b549441d429db11d5e91f3825e86, scope.project.id=7543fca6f3a747199a7adba87590509d) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:02.175844 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdeaf6-f998-486d-9354-54ff2ad5355e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:02.177520 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbdeaf6-f998-486d-9354-54ff2ad5355e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:02.184311 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 192/374] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Jul 15 19:16:02 2022] GET /identity/v3/role_assignments?group.id=f1d6bb2ceb0c4baf86a46bdc48400e30&scope.project.id=7543fca6f3a747199a7adba87590509d&role.id=5d20b549441d429db11d5e91f3825e86 => generated 260 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:02.185630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdeaf6-f998-486d-9354-54ff2ad5355e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:02.221431 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 183/375] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:02.226848 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a862b-7147-4e40-984d-4ef718070b59 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:02.304497 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbdeaf6-f998-486d-9354-54ff2ad5355e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:02.345918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b42bb-e07d-4cd6-9b24-71aa4bfbdb35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:02.347208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b42bb-e07d-4cd6-9b24-71aa4bfbdb35 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:02.347671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b42bb-e07d-4cd6-9b24-71aa4bfbdb35 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:02.348140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359b42bb-e07d-4cd6-9b24-71aa4bfbdb35 None admin] PATH_INFO: `/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:02.349571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b42bb-e07d-4cd6-9b24-71aa4bfbdb35 None admin] RBAC: Authorizing `identity:get_group(group_id=f1d6bb2ceb0c4baf86a46bdc48400e30)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:02.351259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359b42bb-e07d-4cd6-9b24-71aa4bfbdb35 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:02.353516 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 193/376] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Jul 15 19:16:02 2022] GET /identity/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30 => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:02.365442 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b42bb-e07d-4cd6-9b24-71aa4bfbdb35 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:02.368753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:02.380415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939a862b-7147-4e40-984d-4ef718070b59 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:02.426876 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e372e-e3d1-47ff-b744-4ac49167137e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:02.428498 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e372e-e3d1-47ff-b744-4ac49167137e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:02.428909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e372e-e3d1-47ff-b744-4ac49167137e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:02.429306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533e372e-e3d1-47ff-b744-4ac49167137e None admin] PATH_INFO: `/v3/projects/236a9e48f4d940ef9a994f185adc8b9d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:02.430850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e372e-e3d1-47ff-b744-4ac49167137e None admin] RBAC: Authorizing `identity:get_project(project_id=236a9e48f4d940ef9a994f185adc8b9d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:02.433001 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533e372e-e3d1-47ff-b744-4ac49167137e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:02.436101 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 184/377] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:02 2022] GET /identity/v3/projects/236a9e48f4d940ef9a994f185adc8b9d => generated 344 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:02.443997 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e372e-e3d1-47ff-b744-4ac49167137e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:02.483332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:02.531651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359b42bb-e07d-4cd6-9b24-71aa4bfbdb35 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:02.575380 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03be84f3-c353-4816-a89c-17d57dcc9158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:02.576281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be84f3-c353-4816-a89c-17d57dcc9158 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:02.576704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be84f3-c353-4816-a89c-17d57dcc9158 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:02.577119 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03be84f3-c353-4816-a89c-17d57dcc9158 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:02.578128 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be84f3-c353-4816-a89c-17d57dcc9158 None admin] RBAC: Adding query filter params (group.id=f1d6bb2ceb0c4baf86a46bdc48400e30, role.id=a1dd99d822514511a82daa669061e683, scope.project.id=7543fca6f3a747199a7adba87590509d) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:02.578616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be84f3-c353-4816-a89c-17d57dcc9158 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:02.580208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03be84f3-c353-4816-a89c-17d57dcc9158 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:02.588908 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 194/378] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Jul 15 19:16:02 2022] GET /identity/v3/role_assignments?group.id=f1d6bb2ceb0c4baf86a46bdc48400e30&scope.project.id=7543fca6f3a747199a7adba87590509d&role.id=a1dd99d822514511a82daa669061e683 => generated 260 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:02.637188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41669f4-df4d-462c-b6aa-469b3185353b None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:02.637374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41669f4-df4d-462c-b6aa-469b3185353b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:02.637688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41669f4-df4d-462c-b6aa-469b3185353b None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:02.639257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 195/379] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:16:02.642829 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533e372e-e3d1-47ff-b744-4ac49167137e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:02.646720 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c55817-0147-46b4-8e7b-848a7479ebb8 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:02.647092 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c55817-0147-46b4-8e7b-848a7479ebb8 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:02.647367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c55817-0147-46b4-8e7b-848a7479ebb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:02.685853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-36c55817-0147-46b4-8e7b-848a7479ebb8 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:02.687099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-36c55817-0147-46b4-8e7b-848a7479ebb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:02.715223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bb1bc-ee9a-4ff3-814c-324b104cc3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:02.716210 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bb1bc-ee9a-4ff3-814c-324b104cc3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:02.716647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bb1bc-ee9a-4ff3-814c-324b104cc3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:02.716876 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423bb1bc-ee9a-4ff3-814c-324b104cc3f3 None admin] PATH_INFO: `/v3/groups/c5cc1a5bd4474a1f8f27d6dedf7f7704` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:02.722624 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bb1bc-ee9a-4ff3-814c-324b104cc3f3 None admin] RBAC: Authorizing `identity:get_group(group_id=c5cc1a5bd4474a1f8f27d6dedf7f7704)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:02.724147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423bb1bc-ee9a-4ff3-814c-324b104cc3f3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:02.726316 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 185/380] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Jul 15 19:16:02 2022] GET /identity/v3/groups/c5cc1a5bd4474a1f8f27d6dedf7f7704 => generated 229 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:02.732275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bb1bc-ee9a-4ff3-814c-324b104cc3f3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:02.801818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:02.820268 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 196/381] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:16:02.851887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c55817-0147-46b4-8e7b-848a7479ebb8 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:02.867906 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:02.890297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423bb1bc-ee9a-4ff3-814c-324b104cc3f3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:02.930659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf565db5-f0fb-4764-9cb7-35ca07655452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:02.931620 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf565db5-f0fb-4764-9cb7-35ca07655452 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:02.931905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf565db5-f0fb-4764-9cb7-35ca07655452 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:02.932179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf565db5-f0fb-4764-9cb7-35ca07655452 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:02.933012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf565db5-f0fb-4764-9cb7-35ca07655452 None admin] RBAC: Adding query filter params (group.id=c5cc1a5bd4474a1f8f27d6dedf7f7704, role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=236a9e48f4d940ef9a994f185adc8b9d) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:02.933335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf565db5-f0fb-4764-9cb7-35ca07655452 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:02.935605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf565db5-f0fb-4764-9cb7-35ca07655452 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:02.942720 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 186/382] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Jul 15 19:16:02 2022] GET /identity/v3/role_assignments?group.id=c5cc1a5bd4474a1f8f27d6dedf7f7704&scope.project.id=236a9e48f4d940ef9a994f185adc8b9d&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 260 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:02.987064 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c55817-0147-46b4-8e7b-848a7479ebb8 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:03.031545 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4ff60-f8b5-4018-a4ec-48da94e25791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:03.033226 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4ff60-f8b5-4018-a4ec-48da94e25791 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:03.033714 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4ff60-f8b5-4018-a4ec-48da94e25791 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:03.034166 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd4ff60-f8b5-4018-a4ec-48da94e25791 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:03.047054 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd4ff60-f8b5-4018-a4ec-48da94e25791 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:03.055607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-0fd4ff60-f8b5-4018-a4ec-48da94e25791 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:03.055607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:03.055607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:03.055607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:03.055607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:03.055607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:03.055607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:03.055607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:03.055607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:03.055607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:03.055607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:03.055607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:03.055607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:03.055607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:03.055607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:03.055607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:03.056572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:03.056572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:03.056572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:03.056572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:03.056572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:03.056572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:03.056572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:03.056572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:03.056572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:03.056572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:03.056572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:03.056572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:03.056572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:03.056572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:03.056572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:03.056572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:03.057394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:03.057394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:03.057394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:03.057394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:03.057394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:03.057394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:03.057394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:03.057394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:03.057394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:03.057394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:03.057394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:03.057394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:03.061379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 197/383] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:03.068592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf565db5-f0fb-4764-9cb7-35ca07655452 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:03.201109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf565db5-f0fb-4764-9cb7-35ca07655452 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:03.248453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994835f-a802-43de-9138-c7e201b45e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:03.249396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994835f-a802-43de-9138-c7e201b45e5a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:03.249830 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994835f-a802-43de-9138-c7e201b45e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:03.250322 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c994835f-a802-43de-9138-c7e201b45e5a None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:03.251488 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994835f-a802-43de-9138-c7e201b45e5a None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:03.251950 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994835f-a802-43de-9138-c7e201b45e5a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:03.253480 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c994835f-a802-43de-9138-c7e201b45e5a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:03.267935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 187/384] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:16:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:03.273331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4ff60-f8b5-4018-a4ec-48da94e25791 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:03.348182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:03.409639 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd4ff60-f8b5-4018-a4ec-48da94e25791 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:03.452195 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e04ebf-4855-4f29-9d48-31206f91b888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:03.453041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e04ebf-4855-4f29-9d48-31206f91b888 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:03.453937 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e04ebf-4855-4f29-9d48-31206f91b888 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:03.454227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e04ebf-4855-4f29-9d48-31206f91b888 None admin] PATH_INFO: `/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:03.455708 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e04ebf-4855-4f29-9d48-31206f91b888 None admin] RBAC: Authorizing `identity:get_group(group_id=f1d6bb2ceb0c4baf86a46bdc48400e30)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:03.457381 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e04ebf-4855-4f29-9d48-31206f91b888 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:03.459449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 198/385] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Jul 15 19:16:03 2022] GET /identity/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:03.465243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994835f-a802-43de-9138-c7e201b45e5a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:03.481407 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:03.483079 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7511a6-23c0-40c7-944a-897096bf3c86 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:03.483367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7511a6-23c0-40c7-944a-897096bf3c86 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:03.483682 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7511a6-23c0-40c7-944a-897096bf3c86 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:03.485571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 199/386] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:03.494680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73d0e8-cf7b-4e19-ac38-c5182e12d5ea None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:03.495023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73d0e8-cf7b-4e19-ac38-c5182e12d5ea None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:03.495289 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c73d0e8-cf7b-4e19-ac38-c5182e12d5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:03.525318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-1c73d0e8-cf7b-4e19-ac38-c5182e12d5ea None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:03.528011 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1c73d0e8-cf7b-4e19-ac38-c5182e12d5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:03.638981 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c994835f-a802-43de-9138-c7e201b45e5a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:03.660062 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 200/387] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:16:03.694240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73d0e8-cf7b-4e19-ac38-c5182e12d5ea None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:03.708444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaadc0-b4f9-424b-912f-380615b07b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:03.709258 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaadc0-b4f9-424b-912f-380615b07b23 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:03.709545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaadc0-b4f9-424b-912f-380615b07b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:03.709821 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcaadc0-b4f9-424b-912f-380615b07b23 None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:03.711085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcaadc0-b4f9-424b-912f-380615b07b23 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:03.712559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcaadc0-b4f9-424b-912f-380615b07b23 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:03.714619 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 188/388] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:03 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:03.723762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaadc0-b4f9-424b-912f-380615b07b23 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:03.787155 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:03.867166 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:03.876449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c73d0e8-cf7b-4e19-ac38-c5182e12d5ea None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:03.921947 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcaadc0-b4f9-424b-912f-380615b07b23 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:03.945119 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e8e0f-1e11-4938-822e-5757c9e67a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:03.945933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e8e0f-1e11-4938-822e-5757c9e67a01 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:03.946215 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e8e0f-1e11-4938-822e-5757c9e67a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:03.946489 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d42e8e0f-1e11-4938-822e-5757c9e67a01 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:03.959184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d42e8e0f-1e11-4938-822e-5757c9e67a01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:03.967701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-d42e8e0f-1e11-4938-822e-5757c9e67a01 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:03.967701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:03.967701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:03.967701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:03.967701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:03.967701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:03.967701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:03.967701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:03.967701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:03.967701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:03.967701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:03.967701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:03.967701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:03.967701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:03.967701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:03.967701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:03.968840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:03.968840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:03.968840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:03.968840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:03.968840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:03.968840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:03.968840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:03.968840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:03.968840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:03.968840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:03.968840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:03.968840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:03.968840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:03.968840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:03.968840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:03.968840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:03.970917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:03.970917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:03.970917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:03.970917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:03.970917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:03.970917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:03.970917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:03.970917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:03.970917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:03.970917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:03.970917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:03.970917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:03.970917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 201/389] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:16:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:16:03.976048 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e8e0f-1e11-4938-822e-5757c9e67a01 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:04.011317 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953eb6a-758b-4c95-94ed-37146502a0b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:04.013353 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953eb6a-758b-4c95-94ed-37146502a0b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:04.013638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953eb6a-758b-4c95-94ed-37146502a0b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:04.014495 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7953eb6a-758b-4c95-94ed-37146502a0b1 None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078/groups/f1d6bb2ceb0c4baf86a46bdc48400e30/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:04.019799 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953eb6a-758b-4c95-94ed-37146502a0b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0917f4477b4c16bde98021e0a84078, group_id=f1d6bb2ceb0c4baf86a46bdc48400e30, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:04.021289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7953eb6a-758b-4c95-94ed-37146502a0b1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:04.107956 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 189/390] 10.222.0.40 () {58 vars in 1442 bytes} [Fri Jul 15 19:16:03 2022] PUT /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078/groups/f1d6bb2ceb0c4baf86a46bdc48400e30/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:04.118272 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d42e8e0f-1e11-4938-822e-5757c9e67a01 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:04.135937 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:04.159281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c75f50-7644-4145-98ff-687f1197c190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:04.159964 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c75f50-7644-4145-98ff-687f1197c190 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:04.160303 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c75f50-7644-4145-98ff-687f1197c190 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:04.160589 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c75f50-7644-4145-98ff-687f1197c190 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:04.161366 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c75f50-7644-4145-98ff-687f1197c190 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:04.161681 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c75f50-7644-4145-98ff-687f1197c190 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:04.163225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c75f50-7644-4145-98ff-687f1197c190 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:04.174513 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 202/391] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:04.180434 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953eb6a-758b-4c95-94ed-37146502a0b1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:04.316458 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7953eb6a-758b-4c95-94ed-37146502a0b1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:04.362836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94595623-0677-4bb6-b37b-3035bb0c2f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:04.364082 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94595623-0677-4bb6-b37b-3035bb0c2f71 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:04.364581 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94595623-0677-4bb6-b37b-3035bb0c2f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:04.365107 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94595623-0677-4bb6-b37b-3035bb0c2f71 None admin] PATH_INFO: `/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:04.370259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94595623-0677-4bb6-b37b-3035bb0c2f71 None admin] RBAC: Authorizing `identity:get_group(group_id=f1d6bb2ceb0c4baf86a46bdc48400e30)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:04.372136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94595623-0677-4bb6-b37b-3035bb0c2f71 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:04.374128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 190/392] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Jul 15 19:16:04 2022] GET /identity/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30 => generated 226 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:04.380672 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c75f50-7644-4145-98ff-687f1197c190 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:04.520987 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c75f50-7644-4145-98ff-687f1197c190 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:04.560156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e614d8-e338-4fcc-83cf-254a7346e722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:04.561017 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e614d8-e338-4fcc-83cf-254a7346e722 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:04.561350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e614d8-e338-4fcc-83cf-254a7346e722 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:04.561645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e614d8-e338-4fcc-83cf-254a7346e722 None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:04.562911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e614d8-e338-4fcc-83cf-254a7346e722 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:04.564384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e614d8-e338-4fcc-83cf-254a7346e722 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:04.566540 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 203/393] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:04 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:04.575793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94595623-0677-4bb6-b37b-3035bb0c2f71 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:04.579542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:04.724621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94595623-0677-4bb6-b37b-3035bb0c2f71 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:04.774881 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b79b03f-ff1a-43f1-803a-ea284532fb22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:04.776165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79b03f-ff1a-43f1-803a-ea284532fb22 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:04.776661 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79b03f-ff1a-43f1-803a-ea284532fb22 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:04.777130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b79b03f-ff1a-43f1-803a-ea284532fb22 None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078/groups/f1d6bb2ceb0c4baf86a46bdc48400e30/roles/a1dd99d822514511a82daa669061e683` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:04.784582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79b03f-ff1a-43f1-803a-ea284532fb22 None admin] RBAC: Authorizing `identity:create_grant(project_id=3c0917f4477b4c16bde98021e0a84078, group_id=f1d6bb2ceb0c4baf86a46bdc48400e30, role_id=a1dd99d822514511a82daa669061e683)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:04.786294 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b79b03f-ff1a-43f1-803a-ea284532fb22 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:04.852965 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 191/394] 10.222.0.40 () {58 vars in 1442 bytes} [Fri Jul 15 19:16:04 2022] PUT /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078/groups/f1d6bb2ceb0c4baf86a46bdc48400e30/roles/a1dd99d822514511a82daa669061e683 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:04.920560 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368b3ca-4b47-4485-8b17-a9cf154db200 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:04.920886 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368b3ca-4b47-4485-8b17-a9cf154db200 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:04.921129 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a368b3ca-4b47-4485-8b17-a9cf154db200 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:04.922888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 204/395] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:04.938195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3cff8-9f08-4b15-83fa-620090cb7e54 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:04.938900 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3cff8-9f08-4b15-83fa-620090cb7e54 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:04.939459 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3cff8-9f08-4b15-83fa-620090cb7e54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:04.964512 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-08d3cff8-9f08-4b15-83fa-620090cb7e54 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:04.966103 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-08d3cff8-9f08-4b15-83fa-620090cb7e54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:05.044527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:05.056008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd681a-6c3a-4697-ab2b-3a23081be66e None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:05.056298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd681a-6c3a-4697-ab2b-3a23081be66e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:05.056565 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dcd681a-6c3a-4697-ab2b-3a23081be66e None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:05.057125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 192/396] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:16:05.061553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 205/397] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:05.067739 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577dee2-1b29-4e60-b1d8-d54d0f959672 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:05.071249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577dee2-1b29-4e60-b1d8-d54d0f959672 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:05.071546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577dee2-1b29-4e60-b1d8-d54d0f959672 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:05.092561 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd681a-6c3a-4697-ab2b-3a23081be66e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:05.096488 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0577dee2-1b29-4e60-b1d8-d54d0f959672 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:05.096488 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0577dee2-1b29-4e60-b1d8-d54d0f959672 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:05.180596 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:05.226444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 193/398] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:05.273148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577dee2-1b29-4e60-b1d8-d54d0f959672 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:05.303495 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dcd681a-6c3a-4697-ab2b-3a23081be66e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:05.378780 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577dee2-1b29-4e60-b1d8-d54d0f959672 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:05.384773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620a2c0-4a71-4c2d-9f56-42f36b100494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:05.386070 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620a2c0-4a71-4c2d-9f56-42f36b100494 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:05.386573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620a2c0-4a71-4c2d-9f56-42f36b100494 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:05.387067 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f620a2c0-4a71-4c2d-9f56-42f36b100494 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:05.407158 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:05.412044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f620a2c0-4a71-4c2d-9f56-42f36b100494 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:05.421206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-f620a2c0-4a71-4c2d-9f56-42f36b100494 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:05.421206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:05.421206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:05.421206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:05.421206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:05.421206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:05.421206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:05.421206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:05.421206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:05.421206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:05.421206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:05.421206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:05.421206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:05.421206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:05.421206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:05.421206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:05.422955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:05.422955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:05.422955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:05.422955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:05.422955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:05.422955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:05.422955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:05.422955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:05.422955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:05.422955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:05.422955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:05.422955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:05.422955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:05.422955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:05.422955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:05.422955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:05.423821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:05.423821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:05.423821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:05.423821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:05.423821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:05.423821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:05.423821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:05.423821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:05.423821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:05.423821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:05.423821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:05.423821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:05.424528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f94860-2f8f-4a54-a26d-cb8cdaa9d48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:05.431074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f94860-2f8f-4a54-a26d-cb8cdaa9d48e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:05.431074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f94860-2f8f-4a54-a26d-cb8cdaa9d48e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:05.431074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f94860-2f8f-4a54-a26d-cb8cdaa9d48e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:05.432144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 206/399] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:05 2022] GET /identity/v3/roles/member => generated 84 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:05.438059 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620a2c0-4a71-4c2d-9f56-42f36b100494 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:05.445382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f94860-2f8f-4a54-a26d-cb8cdaa9d48e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:05.458074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-60f94860-2f8f-4a54-a26d-cb8cdaa9d48e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:05.458074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:05.458074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:05.458074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:05.458074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:05.458074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:05.458074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:05.458074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:05.458074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:05.458074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:05.458074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:05.458074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:05.458074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:05.458074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:05.458074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:05.458074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:05.459832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:05.459832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:05.459832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:05.459832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:05.459832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:05.459832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:05.459832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:05.459832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:05.459832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:05.459832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:05.459832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:05.459832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:05.459832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:05.459832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:05.459832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:05.459832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:05.461795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:05.461795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:05.461795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:05.461795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:05.461795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:05.461795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:05.461795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:05.461795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:05.461795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:05.461795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:05.461795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:05.461795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:05.464953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 194/400] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:16:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:16:05.466337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f94860-2f8f-4a54-a26d-cb8cdaa9d48e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:05.626847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f620a2c0-4a71-4c2d-9f56-42f36b100494 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:05.629472 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:05.643521 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f94860-2f8f-4a54-a26d-cb8cdaa9d48e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:05.673931 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dfc65-a3ec-4336-b00b-d9068bacd542 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:05.675138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dfc65-a3ec-4336-b00b-d9068bacd542 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:05.675666 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dfc65-a3ec-4336-b00b-d9068bacd542 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:05.676148 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dfc65-a3ec-4336-b00b-d9068bacd542 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:05.677148 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2dfc65-a3ec-4336-b00b-d9068bacd542 None admin] RBAC: Adding query filter params (name=member) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:05.677685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2dfc65-a3ec-4336-b00b-d9068bacd542 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:05.679605 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2dfc65-a3ec-4336-b00b-d9068bacd542 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:05.691087 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 207/401] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:16:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:05.692747 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41fc07-fa65-4216-9557-41ce8dccb3df None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:05.693265 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41fc07-fa65-4216-9557-41ce8dccb3df None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:05.693371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a5cff-0dbe-48eb-8c8d-fe3449d63495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:05.693867 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f41fc07-fa65-4216-9557-41ce8dccb3df None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:05.694059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5cff-0dbe-48eb-8c8d-fe3449d63495 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:05.694359 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5cff-0dbe-48eb-8c8d-fe3449d63495 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:05.694638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5cff-0dbe-48eb-8c8d-fe3449d63495 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:05.695856 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a5cff-0dbe-48eb-8c8d-fe3449d63495 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:05.696173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a5cff-0dbe-48eb-8c8d-fe3449d63495 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:05.696727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 208/402] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:05.697580 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a5cff-0dbe-48eb-8c8d-fe3449d63495 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:05.697891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41fc07-fa65-4216-9557-41ce8dccb3df None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:05.714669 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 195/403] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:05.716002 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbdd68-e839-4d68-9109-db5a8d697054 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:05.717108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbdd68-e839-4d68-9109-db5a8d697054 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:05.717108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9efbdd68-e839-4d68-9109-db5a8d697054 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:05.742360 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9efbdd68-e839-4d68-9109-db5a8d697054 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:05.744959 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9efbdd68-e839-4d68-9109-db5a8d697054 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:05.792581 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:05.827623 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 196/404] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:05.828779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbdd68-e839-4d68-9109-db5a8d697054 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:05.829157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f41fc07-fa65-4216-9557-41ce8dccb3df None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:05.869034 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14669a-66ad-416d-8f5e-09a0e689922c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:05.870251 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14669a-66ad-416d-8f5e-09a0e689922c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:05.870786 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14669a-66ad-416d-8f5e-09a0e689922c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:05.871269 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c14669a-66ad-416d-8f5e-09a0e689922c None admin] PATH_INFO: `/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:05.872648 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14669a-66ad-416d-8f5e-09a0e689922c None admin] RBAC: Authorizing `identity:get_group(group_id=f1d6bb2ceb0c4baf86a46bdc48400e30)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:05.874277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c14669a-66ad-416d-8f5e-09a0e689922c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:05.877188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 209/405] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Jul 15 19:16:05 2022] GET /identity/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30 => generated 226 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:05.878245 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14669a-66ad-416d-8f5e-09a0e689922c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:05.916299 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:05.957818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9efbdd68-e839-4d68-9109-db5a8d697054 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:05.988688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c14669a-66ad-416d-8f5e-09a0e689922c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:05.994536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34574a-ce82-429f-a792-e2919d6d1c28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:05.995437 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34574a-ce82-429f-a792-e2919d6d1c28 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:05.995723 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34574a-ce82-429f-a792-e2919d6d1c28 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:05.995999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd34574a-ce82-429f-a792-e2919d6d1c28 None admin] PATH_INFO: `/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:05.997196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34574a-ce82-429f-a792-e2919d6d1c28 None admin] RBAC: Authorizing `identity:get_group(group_id=f1d6bb2ceb0c4baf86a46bdc48400e30)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:05.998640 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd34574a-ce82-429f-a792-e2919d6d1c28 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:06.000726 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 197/406] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Jul 15 19:16:05 2022] GET /identity/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:06.001456 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34574a-ce82-429f-a792-e2919d6d1c28 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:06.028108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d1060-6049-416c-a3df-4c36740da300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:06.029180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d1060-6049-416c-a3df-4c36740da300 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:06.029614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d1060-6049-416c-a3df-4c36740da300 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:06.030105 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d1060-6049-416c-a3df-4c36740da300 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:06.041928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-643d1060-6049-416c-a3df-4c36740da300 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:06.050352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-643d1060-6049-416c-a3df-4c36740da300 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:06.050352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:06.050352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:06.050352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:06.050352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:06.050352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:06.050352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:06.050352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:06.050352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:06.050352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:06.050352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:06.050352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:06.050352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:06.050352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:06.050352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:06.050352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:06.051330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:06.051330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:06.051330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:06.051330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:06.051330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:06.051330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:06.051330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:06.051330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:06.051330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:06.051330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:06.051330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:06.051330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:06.051330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:06.051330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:06.051330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:06.051330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:06.052146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:06.052146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:06.052146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:06.052146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:06.052146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:06.052146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:06.052146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:06.052146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:06.052146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:06.052146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:06.052146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:06.052146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:06.052755 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:06.054641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 210/407] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:06.055772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d1060-6049-416c-a3df-4c36740da300 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:06.131591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd34574a-ce82-429f-a792-e2919d6d1c28 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:06.178567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54827489-d664-4e08-a463-08139342762d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:06.180500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54827489-d664-4e08-a463-08139342762d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:06.181013 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54827489-d664-4e08-a463-08139342762d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:06.181654 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54827489-d664-4e08-a463-08139342762d None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:06.183423 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54827489-d664-4e08-a463-08139342762d None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:06.185102 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54827489-d664-4e08-a463-08139342762d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:06.188577 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 198/408] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:06 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:06.190157 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54827489-d664-4e08-a463-08139342762d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:06.192059 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:06.201079 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d1060-6049-416c-a3df-4c36740da300 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:06.248179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d17da-b7e2-45dc-93f9-25f958f3454b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:06.249265 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d17da-b7e2-45dc-93f9-25f958f3454b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:06.249548 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d17da-b7e2-45dc-93f9-25f958f3454b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:06.249818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776d17da-b7e2-45dc-93f9-25f958f3454b None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:06.251498 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d17da-b7e2-45dc-93f9-25f958f3454b None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:06.253539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-776d17da-b7e2-45dc-93f9-25f958f3454b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:06.256036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 211/409] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:06 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:06.256805 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d17da-b7e2-45dc-93f9-25f958f3454b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:06.320375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54827489-d664-4e08-a463-08139342762d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:06.354078 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:06.357965 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbe5a1-6967-4551-a1c9-e3a16d5dc274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:06.358684 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbe5a1-6967-4551-a1c9-e3a16d5dc274 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:06.358995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbe5a1-6967-4551-a1c9-e3a16d5dc274 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:06.359268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ccbe5a1-6967-4551-a1c9-e3a16d5dc274 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:06.360721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbe5a1-6967-4551-a1c9-e3a16d5dc274 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:06.361029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbe5a1-6967-4551-a1c9-e3a16d5dc274 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:06.362575 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ccbe5a1-6967-4551-a1c9-e3a16d5dc274 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:06.371186 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-776d17da-b7e2-45dc-93f9-25f958f3454b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:06.371700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 199/410] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:06.372392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbe5a1-6967-4551-a1c9-e3a16d5dc274 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:06.408684 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7e1c7-ed40-4318-8534-f31fc6008268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:06.410277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7e1c7-ed40-4318-8534-f31fc6008268 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:06.410801 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7e1c7-ed40-4318-8534-f31fc6008268 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:06.411284 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd7e1c7-ed40-4318-8534-f31fc6008268 None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d/groups/f1d6bb2ceb0c4baf86a46bdc48400e30/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:06.413570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7e1c7-ed40-4318-8534-f31fc6008268 None admin] RBAC: Authorizing `identity:create_grant(project_id=7543fca6f3a747199a7adba87590509d, group_id=f1d6bb2ceb0c4baf86a46bdc48400e30, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:06.415356 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dd7e1c7-ed40-4318-8534-f31fc6008268 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:06.480513 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ccbe5a1-6967-4551-a1c9-e3a16d5dc274 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:06.520567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2acc7b2-dd35-4810-be18-3d7bdfa520d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:06.521915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acc7b2-dd35-4810-be18-3d7bdfa520d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:06.522435 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acc7b2-dd35-4810-be18-3d7bdfa520d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:06.522887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 212/411] 10.222.0.40 () {58 vars in 1442 bytes} [Fri Jul 15 19:16:06 2022] PUT /identity/v3/projects/7543fca6f3a747199a7adba87590509d/groups/f1d6bb2ceb0c4baf86a46bdc48400e30/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:06.523370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2acc7b2-dd35-4810-be18-3d7bdfa520d3 None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d/groups/f1d6bb2ceb0c4baf86a46bdc48400e30/roles/a1dd99d822514511a82daa669061e683` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:06.523889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7e1c7-ed40-4318-8534-f31fc6008268 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:06.526335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acc7b2-dd35-4810-be18-3d7bdfa520d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=7543fca6f3a747199a7adba87590509d, group_id=f1d6bb2ceb0c4baf86a46bdc48400e30, role_id=a1dd99d822514511a82daa669061e683)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:06.528475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2acc7b2-dd35-4810-be18-3d7bdfa520d3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:06.574134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:06.600024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 200/412] 10.222.0.40 () {58 vars in 1442 bytes} [Fri Jul 15 19:16:06 2022] PUT /identity/v3/projects/7543fca6f3a747199a7adba87590509d/groups/f1d6bb2ceb0c4baf86a46bdc48400e30/roles/a1dd99d822514511a82daa669061e683 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:06.658646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dd2aa-a7fa-4ea0-b9b5-09993e9808f6 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:06.659025 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dd2aa-a7fa-4ea0-b9b5-09993e9808f6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:06.659243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002dd2aa-a7fa-4ea0-b9b5-09993e9808f6 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:06.661153 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 201/413] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:06.667030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05bd1d-c761-406d-89bf-d1c1abed0a1c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:06.667319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05bd1d-c761-406d-89bf-d1c1abed0a1c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:06.667592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d05bd1d-c761-406d-89bf-d1c1abed0a1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:06.689239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7d05bd1d-c761-406d-89bf-d1c1abed0a1c None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:06.690514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7d05bd1d-c761-406d-89bf-d1c1abed0a1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:06.694789 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd7e1c7-ed40-4318-8534-f31fc6008268 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:06.730664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:06.745418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f9aed-d5a3-425a-adde-0b3a260f05c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:06.746828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f9aed-d5a3-425a-adde-0b3a260f05c2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:06.747539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f9aed-d5a3-425a-adde-0b3a260f05c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:06.748086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3f9aed-d5a3-425a-adde-0b3a260f05c2 None admin] PATH_INFO: `/v3/groups/c5cc1a5bd4474a1f8f27d6dedf7f7704` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:06.749636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f9aed-d5a3-425a-adde-0b3a260f05c2 None admin] RBAC: Authorizing `identity:get_group(group_id=c5cc1a5bd4474a1f8f27d6dedf7f7704)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:06.752293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3f9aed-d5a3-425a-adde-0b3a260f05c2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:06.754366 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 213/414] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Jul 15 19:16:06 2022] GET /identity/v3/groups/c5cc1a5bd4474a1f8f27d6dedf7f7704 => generated 229 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:06.760721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f9aed-d5a3-425a-adde-0b3a260f05c2 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:06.797010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 202/415] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:06.827231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05bd1d-c761-406d-89bf-d1c1abed0a1c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:06.904284 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:06.917240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3f9aed-d5a3-425a-adde-0b3a260f05c2 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:06.966960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fa145-0d53-4efa-a055-e60354bce100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:06.967833 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fa145-0d53-4efa-a055-e60354bce100 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:06.968112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fa145-0d53-4efa-a055-e60354bce100 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:06.968382 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325fa145-0d53-4efa-a055-e60354bce100 None admin] PATH_INFO: `/v3/projects/236a9e48f4d940ef9a994f185adc8b9d` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:06.971147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325fa145-0d53-4efa-a055-e60354bce100 None admin] RBAC: Authorizing `identity:get_project(project_id=236a9e48f4d940ef9a994f185adc8b9d)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:06.972594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325fa145-0d53-4efa-a055-e60354bce100 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:06.978385 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d05bd1d-c761-406d-89bf-d1c1abed0a1c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:06.980366 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 214/416] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:06 2022] GET /identity/v3/projects/236a9e48f4d940ef9a994f185adc8b9d => generated 344 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:06.981212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fa145-0d53-4efa-a055-e60354bce100 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:07.050970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b670116-cf84-42a0-9d39-3578c14a0fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:07.051687 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b670116-cf84-42a0-9d39-3578c14a0fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:07.051962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b670116-cf84-42a0-9d39-3578c14a0fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:07.052236 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b670116-cf84-42a0-9d39-3578c14a0fb3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:07.075778 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b670116-cf84-42a0-9d39-3578c14a0fb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:07.091586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-7b670116-cf84-42a0-9d39-3578c14a0fb3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:07.091586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:07.091586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:07.091586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:07.091586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:07.091586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:07.091586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:07.091586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:07.091586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:07.091586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:07.091586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:07.091586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:07.091586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:07.091586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:07.091586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:07.091586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:07.092558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:07.092558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:07.092558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:07.092558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:07.092558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:07.092558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:07.092558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:07.092558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:07.092558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:07.092558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:07.092558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:07.092558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:07.092558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:07.092558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:07.092558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:07.092558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:07.093380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:07.093380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:07.093380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:07.093380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:07.093380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:07.093380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:07.093380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:07.093380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:07.093380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:07.093380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:07.093380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:07.093380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:07.099423 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 203/417] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:16:07.100700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b670116-cf84-42a0-9d39-3578c14a0fb3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:07.151172 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:07.164357 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325fa145-0d53-4efa-a055-e60354bce100 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:07.201272 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b802a66-7588-4d81-9355-995d7396c362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:07.202159 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b802a66-7588-4d81-9355-995d7396c362 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:07.202437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b802a66-7588-4d81-9355-995d7396c362 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:07.202711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b802a66-7588-4d81-9355-995d7396c362 None admin] PATH_INFO: `/v3/projects/236a9e48f4d940ef9a994f185adc8b9d/groups/c5cc1a5bd4474a1f8f27d6dedf7f7704/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:07.205283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b802a66-7588-4d81-9355-995d7396c362 None admin] RBAC: Authorizing `identity:create_grant(project_id=236a9e48f4d940ef9a994f185adc8b9d, group_id=c5cc1a5bd4474a1f8f27d6dedf7f7704, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:07.206734 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b802a66-7588-4d81-9355-995d7396c362 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:07.237959 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b670116-cf84-42a0-9d39-3578c14a0fb3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:07.279893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 215/418] 10.222.0.40 () {58 vars in 1442 bytes} [Fri Jul 15 19:16:06 2022] PUT /identity/v3/projects/236a9e48f4d940ef9a994f185adc8b9d/groups/c5cc1a5bd4474a1f8f27d6dedf7f7704/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:07.280395 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7228d-989a-45d5-89ff-598a86a70def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:07.281256 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77172c3e-1ef5-48c4-a55d-7323ad85fa18 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:07.281568 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77172c3e-1ef5-48c4-a55d-7323ad85fa18 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:07.281937 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77172c3e-1ef5-48c4-a55d-7323ad85fa18 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:07.282303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7228d-989a-45d5-89ff-598a86a70def None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:07.282800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7228d-989a-45d5-89ff-598a86a70def None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:07.283316 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7228d-989a-45d5-89ff-598a86a70def None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:07.284295 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7228d-989a-45d5-89ff-598a86a70def None admin] RBAC: Adding query filter params (name=member) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:07.284884 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7228d-989a-45d5-89ff-598a86a70def None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:07.286533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac7228d-989a-45d5-89ff-598a86a70def None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:07.287056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 216/419] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:07.290566 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dc010-75f9-48e0-ba2f-93039d7c6991 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:07.290898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dc010-75f9-48e0-ba2f-93039d7c6991 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:07.291146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2dc010-75f9-48e0-ba2f-93039d7c6991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:07.304690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 204/420] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:16:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:07.306705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7228d-989a-45d5-89ff-598a86a70def None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:07.313403 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-ae2dc010-75f9-48e0-ba2f-93039d7c6991 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:07.314744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ae2dc010-75f9-48e0-ba2f-93039d7c6991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:07.333669 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:07.433492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 217/421] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:07.440708 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:07.465014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac7228d-989a-45d5-89ff-598a86a70def None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:07.483849 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dc010-75f9-48e0-ba2f-93039d7c6991 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:07.539513 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed4127-7e96-42b5-8a10-e617380f54be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:07.540932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed4127-7e96-42b5-8a10-e617380f54be None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:07.541416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed4127-7e96-42b5-8a10-e617380f54be None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:07.541887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ed4127-7e96-42b5-8a10-e617380f54be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:07.632028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2dc010-75f9-48e0-ba2f-93039d7c6991 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:07.639939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed4127-7e96-42b5-8a10-e617380f54be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:07.643439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ed4127-7e96-42b5-8a10-e617380f54be None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:07.681720 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd04c6d-05c9-45d5-b740-76f36fdb6ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:07.683245 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd04c6d-05c9-45d5-b740-76f36fdb6ccd None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:07.683974 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd04c6d-05c9-45d5-b740-76f36fdb6ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:07.684850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd04c6d-05c9-45d5-b740-76f36fdb6ccd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:07.699457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd04c6d-05c9-45d5-b740-76f36fdb6ccd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:07.711927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-bbd04c6d-05c9-45d5-b740-76f36fdb6ccd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:07.711927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:07.711927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:07.711927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:07.711927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:07.711927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:07.711927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:07.711927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:07.711927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:07.711927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:07.711927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:07.711927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:07.711927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:07.711927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:07.711927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:07.711927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:07.713316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:07.713316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:07.713316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:07.713316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:07.713316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:07.713316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:07.713316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:07.713316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:07.713316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:07.713316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:07.713316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:07.713316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:07.713316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:07.713316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:07.713316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:07.713316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:07.714123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:07.714123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:07.714123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:07.714123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:07.714123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:07.714123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:07.714123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:07.714123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:07.714123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:07.714123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:07.714123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:07.714123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:07.714123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 218/422] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:16:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:16:07.721055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd04c6d-05c9-45d5-b740-76f36fdb6ccd None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:07.733296 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:07.815557 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:07.836820 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd04c6d-05c9-45d5-b740-76f36fdb6ccd None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:07.875843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94ca27-456c-410f-96be-af26e3566549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:07.876514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94ca27-456c-410f-96be-af26e3566549 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:07.876796 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94ca27-456c-410f-96be-af26e3566549 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:07.877070 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f94ca27-456c-410f-96be-af26e3566549 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:07.877833 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94ca27-456c-410f-96be-af26e3566549 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:07.878142 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94ca27-456c-410f-96be-af26e3566549 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:07.879644 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f94ca27-456c-410f-96be-af26e3566549 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:07.881626 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 205/423] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 19:16:07.895576 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed4127-7e96-42b5-8a10-e617380f54be None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:07.897717 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 219/424] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:07.900399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94ca27-456c-410f-96be-af26e3566549 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:07.984858 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:08.026050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f94ca27-456c-410f-96be-af26e3566549 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:08.071770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd56e1-231b-413f-a725-47b2b1bcc49a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:08.072455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd56e1-231b-413f-a725-47b2b1bcc49a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:08.072740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd56e1-231b-413f-a725-47b2b1bcc49a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:08.073019 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfd56e1-231b-413f-a725-47b2b1bcc49a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:08.156873 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd56e1-231b-413f-a725-47b2b1bcc49a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:08.158565 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfd56e1-231b-413f-a725-47b2b1bcc49a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:08.161077 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ed4127-7e96-42b5-8a10-e617380f54be None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:08.234462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb295ef-5509-4604-bc70-d38e4a1b136d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:08.235639 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb295ef-5509-4604-bc70-d38e4a1b136d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:08.235927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb295ef-5509-4604-bc70-d38e4a1b136d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:08.236205 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb295ef-5509-4604-bc70-d38e4a1b136d None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:08.237430 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb295ef-5509-4604-bc70-d38e4a1b136d None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:08.238347 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:08.240049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb295ef-5509-4604-bc70-d38e4a1b136d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:08.242102 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 206/425] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:07 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:08.258570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb295ef-5509-4604-bc70-d38e4a1b136d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:08.283889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 220/426] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:08.286618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd56e1-231b-413f-a725-47b2b1bcc49a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:08.395255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:08.403608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfd56e1-231b-413f-a725-47b2b1bcc49a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:08.444353 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a34072-73a4-4a54-bd42-cba23fe60342 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:08.445145 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a34072-73a4-4a54-bd42-cba23fe60342 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:08.445487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a34072-73a4-4a54-bd42-cba23fe60342 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:08.445773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a34072-73a4-4a54-bd42-cba23fe60342 None admin] PATH_INFO: `/v3/projects/3c0917f4477b4c16bde98021e0a84078` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:08.447158 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a34072-73a4-4a54-bd42-cba23fe60342 None admin] RBAC: Authorizing `identity:get_project(project_id=3c0917f4477b4c16bde98021e0a84078)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:08.448611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a34072-73a4-4a54-bd42-cba23fe60342 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:08.454275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 221/427] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:08 2022] GET /identity/v3/projects/3c0917f4477b4c16bde98021e0a84078 => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:08.456927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a34072-73a4-4a54-bd42-cba23fe60342 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:08.515120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:08.573573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a34072-73a4-4a54-bd42-cba23fe60342 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:08.581223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb295ef-5509-4604-bc70-d38e4a1b136d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:08.646604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dced34-fa5c-4179-ab1a-5e5d82b8f655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:08.647490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dced34-fa5c-4179-ab1a-5e5d82b8f655 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:08.647773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dced34-fa5c-4179-ab1a-5e5d82b8f655 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:08.648049 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3dced34-fa5c-4179-ab1a-5e5d82b8f655 None admin] PATH_INFO: `/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:08.649513 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dced34-fa5c-4179-ab1a-5e5d82b8f655 None admin] RBAC: Authorizing `identity:get_group(group_id=f1d6bb2ceb0c4baf86a46bdc48400e30)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:08.650993 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3dced34-fa5c-4179-ab1a-5e5d82b8f655 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:08.652629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 222/428] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Jul 15 19:16:08 2022] GET /identity/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30 => generated 226 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:08.659452 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dced34-fa5c-4179-ab1a-5e5d82b8f655 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:08.659626 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff60e4-f8d2-426e-9a4e-c513b17009a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:08.660352 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff60e4-f8d2-426e-9a4e-c513b17009a6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:08.660643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff60e4-f8d2-426e-9a4e-c513b17009a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:08.660925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ff60e4-f8d2-426e-9a4e-c513b17009a6 None admin] PATH_INFO: `/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:08.667506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff60e4-f8d2-426e-9a4e-c513b17009a6 None admin] RBAC: Authorizing `identity:get_group(group_id=f1d6bb2ceb0c4baf86a46bdc48400e30)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:08.668967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ff60e4-f8d2-426e-9a4e-c513b17009a6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:08.670954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 207/429] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Jul 15 19:16:08 2022] GET /identity/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30 => generated 226 bytes in 413 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:08.676727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff60e4-f8d2-426e-9a4e-c513b17009a6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:08.767276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3dced34-fa5c-4179-ab1a-5e5d82b8f655 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:08.779125 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:08.807788 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaab5eba-f9e6-4e35-add0-fa70795daa4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:08.808509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab5eba-f9e6-4e35-add0-fa70795daa4b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:08.808796 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab5eba-f9e6-4e35-add0-fa70795daa4b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:08.809175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaab5eba-f9e6-4e35-add0-fa70795daa4b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:08.810185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab5eba-f9e6-4e35-add0-fa70795daa4b None admin] RBAC: Adding query filter params (group.id=f1d6bb2ceb0c4baf86a46bdc48400e30, role.id=a1dd99d822514511a82daa669061e683, scope.project.id=3c0917f4477b4c16bde98021e0a84078) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:08.810503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab5eba-f9e6-4e35-add0-fa70795daa4b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:08.812036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaab5eba-f9e6-4e35-add0-fa70795daa4b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:08.824112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 223/430] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Jul 15 19:16:08 2022] GET /identity/v3/role_assignments?group.id=f1d6bb2ceb0c4baf86a46bdc48400e30&scope.project.id=3c0917f4477b4c16bde98021e0a84078&role.id=a1dd99d822514511a82daa669061e683 => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:08.876926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ff60e4-f8d2-426e-9a4e-c513b17009a6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:08.887275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f6c00-fd42-4069-8839-b20fc818e283 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:08.887666 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f6c00-fd42-4069-8839-b20fc818e283 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:08.887954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3f6c00-fd42-4069-8839-b20fc818e283 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:08.889612 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 224/431] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:16:08.895933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268af509-0092-49b9-b488-1e781d690036 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:08.896213 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268af509-0092-49b9-b488-1e781d690036 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:08.896601 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-268af509-0092-49b9-b488-1e781d690036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:08.899793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:08.925697 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-268af509-0092-49b9-b488-1e781d690036 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:08.927773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-268af509-0092-49b9-b488-1e781d690036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:08.930819 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225821a6-da83-4dd2-9645-b807fc307986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:08.932074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225821a6-da83-4dd2-9645-b807fc307986 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:08.932637 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225821a6-da83-4dd2-9645-b807fc307986 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:08.934285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225821a6-da83-4dd2-9645-b807fc307986 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:08.934285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225821a6-da83-4dd2-9645-b807fc307986 None admin] RBAC: Adding query filter params (group.id=f1d6bb2ceb0c4baf86a46bdc48400e30, role.id=5d20b549441d429db11d5e91f3825e86, scope.project.id=3c0917f4477b4c16bde98021e0a84078) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:08.934643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225821a6-da83-4dd2-9645-b807fc307986 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:08.936135 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225821a6-da83-4dd2-9645-b807fc307986 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:08.951860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 208/432] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Jul 15 19:16:08 2022] GET /identity/v3/role_assignments?group.id=f1d6bb2ceb0c4baf86a46bdc48400e30&scope.project.id=3c0917f4477b4c16bde98021e0a84078&role.id=5d20b549441d429db11d5e91f3825e86 => generated 611 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:09.012204 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 225/433] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:16:09.046844 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225821a6-da83-4dd2-9645-b807fc307986 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:09.186601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225821a6-da83-4dd2-9645-b807fc307986 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:09.229538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b0c445-49af-48d3-bced-f3b476e6b010 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:09.229980 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0c445-49af-48d3-bced-f3b476e6b010 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:09.230267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0c445-49af-48d3-bced-f3b476e6b010 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:09.230545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b0c445-49af-48d3-bced-f3b476e6b010 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:09.245157 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b0c445-49af-48d3-bced-f3b476e6b010 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:09.253817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-99b0c445-49af-48d3-bced-f3b476e6b010 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:09.253817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:09.253817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:09.253817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:09.253817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:09.253817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:09.253817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:09.253817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:09.253817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:09.253817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:09.253817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:09.253817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:09.253817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:09.253817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:09.253817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:09.253817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:09.254732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:09.254732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:09.254732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:09.254732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:09.254732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:09.254732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:09.254732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:09.254732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:09.254732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:09.254732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:09.254732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:09.254732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:09.254732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:09.254732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:09.254732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:09.254732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:09.255593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:09.255593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:09.255593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:09.255593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:09.255593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:09.255593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:09.255593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:09.255593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:09.255593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:09.255593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:09.255593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 15 19:16:09.255593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:09.255593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 209/434] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:16:09.262529 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268af509-0092-49b9-b488-1e781d690036 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:09.340725 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c8115-4bb7-41a5-8279-c88efd3ed6b5 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:09.341620 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c8115-4bb7-41a5-8279-c88efd3ed6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:09.341911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42c8115-4bb7-41a5-8279-c88efd3ed6b5 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:09.343683 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 210/435] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:16:09.349654 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29901574-f0f0-43cf-b9ac-f5eab1888779 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:09.349925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29901574-f0f0-43cf-b9ac-f5eab1888779 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:09.350201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29901574-f0f0-43cf-b9ac-f5eab1888779 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:09.371079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-29901574-f0f0-43cf-b9ac-f5eab1888779 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:09.372295 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-29901574-f0f0-43cf-b9ac-f5eab1888779 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:09.380250 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:09.384801 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-268af509-0092-49b9-b488-1e781d690036 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:09.425567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:09.430115 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78131e-ab9d-45f6-8e46-0dd89af2569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:09.432734 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78131e-ab9d-45f6-8e46-0dd89af2569c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:09.432734 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78131e-ab9d-45f6-8e46-0dd89af2569c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:09.432734 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af78131e-ab9d-45f6-8e46-0dd89af2569c None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:09.432734 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78131e-ab9d-45f6-8e46-0dd89af2569c None admin] RBAC: Adding query filter params (name=member) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:09.432734 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78131e-ab9d-45f6-8e46-0dd89af2569c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:09.434656 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af78131e-ab9d-45f6-8e46-0dd89af2569c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:09.445847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 226/436] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:16:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:09.452272 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78131e-ab9d-45f6-8e46-0dd89af2569c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:09.472648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 211/437] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:16:09.497376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29901574-f0f0-43cf-b9ac-f5eab1888779 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:09.612577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af78131e-ab9d-45f6-8e46-0dd89af2569c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:09.634226 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29901574-f0f0-43cf-b9ac-f5eab1888779 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:09.666425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57146718-1eb5-47a4-a65c-57fec3ed6949 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:09.666425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57146718-1eb5-47a4-a65c-57fec3ed6949 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:09.666718 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57146718-1eb5-47a4-a65c-57fec3ed6949 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:09.667012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57146718-1eb5-47a4-a65c-57fec3ed6949 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:09.683241 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a48d9d-a00c-419d-8921-b5d8e3831394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:09.684067 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a48d9d-a00c-419d-8921-b5d8e3831394 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:09.684337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a48d9d-a00c-419d-8921-b5d8e3831394 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:09.684881 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a48d9d-a00c-419d-8921-b5d8e3831394 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:09.697052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a48d9d-a00c-419d-8921-b5d8e3831394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:09.705118 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:09.706551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-c4a48d9d-a00c-419d-8921-b5d8e3831394 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:09.706551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:09.706551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:09.706551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:09.706551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:09.706551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:09.706551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:09.706551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:09.706551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:09.706551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:09.706551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:09.706551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:09.706551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:09.706551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:09.706551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:09.706551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:09.707502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:09.707502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:09.707502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:09.707502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:09.707502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:09.707502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:09.707502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:09.707502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:09.707502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:09.707502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:09.707502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:09.707502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:09.707502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:09.707502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:09.707502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:09.707502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:09.708313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:09.708313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:09.708313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:09.708313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:09.708313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:09.708313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:09.708313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:09.708313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:09.708313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:09.708313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:09.708313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:09.708313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:09.708313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 212/438] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:16:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:16:09.710104 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ce80f-ceca-4f37-929c-febeb19d393d None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:09.710104 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ce80f-ceca-4f37-929c-febeb19d393d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:09.710104 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5ce80f-ceca-4f37-929c-febeb19d393d None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:09.711221 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 213/439] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:09.716874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ce80f-ceca-4f37-929c-febeb19d393d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:09.754481 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57146718-1eb5-47a4-a65c-57fec3ed6949 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:09.755981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57146718-1eb5-47a4-a65c-57fec3ed6949 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:09.757876 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:09.830931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5ce80f-ceca-4f37-929c-febeb19d393d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:09.860663 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 227/440] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 15 19:16:09.861851 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b2a6a-e401-434b-8db9-8e8307c065b2 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:09.862140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b2a6a-e401-434b-8db9-8e8307c065b2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:09.862424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39b2a6a-e401-434b-8db9-8e8307c065b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:09.870914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b6924-eeca-4853-ad0d-d3ed56633435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:09.871509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b6924-eeca-4853-ad0d-d3ed56633435 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:09.871791 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b6924-eeca-4853-ad0d-d3ed56633435 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:09.872067 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80b6924-eeca-4853-ad0d-d3ed56633435 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:09.872816 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b6924-eeca-4853-ad0d-d3ed56633435 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:09.873124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b6924-eeca-4853-ad0d-d3ed56633435 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:09.874495 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80b6924-eeca-4853-ad0d-d3ed56633435 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:09.880092 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f39b2a6a-e401-434b-8db9-8e8307c065b2 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:09.881293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f39b2a6a-e401-434b-8db9-8e8307c065b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:09.883514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 214/441] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:09.884314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b6924-eeca-4853-ad0d-d3ed56633435 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:09.941101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:09.951406 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 228/442] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:09.952223 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b2a6a-e401-434b-8db9-8e8307c065b2 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:09.987542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:09.993485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80b6924-eeca-4853-ad0d-d3ed56633435 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:10.028351 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46186639-585f-45dc-be8e-67872e785f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:10.029216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186639-585f-45dc-be8e-67872e785f51 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:10.029496 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186639-585f-45dc-be8e-67872e785f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:10.029767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46186639-585f-45dc-be8e-67872e785f51 None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:10.030979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46186639-585f-45dc-be8e-67872e785f51 None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:10.033252 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46186639-585f-45dc-be8e-67872e785f51 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:10.034982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 215/443] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:09 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:10.035741 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46186639-585f-45dc-be8e-67872e785f51 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:10.055690 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39b2a6a-e401-434b-8db9-8e8307c065b2 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:10.091876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62deae-bb2b-4ba1-b315-9a974981f5a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:10.092590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62deae-bb2b-4ba1-b315-9a974981f5a8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:10.092871 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62deae-bb2b-4ba1-b315-9a974981f5a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:10.093139 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec62deae-bb2b-4ba1-b315-9a974981f5a8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:10.145598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46186639-585f-45dc-be8e-67872e785f51 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:10.155506 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:10.165342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62deae-bb2b-4ba1-b315-9a974981f5a8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:10.166859 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec62deae-bb2b-4ba1-b315-9a974981f5a8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:10.179932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2104db-5b92-4edc-a061-598a9219ad48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:10.180717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2104db-5b92-4edc-a061-598a9219ad48 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:10.181000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2104db-5b92-4edc-a061-598a9219ad48 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:10.181276 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2104db-5b92-4edc-a061-598a9219ad48 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:10.191847 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2104db-5b92-4edc-a061-598a9219ad48 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:10.199635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-9d2104db-5b92-4edc-a061-598a9219ad48 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:10.199635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:10.199635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:10.199635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:10.199635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:10.199635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:10.199635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:10.199635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:10.199635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:10.199635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:10.199635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:10.199635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:10.199635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:10.199635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:10.199635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:10.199635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:10.200745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:10.200745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:10.200745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:10.200745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:10.200745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:10.200745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:10.200745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:10.200745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:10.200745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:10.200745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:10.200745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:10.200745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:10.200745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:10.200745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:10.200745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:10.200745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:10.207148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:10.207148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:10.207148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:10.207148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:10.207148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:10.207148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:10.207148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:10.207148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:10.207148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:10.207148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:10.207148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:10.207148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:10.207148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 216/444] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:10.207148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2104db-5b92-4edc-a061-598a9219ad48 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:10.227700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:10.269068 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 229/445] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:10.269918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62deae-bb2b-4ba1-b315-9a974981f5a8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:10.305975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2104db-5b92-4edc-a061-598a9219ad48 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:10.342093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f93ccd-d54d-47a8-bfee-adeb6b4e528e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:10.342963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f93ccd-d54d-47a8-bfee-adeb6b4e528e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:10.343248 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f93ccd-d54d-47a8-bfee-adeb6b4e528e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:10.344055 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f93ccd-d54d-47a8-bfee-adeb6b4e528e None admin] PATH_INFO: `/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:10.345530 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f93ccd-d54d-47a8-bfee-adeb6b4e528e None admin] RBAC: Authorizing `identity:get_group(group_id=f1d6bb2ceb0c4baf86a46bdc48400e30)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:10.347012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f93ccd-d54d-47a8-bfee-adeb6b4e528e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:10.348638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 217/446] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Jul 15 19:16:10 2022] GET /identity/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30 => generated 226 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:10.349403 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f93ccd-d54d-47a8-bfee-adeb6b4e528e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:10.363471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:10.371981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec62deae-bb2b-4ba1-b315-9a974981f5a8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:10.409224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbfcad-d187-45c3-a988-738201cfa849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:10.410383 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbfcad-d187-45c3-a988-738201cfa849 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:10.410945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbfcad-d187-45c3-a988-738201cfa849 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:10.411443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0edbfcad-d187-45c3-a988-738201cfa849 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:10.412901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbfcad-d187-45c3-a988-738201cfa849 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:10.413462 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbfcad-d187-45c3-a988-738201cfa849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:10.416112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0edbfcad-d187-45c3-a988-738201cfa849 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:10.429985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 230/447] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:10.431452 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbfcad-d187-45c3-a988-738201cfa849 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:10.461606 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:10.471283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f93ccd-d54d-47a8-bfee-adeb6b4e528e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:10.508783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54237f3-bc12-4f21-8cd7-474ef5bce3e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:10.509734 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54237f3-bc12-4f21-8cd7-474ef5bce3e6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:10.509927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54237f3-bc12-4f21-8cd7-474ef5bce3e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:10.510204 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54237f3-bc12-4f21-8cd7-474ef5bce3e6 None admin] PATH_INFO: `/v3/projects/7543fca6f3a747199a7adba87590509d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:10.511859 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54237f3-bc12-4f21-8cd7-474ef5bce3e6 None admin] RBAC: Authorizing `identity:get_project(project_id=7543fca6f3a747199a7adba87590509d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:10.513322 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54237f3-bc12-4f21-8cd7-474ef5bce3e6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:10.515085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 218/448] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:10 2022] GET /identity/v3/projects/7543fca6f3a747199a7adba87590509d => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:10.515874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54237f3-bc12-4f21-8cd7-474ef5bce3e6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:10.549094 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0edbfcad-d187-45c3-a988-738201cfa849 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:10.584567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4d2ca-9630-4bab-bfc6-695fd7ab84b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:10.585261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4d2ca-9630-4bab-bfc6-695fd7ab84b2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:10.585543 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4d2ca-9630-4bab-bfc6-695fd7ab84b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:10.585820 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba4d2ca-9630-4bab-bfc6-695fd7ab84b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:10.586669 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4d2ca-9630-4bab-bfc6-695fd7ab84b2 None admin] RBAC: Adding query filter params (group.id=f1d6bb2ceb0c4baf86a46bdc48400e30, role.id=5d20b549441d429db11d5e91f3825e86, scope.project.id=7543fca6f3a747199a7adba87590509d) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:10.587013 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4d2ca-9630-4bab-bfc6-695fd7ab84b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:10.588474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ba4d2ca-9630-4bab-bfc6-695fd7ab84b2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:10.595860 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 231/449] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Jul 15 19:16:10 2022] GET /identity/v3/role_assignments?group.id=f1d6bb2ceb0c4baf86a46bdc48400e30&scope.project.id=7543fca6f3a747199a7adba87590509d&role.id=5d20b549441d429db11d5e91f3825e86 => generated 611 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:10.596717 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4d2ca-9630-4bab-bfc6-695fd7ab84b2 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:10.621290 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:10.626068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54237f3-bc12-4f21-8cd7-474ef5bce3e6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:10.668940 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a0928-69df-4de2-90eb-3a0362c64bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:10.669612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a0928-69df-4de2-90eb-3a0362c64bac None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:10.669803 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a0928-69df-4de2-90eb-3a0362c64bac None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:10.670058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90a0928-69df-4de2-90eb-3a0362c64bac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:10.701866 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:10.736714 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ba4d2ca-9630-4bab-bfc6-695fd7ab84b2 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:10.749994 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a0928-69df-4de2-90eb-3a0362c64bac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:10.760043 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90a0928-69df-4de2-90eb-3a0362c64bac None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:10.780943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2a608-4602-4182-ba98-804eea3f5648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:10.781910 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2a608-4602-4182-ba98-804eea3f5648 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:10.782194 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2a608-4602-4182-ba98-804eea3f5648 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:10.782467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b2a608-4602-4182-ba98-804eea3f5648 None admin] PATH_INFO: `/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:10.783833 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2a608-4602-4182-ba98-804eea3f5648 None admin] RBAC: Authorizing `identity:get_group(group_id=f1d6bb2ceb0c4baf86a46bdc48400e30)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:10.785186 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b2a608-4602-4182-ba98-804eea3f5648 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:10.786872 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 232/450] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Jul 15 19:16:10 2022] GET /identity/v3/groups/f1d6bb2ceb0c4baf86a46bdc48400e30 => generated 226 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:10.793442 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2a608-4602-4182-ba98-804eea3f5648 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:10.880345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 219/451] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:10.885964 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a0928-69df-4de2-90eb-3a0362c64bac None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:10.899787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:10.916958 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b2a608-4602-4182-ba98-804eea3f5648 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:10.960102 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:10.961376 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8125fd1-280f-497c-9f44-c262736119a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:10.961376 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8125fd1-280f-497c-9f44-c262736119a5 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:10.961376 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8125fd1-280f-497c-9f44-c262736119a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:10.961634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8125fd1-280f-497c-9f44-c262736119a5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:10.962388 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8125fd1-280f-497c-9f44-c262736119a5 None admin] RBAC: Adding query filter params (group.id=f1d6bb2ceb0c4baf86a46bdc48400e30, role.id=a1dd99d822514511a82daa669061e683, scope.project.id=7543fca6f3a747199a7adba87590509d) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:10.962695 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8125fd1-280f-497c-9f44-c262736119a5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:10.964847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8125fd1-280f-497c-9f44-c262736119a5 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:10.972042 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 233/452] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Jul 15 19:16:10 2022] GET /identity/v3/role_assignments?group.id=f1d6bb2ceb0c4baf86a46bdc48400e30&scope.project.id=7543fca6f3a747199a7adba87590509d&role.id=a1dd99d822514511a82daa669061e683 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:11.011749 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90a0928-69df-4de2-90eb-3a0362c64bac None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:11.050040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7930197-5bd3-4477-bfdc-e79785ff438c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:11.050944 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7930197-5bd3-4477-bfdc-e79785ff438c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:11.051230 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7930197-5bd3-4477-bfdc-e79785ff438c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:11.051503 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7930197-5bd3-4477-bfdc-e79785ff438c None admin] PATH_INFO: `/v3/projects/236a9e48f4d940ef9a994f185adc8b9d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:11.052736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7930197-5bd3-4477-bfdc-e79785ff438c None admin] RBAC: Authorizing `identity:get_project(project_id=236a9e48f4d940ef9a994f185adc8b9d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:11.054199 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7930197-5bd3-4477-bfdc-e79785ff438c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:11.056022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 220/453] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:16:10 2022] GET /identity/v3/projects/236a9e48f4d940ef9a994f185adc8b9d => generated 344 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:11.061663 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8125fd1-280f-497c-9f44-c262736119a5 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:11.165452 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8125fd1-280f-497c-9f44-c262736119a5 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:11.199853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f705cfca-a75f-45e7-a1c6-c3a8ab385a56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:11.200710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705cfca-a75f-45e7-a1c6-c3a8ab385a56 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:11.200981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705cfca-a75f-45e7-a1c6-c3a8ab385a56 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:11.201247 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f705cfca-a75f-45e7-a1c6-c3a8ab385a56 None admin] PATH_INFO: `/v3/groups/c5cc1a5bd4474a1f8f27d6dedf7f7704` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:11.202407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705cfca-a75f-45e7-a1c6-c3a8ab385a56 None admin] RBAC: Authorizing `identity:get_group(group_id=c5cc1a5bd4474a1f8f27d6dedf7f7704)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:11.204071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f705cfca-a75f-45e7-a1c6-c3a8ab385a56 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:11.206010 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 234/454] 10.222.0.40 () {56 vars in 1180 bytes} [Fri Jul 15 19:16:11 2022] GET /identity/v3/groups/c5cc1a5bd4474a1f8f27d6dedf7f7704 => generated 229 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:11.211534 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7930197-5bd3-4477-bfdc-e79785ff438c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:11.318872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7930197-5bd3-4477-bfdc-e79785ff438c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:11.345680 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:11.353089 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd74b615-14a3-47d1-ab64-e0fec9406068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:11.353739 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b615-14a3-47d1-ab64-e0fec9406068 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:11.360807 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b615-14a3-47d1-ab64-e0fec9406068 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:11.360807 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd74b615-14a3-47d1-ab64-e0fec9406068 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:11.360807 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74b615-14a3-47d1-ab64-e0fec9406068 None admin] RBAC: Adding query filter params (group.id=c5cc1a5bd4474a1f8f27d6dedf7f7704, role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=236a9e48f4d940ef9a994f185adc8b9d) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:11.360807 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74b615-14a3-47d1-ab64-e0fec9406068 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:11.360807 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd74b615-14a3-47d1-ab64-e0fec9406068 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:11.363525 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 221/455] 10.222.0.40 () {56 vars in 1376 bytes} [Fri Jul 15 19:16:11 2022] GET /identity/v3/role_assignments?group.id=c5cc1a5bd4474a1f8f27d6dedf7f7704&scope.project.id=236a9e48f4d940ef9a994f185adc8b9d&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 611 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:13.798777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d49f51-c64d-45cc-80c3-ca67af84f5dd None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:13.799323 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d49f51-c64d-45cc-80c3-ca67af84f5dd None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:13.799323 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d49f51-c64d-45cc-80c3-ca67af84f5dd None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:13.801077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 235/456] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:13.806444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa11d3-2cc6-4922-b883-6e5d768d23c8 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:13.806882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa11d3-2cc6-4922-b883-6e5d768d23c8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:13.807055 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fa11d3-2cc6-4922-b883-6e5d768d23c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:13.832045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-53fa11d3-2cc6-4922-b883-6e5d768d23c8 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:13.833282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-53fa11d3-2cc6-4922-b883-6e5d768d23c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:13.929512 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 222/457] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:13.964812 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d49f51-c64d-45cc-80c3-ca67af84f5dd None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:13.981038 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1efe1a-9119-4e0b-bdc1-e6c3f08a390a None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:13.981346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1efe1a-9119-4e0b-bdc1-e6c3f08a390a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:13.981590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb1efe1a-9119-4e0b-bdc1-e6c3f08a390a None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:13.983403 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 223/458] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:16:13.989622 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d1d9b-939b-4ff4-8a0a-8edccdfeda76 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:13.989907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d1d9b-939b-4ff4-8a0a-8edccdfeda76 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:13.990184 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73d1d9b-939b-4ff4-8a0a-8edccdfeda76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:14.000301 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:14.018624 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d73d1d9b-939b-4ff4-8a0a-8edccdfeda76 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:14.019859 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d73d1d9b-939b-4ff4-8a0a-8edccdfeda76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:14.170095 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 224/459] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:16:14.180036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d49f51-c64d-45cc-80c3-ca67af84f5dd None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:14.192698 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d1d9b-939b-4ff4-8a0a-8edccdfeda76 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:14.252586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166dbee-dba8-4930-a344-af03b1a24821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:14.253757 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166dbee-dba8-4930-a344-af03b1a24821 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:14.254245 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166dbee-dba8-4930-a344-af03b1a24821 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:14.254778 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0166dbee-dba8-4930-a344-af03b1a24821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:14.268140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166dbee-dba8-4930-a344-af03b1a24821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:14.269930 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0166dbee-dba8-4930-a344-af03b1a24821 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:14.293277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-0166dbee-dba8-4930-a344-af03b1a24821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:14.293277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:14.293277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:14.293277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:14.293277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:14.293277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:14.293277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:14.293277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:14.293277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:14.293277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:14.293277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:14.293277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:14.293277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:14.293277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:14.293277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:14.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:14.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:14.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:14.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:14.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:14.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:14.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:14.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:14.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:14.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:14.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:14.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:14.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:14.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:14.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:14.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:14.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:14.295084 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:14.295084 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:14.295084 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:14.295084 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:14.297689 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 236/460] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:14.303721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166dbee-dba8-4930-a344-af03b1a24821 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:14.335200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:14.404675 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:14.405335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d73d1d9b-939b-4ff4-8a0a-8edccdfeda76 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:14.439228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0166dbee-dba8-4930-a344-af03b1a24821 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:14.443153 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e754b603-ec98-441d-a5c0-83fed4648eaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:14.444193 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754b603-ec98-441d-a5c0-83fed4648eaf None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:14.444679 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754b603-ec98-441d-a5c0-83fed4648eaf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:14.445150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e754b603-ec98-441d-a5c0-83fed4648eaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:14.456981 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754b603-ec98-441d-a5c0-83fed4648eaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:14.458764 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e754b603-ec98-441d-a5c0-83fed4648eaf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:14.476950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2faef99-adfd-4b6a-b4ea-f517533bf754 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:14.477572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2faef99-adfd-4b6a-b4ea-f517533bf754 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:14.477859 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2faef99-adfd-4b6a-b4ea-f517533bf754 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:14.478138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2faef99-adfd-4b6a-b4ea-f517533bf754 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:14.478904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2faef99-adfd-4b6a-b4ea-f517533bf754 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:14.479217 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2faef99-adfd-4b6a-b4ea-f517533bf754 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:14.480620 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2faef99-adfd-4b6a-b4ea-f517533bf754 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:14.481170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-e754b603-ec98-441d-a5c0-83fed4648eaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:14.481170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:14.481170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:14.481170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:14.481170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:14.481170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:14.481170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:14.481170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:14.481170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:14.481170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:14.481170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:14.481170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:14.481170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:14.481170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:14.481170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:14.482003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:14.482003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:14.482003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:14.482003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:14.482003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:14.482003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:14.482003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:14.482003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:14.482003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:14.482003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:14.482003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:14.482003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:14.482003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:14.482003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:14.482003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:14.482003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:14.482003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:14.482913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:14.482913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:14.482913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:14.482913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:14.485842 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 225/461] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:16:14.487483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a476c-1c7d-470f-84f6-976d440eb66e None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:14.487977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a476c-1c7d-470f-84f6-976d440eb66e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:14.488454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9a476c-1c7d-470f-84f6-976d440eb66e None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:14.490028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 226/462] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:14.491695 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a476c-1c7d-470f-84f6-976d440eb66e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:14.498542 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 237/463] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:14.502879 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdaf37-023e-4b6d-968b-bc3b4ee9c4b0 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:14.502879 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdaf37-023e-4b6d-968b-bc3b4ee9c4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:14.502879 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63cdaf37-023e-4b6d-968b-bc3b4ee9c4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:14.522662 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-63cdaf37-023e-4b6d-968b-bc3b4ee9c4b0 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:14.523915 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-63cdaf37-023e-4b6d-968b-bc3b4ee9c4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:14.601225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 238/464] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:14.602045 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdaf37-023e-4b6d-968b-bc3b4ee9c4b0 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:14.615648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9a476c-1c7d-470f-84f6-976d440eb66e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:14.619425 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:14.655073 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4200a9df-ebb6-4137-b839-a897689b17eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:14.655917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200a9df-ebb6-4137-b839-a897689b17eb None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:14.656202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200a9df-ebb6-4137-b839-a897689b17eb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:14.658737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4200a9df-ebb6-4137-b839-a897689b17eb None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:14.658737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200a9df-ebb6-4137-b839-a897689b17eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:14.658737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200a9df-ebb6-4137-b839-a897689b17eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:14.659259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4200a9df-ebb6-4137-b839-a897689b17eb None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:14.668099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:14.678555 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 227/465] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:14.678555 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e45f0e-7423-4bde-a3bb-831d62b3bc4c None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:14.678555 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e45f0e-7423-4bde-a3bb-831d62b3bc4c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:14.678555 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e45f0e-7423-4bde-a3bb-831d62b3bc4c None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:14.678555 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 228/466] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:14.678555 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e45f0e-7423-4bde-a3bb-831d62b3bc4c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:14.722473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63cdaf37-023e-4b6d-968b-bc3b4ee9c4b0 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:14.762425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6236ec4c-e288-47a2-ab56-08c2fd16b777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:14.763160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236ec4c-e288-47a2-ab56-08c2fd16b777 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:14.763445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236ec4c-e288-47a2-ab56-08c2fd16b777 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:14.763725 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236ec4c-e288-47a2-ab56-08c2fd16b777 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:14.764431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236ec4c-e288-47a2-ab56-08c2fd16b777 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:14.766511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6236ec4c-e288-47a2-ab56-08c2fd16b777 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:14.792807 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e45f0e-7423-4bde-a3bb-831d62b3bc4c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:14.828754 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9276e-6785-4616-b26d-962e01742564 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:14.829577 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9276e-6785-4616-b26d-962e01742564 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:14.829864 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9276e-6785-4616-b26d-962e01742564 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:14.830140 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a9276e-6785-4616-b26d-962e01742564 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:14.840700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9276e-6785-4616-b26d-962e01742564 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:14.842152 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a9276e-6785-4616-b26d-962e01742564 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:14.861475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-25a9276e-6785-4616-b26d-962e01742564 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:14.861475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:14.861475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:14.861475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:14.861475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:14.861475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:14.861475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:14.861475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:14.861475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:14.861475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:14.861475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:14.861475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:14.861475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:14.861475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:14.861475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:14.862382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:14.862382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:14.862382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:14.862382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:14.862382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:14.862382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:14.862382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:14.862382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:14.862382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:14.862382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:14.862382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:14.862382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:14.862382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:14.862382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:14.862382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:14.862382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:14.862382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:14.863303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:14.863303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:14.863303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:14.863303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:14.863303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 229/467] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:14.863589 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9276e-6785-4616-b26d-962e01742564 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:14.873706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 239/468] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:16:14 2022] POST /identity/v3/users => generated 246 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:14.885225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:14.888321 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade4fe2-13aa-41ca-b7cb-57a4648e762e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:14.888615 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade4fe2-13aa-41ca-b7cb-57a4648e762e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:14.888983 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ade4fe2-13aa-41ca-b7cb-57a4648e762e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:14.919788 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-3ade4fe2-13aa-41ca-b7cb-57a4648e762e None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:14.921520 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3ade4fe2-13aa-41ca-b7cb-57a4648e762e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:15.010484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a9276e-6785-4616-b26d-962e01742564 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:15.029993 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 240/469] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:15.031813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade4fe2-13aa-41ca-b7cb-57a4648e762e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:15.069177 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298c80f-7489-4598-9e16-e5ee782ccb2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:15.069403 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298c80f-7489-4598-9e16-e5ee782ccb2a None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:15.069656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298c80f-7489-4598-9e16-e5ee782ccb2a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:15.069931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5298c80f-7489-4598-9e16-e5ee782ccb2a None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:15.073907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298c80f-7489-4598-9e16-e5ee782ccb2a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:15.073907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5298c80f-7489-4598-9e16-e5ee782ccb2a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:15.099987 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:15.156106 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ade4fe2-13aa-41ca-b7cb-57a4648e762e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:15.192428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f950d-b155-4f7f-9543-398e47d9857d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:15.193602 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f950d-b155-4f7f-9543-398e47d9857d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:15.194090 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f950d-b155-4f7f-9543-398e47d9857d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:15.194642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25f950d-b155-4f7f-9543-398e47d9857d None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:15.195623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f950d-b155-4f7f-9543-398e47d9857d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:15.196155 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f950d-b155-4f7f-9543-398e47d9857d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:15.197728 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25f950d-b155-4f7f-9543-398e47d9857d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:15.199367 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 230/470] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:16:14 2022] POST /identity/v3/users => generated 248 bytes in 336 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:15.203521 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298c80f-7489-4598-9e16-e5ee782ccb2a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:15.229121 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 241/471] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:15.236495 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f950d-b155-4f7f-9543-398e47d9857d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:15.322658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:15.356320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5298c80f-7489-4598-9e16-e5ee782ccb2a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:15.399029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25f950d-b155-4f7f-9543-398e47d9857d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:15.403487 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0909f5c0-b609-4eae-b0fa-834a1637ec63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:15.404293 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909f5c0-b609-4eae-b0fa-834a1637ec63 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:15.404575 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909f5c0-b609-4eae-b0fa-834a1637ec63 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:15.404854 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0909f5c0-b609-4eae-b0fa-834a1637ec63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:15.407485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:15.418171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909f5c0-b609-4eae-b0fa-834a1637ec63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:15.419865 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0909f5c0-b609-4eae-b0fa-834a1637ec63 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:15.444305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-0909f5c0-b609-4eae-b0fa-834a1637ec63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:15.444305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:15.444305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:15.444305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:15.444305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:15.444305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:15.444305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:15.444305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:15.444305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:15.444305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:15.444305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:15.444305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:15.444305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:15.444305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:15.444305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:15.445388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:15.445388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:15.445388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:15.445388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:15.445388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:15.445388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:15.445388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:15.445388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:15.445388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:15.445388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:15.445388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:15.445388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:15.445388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:15.445388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:15.445388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:15.445388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:15.445388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:15.446259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:15.446259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:15.446259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:15.446259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:15.446259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 231/472] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:15.448477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dfc08-2e78-4de0-ab7c-14d7a50f67c9 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:15.448477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dfc08-2e78-4de0-ab7c-14d7a50f67c9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:15.448477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417dfc08-2e78-4de0-ab7c-14d7a50f67c9 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:15.449302 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 232/473] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:15.452937 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66647cd1-7007-4f03-b498-dcf30083952b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:15.453888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66647cd1-7007-4f03-b498-dcf30083952b None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:15.454714 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66647cd1-7007-4f03-b498-dcf30083952b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:15.455162 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66647cd1-7007-4f03-b498-dcf30083952b None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:15.455542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417dfc08-2e78-4de0-ab7c-14d7a50f67c9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:15.456045 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66647cd1-7007-4f03-b498-dcf30083952b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:15.457578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66647cd1-7007-4f03-b498-dcf30083952b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:15.575244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417dfc08-2e78-4de0-ab7c-14d7a50f67c9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:15.578233 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 242/474] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:16:15 2022] POST /identity/v3/users => generated 248 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:16:15.580899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a5964-9832-475d-887e-533d6f85b0db None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:15.581220 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a5964-9832-475d-887e-533d6f85b0db None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:15.581505 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a5964-9832-475d-887e-533d6f85b0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:15.608391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:15.611193 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-ef2a5964-9832-475d-887e-533d6f85b0db None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:15.613214 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ef2a5964-9832-475d-887e-533d6f85b0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:15.624985 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b3ebb-d95b-40ef-8450-d60cca843b3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:15.626325 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b3ebb-d95b-40ef-8450-d60cca843b3e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:15.626926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b3ebb-d95b-40ef-8450-d60cca843b3e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:15.627447 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c85b3ebb-d95b-40ef-8450-d60cca843b3e None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:15.628588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b3ebb-d95b-40ef-8450-d60cca843b3e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:15.629118 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b3ebb-d95b-40ef-8450-d60cca843b3e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:15.630982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c85b3ebb-d95b-40ef-8450-d60cca843b3e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:15.646040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 233/475] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:15.652477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b3ebb-d95b-40ef-8450-d60cca843b3e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:15.711212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 243/476] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:15.756429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a5964-9832-475d-887e-533d6f85b0db None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:15.783077 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c85b3ebb-d95b-40ef-8450-d60cca843b3e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:15.830326 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f105a-7e59-40ed-ac0f-39f81fb89477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:15.831795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f105a-7e59-40ed-ac0f-39f81fb89477 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:15.832203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f105a-7e59-40ed-ac0f-39f81fb89477 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:15.832598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12f105a-7e59-40ed-ac0f-39f81fb89477 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:15.833438 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f105a-7e59-40ed-ac0f-39f81fb89477 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:15.835094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12f105a-7e59-40ed-ac0f-39f81fb89477 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:15.908261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:15.918777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a5964-9832-475d-887e-533d6f85b0db None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:15.942781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 234/477] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:16:15 2022] POST /identity/v3/users => generated 249 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:15.970437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31aa240-04fe-4569-9d2a-2cc319c7a8e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:15.971071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aa240-04fe-4569-9d2a-2cc319c7a8e8 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:15.971400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aa240-04fe-4569-9d2a-2cc319c7a8e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:15.971732 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31aa240-04fe-4569-9d2a-2cc319c7a8e8 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:15.972500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31aa240-04fe-4569-9d2a-2cc319c7a8e8 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:15.973971 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e31aa240-04fe-4569-9d2a-2cc319c7a8e8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:16.038436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.sql.core [None req-e31aa240-04fe-4569-9d2a-2cc319c7a8e8 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 15 19:16:16.038436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 15 19:16:16.038436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [parameters: {'id': 'ad757e7949c34ae2aed6865c3b07f833', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 15 19:16:16.038436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80361) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 19:16:16.059995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-e31aa240-04fe-4569-9d2a-2cc319c7a8e8 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 15 19:16:16.059995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:16.059995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 19:16:16.059995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 19:16:16.059995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 19:16:16.059995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 19:16:16.059995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 19:16:16.059995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 19:16:16.059995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 19:16:16.059995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application conn.query(q) Jul 15 19:16:16.059995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 19:16:16.059995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 19:16:16.059995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 19:16:16.059995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application result.read() Jul 15 19:16:16.059995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return ref.to_dict() Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 19:16:16.060933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application next(self.gen) Jul 15 19:16:16.061950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 19:16:16.061950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application yield resource Jul 15 19:16:16.061950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 19:16:16.061950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application next(self.gen) Jul 15 19:16:16.061950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 19:16:16.061950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 19:16:16.061950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 19:16:16.061950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 19:16:16.061950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 19:16:16.061950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise self.value Jul 15 19:16:16.061950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 19:16:16.061950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 19:16:16.061950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 19:16:16.061950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application session.commit() Jul 15 19:16:16.061950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 19:16:16.061950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 19:16:16.061950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 19:16:16.063414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 19:16:16.063414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 19:16:16.063414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self.session.flush() Jul 15 19:16:16.063414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 19:16:16.063414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 19:16:16.063414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 19:16:16.063414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 19:16:16.063414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 19:16:16.063414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application compat.raise_( Jul 15 19:16:16.063414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 19:16:16.063414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception Jul 15 19:16:16.063414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 19:16:16.063414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 19:16:16.063414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 19:16:16.063414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 19:16:16.063414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 19:16:16.063414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 19:16:16.064288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 19:16:16.064288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 19:16:16.064288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 15 19:16:16.064288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 15 19:16:16.064288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 19:16:16.064288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 19:16:16.064288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 19:16:16.064288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 19:16:16.064288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 19:16:16.064288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 19:16:16.064288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 19:16:16.064288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 19:16:16.064288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 19:16:16.064288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 19:16:16.064288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 19:16:16.064288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception Jul 15 19:16:16.065113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 19:16:16.065113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 19:16:16.065113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 19:16:16.065113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 19:16:16.065113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 19:16:16.065113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 19:16:16.065113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 19:16:16.065113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application conn.query(q) Jul 15 19:16:16.065113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 19:16:16.065113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 19:16:16.065113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 19:16:16.065113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application result.read() Jul 15 19:16:16.065113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 19:16:16.065113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 19:16:16.065113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 19:16:16.065113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 19:16:16.065926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 19:16:16.065926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 19:16:16.065926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 19:16:16.065926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 19:16:16.065926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 15 19:16:16.065926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 15 19:16:16.065926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [parameters: {'id': 'ad757e7949c34ae2aed6865c3b07f833', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 15 19:16:16.065926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 19:16:16.065926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:16.065926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:16:16.065926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:16.065926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:16.065926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:16.065926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:16.065926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:16.065926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:16.066721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:16.066721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:16.066721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:16.066721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:16.066721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:16.066721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:16.066721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 15 19:16:16.066721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 15 19:16:16.066721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:16.066721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:16.066721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 15 19:16:16.066721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 15 19:16:16.066721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 19:16:16.066721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 19:16:16.066721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 15 19:16:16.066721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:16.069967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 244/478] 10.222.0.40 () {60 vars in 1131 bytes} [Fri Jul 15 19:16:15 2022] POST /identity/v3/roles => generated 144 bytes in 306 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:16.070111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f105a-7e59-40ed-ac0f-39f81fb89477 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:16.141608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:16.212401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12f105a-7e59-40ed-ac0f-39f81fb89477 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:16.249354 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c26ceb-4ba2-4bbd-a79a-a557f930a499 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:16.250981 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c26ceb-4ba2-4bbd-a79a-a557f930a499 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:16.251473 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c26ceb-4ba2-4bbd-a79a-a557f930a499 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:16.251939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c26ceb-4ba2-4bbd-a79a-a557f930a499 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:16.263044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c26ceb-4ba2-4bbd-a79a-a557f930a499 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:16.272378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-01c26ceb-4ba2-4bbd-a79a-a557f930a499 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:16.272378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:16.272378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:16.272378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:16.272378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:16.272378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:16.272378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:16.272378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:16.272378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:16.272378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:16.272378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:16.272378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:16.272378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:16.272378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:16.272378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:16.272378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:16.273289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:16.273289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:16.273289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:16.273289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:16.273289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:16.273289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:16.273289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:16.273289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:16.273289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:16.273289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:16.273289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:16.273289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:16.273289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:16.273289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:16.273289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:16.273289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:16.274085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:16.274085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:16.274085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:16.274085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:16.274085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:16.274085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:16.274085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:16.274085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:16.274085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:16.274085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:16.274085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 15 19:16:16.274085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:16.276793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 235/479] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:16:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:16.282993 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31aa240-04fe-4569-9d2a-2cc319c7a8e8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:16.392457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31aa240-04fe-4569-9d2a-2cc319c7a8e8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:16.427284 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2c09e9-6e26-4856-a32f-af778a78fc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:16.428341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c09e9-6e26-4856-a32f-af778a78fc9a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:16.428830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c09e9-6e26-4856-a32f-af778a78fc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:16.429308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2c09e9-6e26-4856-a32f-af778a78fc9a None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:16.430267 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c09e9-6e26-4856-a32f-af778a78fc9a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:16.430827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c09e9-6e26-4856-a32f-af778a78fc9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:16.432527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2c09e9-6e26-4856-a32f-af778a78fc9a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:16.442384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 245/480] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:17.136085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c97c47-1aa5-45c7-aa55-cd2655251dee None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:17.137047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c97c47-1aa5-45c7-aa55-cd2655251dee None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:17.137529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c97c47-1aa5-45c7-aa55-cd2655251dee None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:17.139483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 236/481] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:17.146099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd55fff-4298-42fc-a7e4-fc202757f911 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:17.146991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd55fff-4298-42fc-a7e4-fc202757f911 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:17.147511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd55fff-4298-42fc-a7e4-fc202757f911 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:17.166086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-6bd55fff-4298-42fc-a7e4-fc202757f911 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:17.167729 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6bd55fff-4298-42fc-a7e4-fc202757f911 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:17.182898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:17.263229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 246/482] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:16:17.303012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c97c47-1aa5-45c7-aa55-cd2655251dee None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:17.412195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:17.416696 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c97c47-1aa5-45c7-aa55-cd2655251dee None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:17.454155 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d289a3-e90e-47a5-82ad-774101a42dc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:17.455101 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d289a3-e90e-47a5-82ad-774101a42dc8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:17.455389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d289a3-e90e-47a5-82ad-774101a42dc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:17.455716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d289a3-e90e-47a5-82ad-774101a42dc8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:17.466909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d289a3-e90e-47a5-82ad-774101a42dc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:17.474840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-80d289a3-e90e-47a5-82ad-774101a42dc8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:17.474840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:17.474840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:17.474840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:17.474840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:17.474840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:17.474840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:17.474840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:17.474840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:17.474840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:17.474840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:17.474840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:17.474840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:17.474840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:17.474840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:17.474840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:17.475721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:17.475721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:17.475721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:17.475721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:17.475721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:17.475721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:17.475721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:17.475721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:17.475721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:17.475721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:17.475721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:17.475721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:17.475721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:17.475721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:17.475721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:17.475721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:17.476532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:17.476532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:17.476532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:17.476532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:17.476532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:17.476532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:17.476532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:17.476532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:17.476532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:17.476532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:17.476532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:17.476532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:17.476532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 237/483] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:17.482202 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd55fff-4298-42fc-a7e4-fc202757f911 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:17.608688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd55fff-4298-42fc-a7e4-fc202757f911 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:17.650179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c344aabf-9309-46c9-86ec-dd0f5e75fa83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:17.650866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344aabf-9309-46c9-86ec-dd0f5e75fa83 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:17.651148 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344aabf-9309-46c9-86ec-dd0f5e75fa83 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:17.651417 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c344aabf-9309-46c9-86ec-dd0f5e75fa83 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:17.652164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344aabf-9309-46c9-86ec-dd0f5e75fa83 None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:17.652463 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344aabf-9309-46c9-86ec-dd0f5e75fa83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:17.653825 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c344aabf-9309-46c9-86ec-dd0f5e75fa83 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:17.666995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 247/484] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:17.668474 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d289a3-e90e-47a5-82ad-774101a42dc8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:17.696036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761d613-def6-4cc5-9f07-30912e6f05d0 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:17.696374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761d613-def6-4cc5-9f07-30912e6f05d0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:17.696584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e761d613-def6-4cc5-9f07-30912e6f05d0 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:17.698198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 248/485] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:17.704747 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e49fc-67b6-4f68-87bc-9262d103eaf2 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:17.705029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e49fc-67b6-4f68-87bc-9262d103eaf2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:17.705305 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091e49fc-67b6-4f68-87bc-9262d103eaf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:17.735846 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-091e49fc-67b6-4f68-87bc-9262d103eaf2 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:17.737776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-091e49fc-67b6-4f68-87bc-9262d103eaf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:17.744530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:17.861275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 249/486] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:17.875219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d289a3-e90e-47a5-82ad-774101a42dc8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:17.884202 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e49fc-67b6-4f68-87bc-9262d103eaf2 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:17.949365 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de6daa-bc72-4623-b265-35936fe3cbe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:17.950074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de6daa-bc72-4623-b265-35936fe3cbe3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:17.950354 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de6daa-bc72-4623-b265-35936fe3cbe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:17.950625 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5de6daa-bc72-4623-b265-35936fe3cbe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:17.974600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de6daa-bc72-4623-b265-35936fe3cbe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:17.976092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5de6daa-bc72-4623-b265-35936fe3cbe3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:18.007507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f5de6daa-bc72-4623-b265-35936fe3cbe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:18.007507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:18.007507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:18.007507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:18.007507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:18.007507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:18.007507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:18.007507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:18.007507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:18.007507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:18.007507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:18.007507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:18.007507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:18.007507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:18.007507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:18.008446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:18.008446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:18.008446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:18.008446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:18.008446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:18.008446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:18.008446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:18.008446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:18.008446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:18.008446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:18.008446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:18.008446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:18.008446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:18.008446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:18.008446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:18.008446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:18.008446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:18.009319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:18.009319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:18.009319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:18.009319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:18.009319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 238/487] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:18.017513 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de6daa-bc72-4623-b265-35936fe3cbe3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:18.043873 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091e49fc-67b6-4f68-87bc-9262d103eaf2 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:18.051154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:18.108123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7ffc2-9b6b-4318-987a-c6f927429590 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:18.109343 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7ffc2-9b6b-4318-987a-c6f927429590 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:18.109674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7ffc2-9b6b-4318-987a-c6f927429590 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:18.109955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe7ffc2-9b6b-4318-987a-c6f927429590 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:18.127902 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:18.135979 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe7ffc2-9b6b-4318-987a-c6f927429590 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:18.151918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-0fe7ffc2-9b6b-4318-987a-c6f927429590 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:18.151918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:18.151918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:18.151918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:18.151918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:18.151918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:18.151918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:18.151918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:18.151918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:18.151918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:18.151918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:18.151918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:18.151918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:18.151918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:18.151918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:18.151918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:18.153298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:18.153298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:18.153298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:18.153298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:18.153298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:18.153298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:18.153298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:18.153298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:18.153298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:18.153298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:18.153298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:18.153298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:18.153298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:18.153298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:18.153298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:18.153298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:18.154100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:18.154100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:18.154100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:18.154100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:18.154100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:18.154100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:18.154100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:18.154100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:18.154100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:18.154100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:18.154100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:18.154100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:18.154100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 250/488] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:16:18.159479 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7ffc2-9b6b-4318-987a-c6f927429590 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:18.212231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5de6daa-bc72-4623-b265-35936fe3cbe3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:18.251009 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e68fb-796c-488c-b852-20dc32c82fe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:18.251684 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e68fb-796c-488c-b852-20dc32c82fe1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:18.251971 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e68fb-796c-488c-b852-20dc32c82fe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:18.252250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1e68fb-796c-488c-b852-20dc32c82fe1 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:18.253199 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e68fb-796c-488c-b852-20dc32c82fe1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:18.253513 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e68fb-796c-488c-b852-20dc32c82fe1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:18.255005 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1e68fb-796c-488c-b852-20dc32c82fe1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:18.269295 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 239/489] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:18.274896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e68fb-796c-488c-b852-20dc32c82fe1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:18.355181 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:18.355371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe7ffc2-9b6b-4318-987a-c6f927429590 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:18.389573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1e68fb-796c-488c-b852-20dc32c82fe1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:18.391583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce41e39-d321-4757-80ee-c3edae17d456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:18.392586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce41e39-d321-4757-80ee-c3edae17d456 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:18.392940 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce41e39-d321-4757-80ee-c3edae17d456 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:18.393283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce41e39-d321-4757-80ee-c3edae17d456 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:18.394108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce41e39-d321-4757-80ee-c3edae17d456 None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:18.394488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce41e39-d321-4757-80ee-c3edae17d456 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:18.395987 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce41e39-d321-4757-80ee-c3edae17d456 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:18.405133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 251/490] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:18.406989 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd13bf5-dd8b-4731-b7d0-57051984bc6a None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:18.407354 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd13bf5-dd8b-4731-b7d0-57051984bc6a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:18.407703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd13bf5-dd8b-4731-b7d0-57051984bc6a None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:18.413164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 252/491] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:18.414116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd13bf5-dd8b-4731-b7d0-57051984bc6a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:18.433928 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab1b507-e0a4-4830-9701-8525bc34cd85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:18.434932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1b507-e0a4-4830-9701-8525bc34cd85 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:18.435281 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1b507-e0a4-4830-9701-8525bc34cd85 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:18.435568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab1b507-e0a4-4830-9701-8525bc34cd85 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:18.445593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1b507-e0a4-4830-9701-8525bc34cd85 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:18.447201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab1b507-e0a4-4830-9701-8525bc34cd85 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:18.464812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-2ab1b507-e0a4-4830-9701-8525bc34cd85 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:16:18.464812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:18.464812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:18.464812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:18.464812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:18.464812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:18.464812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:18.464812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:18.464812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:18.464812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:18.464812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:18.464812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:18.464812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:18.464812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:18.464812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:18.464812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:18.465762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:18.466664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:18.466664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:18.466664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:18.466664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:18.466664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:18.466664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:18.466664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:18.466664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:18.466664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:16:18.466664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:18.466664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 240/492] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Jul 15 19:16:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:16:18.472513 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80817b-6182-44bd-b26f-f06375a48508 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:18.472809 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80817b-6182-44bd-b26f-f06375a48508 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:18.473092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da80817b-6182-44bd-b26f-f06375a48508 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:18.480820 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:18.493747 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-da80817b-6182-44bd-b26f-f06375a48508 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:18.495082 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-da80817b-6182-44bd-b26f-f06375a48508 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:18.523869 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd13bf5-dd8b-4731-b7d0-57051984bc6a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:18.561479 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e277a287-3581-40c9-a670-564275b40fce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:18.563165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277a287-3581-40c9-a670-564275b40fce None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:18.563447 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277a287-3581-40c9-a670-564275b40fce None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:18.563727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e277a287-3581-40c9-a670-564275b40fce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:18.572635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 241/493] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:18.573690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80817b-6182-44bd-b26f-f06375a48508 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:18.577267 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277a287-3581-40c9-a670-564275b40fce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:18.579419 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e277a287-3581-40c9-a670-564275b40fce None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:18.600222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-e277a287-3581-40c9-a670-564275b40fce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:18.600222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:18.600222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:18.600222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:18.600222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:18.600222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:18.600222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:18.600222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:18.600222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:18.600222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:18.600222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:18.600222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:18.600222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:18.600222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:18.600222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:18.601211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:18.601211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:18.601211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:18.601211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:18.601211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:18.601211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:18.601211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:18.601211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:18.601211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:18.601211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:18.601211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:18.601211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:18.601211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:18.601211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:18.601211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:18.601211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:18.601211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:18.602103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:18.602103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:18.602103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:18.602103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:18.602103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 253/494] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:18.603076 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf0f46-1137-4ce0-a4e6-7705520f9e7e None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:18.603456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf0f46-1137-4ce0-a4e6-7705520f9e7e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:18.603832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaf0f46-1137-4ce0-a4e6-7705520f9e7e None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:18.605203 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 254/495] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:18.606024 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf0f46-1137-4ce0-a4e6-7705520f9e7e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:18.654609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:18.698889 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da80817b-6182-44bd-b26f-f06375a48508 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:18.723458 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaf0f46-1137-4ce0-a4e6-7705520f9e7e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:18.737103 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52671581-6e77-40e3-b558-d5f02473ad99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:18.737662 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:18.738472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52671581-6e77-40e3-b558-d5f02473ad99 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:18.738933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52671581-6e77-40e3-b558-d5f02473ad99 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:18.739481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52671581-6e77-40e3-b558-d5f02473ad99 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:18.740787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52671581-6e77-40e3-b558-d5f02473ad99 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:18.741373 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52671581-6e77-40e3-b558-d5f02473ad99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:18.743316 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52671581-6e77-40e3-b558-d5f02473ad99 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:18.759542 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92adcc-1d02-4948-9d32-ec0c088c88d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:18.760342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92adcc-1d02-4948-9d32-ec0c088c88d4 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:18.760629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92adcc-1d02-4948-9d32-ec0c088c88d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:18.760911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca92adcc-1d02-4948-9d32-ec0c088c88d4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:18.773477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca92adcc-1d02-4948-9d32-ec0c088c88d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:18.781721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-ca92adcc-1d02-4948-9d32-ec0c088c88d4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:18.781721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:18.781721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:18.781721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:18.781721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:18.781721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:18.781721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:18.781721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:18.781721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:18.781721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:18.781721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:18.781721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:18.781721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:18.781721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:18.781721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:18.781721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:18.782688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:18.782688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:18.782688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:18.782688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:18.782688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:18.782688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:18.782688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:18.782688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:18.782688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:18.782688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:18.782688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:18.782688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:18.782688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:18.782688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:18.782688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:18.782688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:18.789102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:18.789102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:18.789102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:18.789102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:18.789102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:18.789102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:18.789102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:18.789102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:18.789102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:18.789102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:18.789102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:18.789102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:18.789102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 255/496] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:18.789102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92adcc-1d02-4948-9d32-ec0c088c88d4 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:18.792266 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 242/497] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Jul 15 19:16:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:18.793623 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1fc29-4901-4e27-b864-8fb88db580f3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:18.793916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1fc29-4901-4e27-b864-8fb88db580f3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:18.794195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d1fc29-4901-4e27-b864-8fb88db580f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:18.811433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e0d1fc29-4901-4e27-b864-8fb88db580f3 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:18.813431 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e0d1fc29-4901-4e27-b864-8fb88db580f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:18.886484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 243/498] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:18.887404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1fc29-4901-4e27-b864-8fb88db580f3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:18.908325 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca92adcc-1d02-4948-9d32-ec0c088c88d4 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:18.943897 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:18.956211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65682282-18ca-4748-afa7-4a358d622f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:18.957844 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65682282-18ca-4748-afa7-4a358d622f65 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:18.958554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65682282-18ca-4748-afa7-4a358d622f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:18.959042 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65682282-18ca-4748-afa7-4a358d622f65 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:18.959987 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65682282-18ca-4748-afa7-4a358d622f65 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:18.960477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65682282-18ca-4748-afa7-4a358d622f65 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:18.962641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65682282-18ca-4748-afa7-4a358d622f65 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:18.979057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 256/499] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:18.980568 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65682282-18ca-4748-afa7-4a358d622f65 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:18.999897 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d1fc29-4901-4e27-b864-8fb88db580f3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:19.016675 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:19.040047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03150175-5e11-4398-bd54-89d3931526e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:19.042564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03150175-5e11-4398-bd54-89d3931526e0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:19.042564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03150175-5e11-4398-bd54-89d3931526e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:19.042564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03150175-5e11-4398-bd54-89d3931526e0 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:19.042564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03150175-5e11-4398-bd54-89d3931526e0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:19.042564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03150175-5e11-4398-bd54-89d3931526e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:19.043936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03150175-5e11-4398-bd54-89d3931526e0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:19.057154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 244/500] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:19.057154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03150175-5e11-4398-bd54-89d3931526e0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:19.099283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65682282-18ca-4748-afa7-4a358d622f65 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:19.136422 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f127f6-7e03-4f9c-8951-5865efa54933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:19.137075 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f127f6-7e03-4f9c-8951-5865efa54933 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:19.137358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f127f6-7e03-4f9c-8951-5865efa54933 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:19.137636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f127f6-7e03-4f9c-8951-5865efa54933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:19.168560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03150175-5e11-4398-bd54-89d3931526e0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:19.183357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:19.205116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d86d0b-bc62-4be5-84b0-bdbc83662f94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:19.205962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d86d0b-bc62-4be5-84b0-bdbc83662f94 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:19.206247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d86d0b-bc62-4be5-84b0-bdbc83662f94 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:19.206515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d86d0b-bc62-4be5-84b0-bdbc83662f94 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:19.213230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f127f6-7e03-4f9c-8951-5865efa54933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:19.214726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f127f6-7e03-4f9c-8951-5865efa54933 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:19.217921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d86d0b-bc62-4be5-84b0-bdbc83662f94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:19.226173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-11d86d0b-bc62-4be5-84b0-bdbc83662f94 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:19.226173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:19.226173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:19.226173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:19.226173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:19.226173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:19.226173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:19.226173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:19.226173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:19.226173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:19.226173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:19.226173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:19.226173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:19.226173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:19.226173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:19.226173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:19.227137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:19.227137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:19.227137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:19.227137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:19.227137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:19.227137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:19.227137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:19.227137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:19.227137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:19.227137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:19.227137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:19.227137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:19.227137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:19.227137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:19.227137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:19.227137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:19.227962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:19.227962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:19.227962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:19.227962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:19.227962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:19.227962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:19.227962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:19.227962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:19.227962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:19.227962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:19.227962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:19.227962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:19.232436 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 245/501] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:19.233115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d86d0b-bc62-4be5-84b0-bdbc83662f94 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:19.253875 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:19.322112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 257/502] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:19.322852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f127f6-7e03-4f9c-8951-5865efa54933 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:19.336229 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d86d0b-bc62-4be5-84b0-bdbc83662f94 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:19.377601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a659854-1b63-432c-9c53-3f4712e00eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:19.379064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a659854-1b63-432c-9c53-3f4712e00eba None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:19.379382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a659854-1b63-432c-9c53-3f4712e00eba None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:19.379661 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a659854-1b63-432c-9c53-3f4712e00eba None admin] PATH_INFO: `/v3/users/glance` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:19.390041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a659854-1b63-432c-9c53-3f4712e00eba None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:19.392391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a659854-1b63-432c-9c53-3f4712e00eba None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:19.408035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-6a659854-1b63-432c-9c53-3f4712e00eba None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 19:16:19.408035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:19.408035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:19.408035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:19.408035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:19.408035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:19.408035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:19.408035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:19.408035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:19.408035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:19.408035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:19.408035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:19.408035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:19.408035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:19.408035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:19.408035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:19.409219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:19.410139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:19.410139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:19.410139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:19.410139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:19.410139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:19.410139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:19.410139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:19.410139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:19.410139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 19:16:19.410139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:19.410139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 246/503] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:19 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:19.410139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a659854-1b63-432c-9c53-3f4712e00eba None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:19.433973 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f127f6-7e03-4f9c-8951-5865efa54933 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:19.445252 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:19.470847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d372f7a3-b805-4d31-bfae-225b10e5c6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:19.471959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372f7a3-b805-4d31-bfae-225b10e5c6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:19.472235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372f7a3-b805-4d31-bfae-225b10e5c6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:19.472505 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d372f7a3-b805-4d31-bfae-225b10e5c6b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:19.474609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:19.487598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372f7a3-b805-4d31-bfae-225b10e5c6b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:19.487598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d372f7a3-b805-4d31-bfae-225b10e5c6b5 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:19.503724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-d372f7a3-b805-4d31-bfae-225b10e5c6b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:19.503724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:19.503724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:19.503724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:19.503724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:19.503724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:19.503724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:19.503724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:19.503724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:19.503724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:19.503724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:19.503724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:19.503724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:19.503724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:19.503724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:19.504630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:19.504630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:19.504630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:19.504630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:19.504630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:19.504630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:19.504630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:19.504630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:19.504630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:19.504630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:19.504630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:19.504630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:19.504630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:19.504630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:19.504630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:19.504630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:19.504630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:19.505567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:19.505567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:19.505567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:19.505567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:19.505567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 258/504] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:19.506498 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455026c-d5cd-4085-bb04-52c9eba902f5 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:19.506602 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455026c-d5cd-4085-bb04-52c9eba902f5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:19.507186 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455026c-d5cd-4085-bb04-52c9eba902f5 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:19.512684 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 259/505] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:19 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:19.513459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455026c-d5cd-4085-bb04-52c9eba902f5 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:19.524358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a659854-1b63-432c-9c53-3f4712e00eba None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:19.562552 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfab57-0cc0-4d34-8861-f89c4b4187ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:19.563253 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfab57-0cc0-4d34-8861-f89c4b4187ed None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:19.563538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfab57-0cc0-4d34-8861-f89c4b4187ed None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:19.563814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccfab57-0cc0-4d34-8861-f89c4b4187ed None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:19.564558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfab57-0cc0-4d34-8861-f89c4b4187ed None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:19.564871 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfab57-0cc0-4d34-8861-f89c4b4187ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:19.566245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eccfab57-0cc0-4d34-8861-f89c4b4187ed None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:19.574644 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 247/506] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:19.575461 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfab57-0cc0-4d34-8861-f89c4b4187ed None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:19.634654 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455026c-d5cd-4085-bb04-52c9eba902f5 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:19.673431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092b63b-a748-47a0-8117-eccf9967a94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:19.674357 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092b63b-a748-47a0-8117-eccf9967a94f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:19.674691 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092b63b-a748-47a0-8117-eccf9967a94f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:19.675068 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e092b63b-a748-47a0-8117-eccf9967a94f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:19.681330 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:19.689976 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092b63b-a748-47a0-8117-eccf9967a94f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:19.690647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eccfab57-0cc0-4d34-8861-f89c4b4187ed None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:19.691837 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e092b63b-a748-47a0-8117-eccf9967a94f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:19.709239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-e092b63b-a748-47a0-8117-eccf9967a94f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:19.709239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:19.709239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:19.709239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:19.709239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:19.709239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:19.709239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:19.709239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:19.709239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:19.709239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:19.709239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:19.709239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:19.709239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:19.709239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:19.709239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:19.710318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:19.710318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:19.710318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:19.710318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:19.710318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:19.710318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:19.710318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:19.710318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:19.710318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:19.710318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:19.710318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:19.710318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:19.710318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:19.710318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:19.710318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:19.710318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:19.710318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:19.711572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:19.711572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:19.711572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:19.711572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:19.711572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 260/507] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:19.711572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092b63b-a748-47a0-8117-eccf9967a94f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:19.730405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79dff5b-c23b-45ad-a2c3-aff330743463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:19.731108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dff5b-c23b-45ad-a2c3-aff330743463 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:19.731391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dff5b-c23b-45ad-a2c3-aff330743463 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:19.731666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79dff5b-c23b-45ad-a2c3-aff330743463 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:19.732514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79dff5b-c23b-45ad-a2c3-aff330743463 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:19.732829 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79dff5b-c23b-45ad-a2c3-aff330743463 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:19.734905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79dff5b-c23b-45ad-a2c3-aff330743463 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:19.753668 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 248/508] 10.222.0.40 () {56 vars in 1137 bytes} [Fri Jul 15 19:16:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:19.754881 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd79553-e8b2-4169-8279-94bc05dd709a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:19.755177 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd79553-e8b2-4169-8279-94bc05dd709a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:19.755345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:19.755472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd79553-e8b2-4169-8279-94bc05dd709a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:19.772762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-bcd79553-e8b2-4169-8279-94bc05dd709a None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:19.774111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bcd79553-e8b2-4169-8279-94bc05dd709a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:19.823229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e092b63b-a748-47a0-8117-eccf9967a94f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:19.843546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 249/509] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:19.847690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd79553-e8b2-4169-8279-94bc05dd709a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:19.859810 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b2b33-53bb-4a26-8b23-56201f757b7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:19.860475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b2b33-53bb-4a26-8b23-56201f757b7d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:19.860758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b2b33-53bb-4a26-8b23-56201f757b7d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:19.861032 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77b2b33-53bb-4a26-8b23-56201f757b7d None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:19.861760 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b2b33-53bb-4a26-8b23-56201f757b7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:19.862077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b2b33-53bb-4a26-8b23-56201f757b7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:19.863484 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77b2b33-53bb-4a26-8b23-56201f757b7d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:19.875640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 261/510] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:19.876701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b2b33-53bb-4a26-8b23-56201f757b7d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:19.947322 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:19.965043 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd79553-e8b2-4169-8279-94bc05dd709a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:19.973383 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:19.977350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77b2b33-53bb-4a26-8b23-56201f757b7d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:19.999074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41401612-3207-45fa-aef2-b47ac85d663d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:20.000432 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41401612-3207-45fa-aef2-b47ac85d663d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:20.000696 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41401612-3207-45fa-aef2-b47ac85d663d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:20.000961 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41401612-3207-45fa-aef2-b47ac85d663d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:20.011008 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41401612-3207-45fa-aef2-b47ac85d663d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:20.011979 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01767229-f019-4469-b0fd-4543559a5288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:20.012465 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41401612-3207-45fa-aef2-b47ac85d663d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:20.012642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01767229-f019-4469-b0fd-4543559a5288 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:20.012926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01767229-f019-4469-b0fd-4543559a5288 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:20.013203 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01767229-f019-4469-b0fd-4543559a5288 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:20.013989 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01767229-f019-4469-b0fd-4543559a5288 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:20.014313 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01767229-f019-4469-b0fd-4543559a5288 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:20.016101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01767229-f019-4469-b0fd-4543559a5288 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:20.028482 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 262/511] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:20.028482 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01767229-f019-4469-b0fd-4543559a5288 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:20.033701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-41401612-3207-45fa-aef2-b47ac85d663d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:20.033701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:20.033701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:20.033701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:20.033701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:20.033701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:20.033701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:20.033701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:20.033701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:20.033701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:20.033701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:20.033701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:20.033701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:20.033701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:20.033701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:20.034691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:20.034691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:20.034691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:20.034691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:20.034691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:20.034691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:20.034691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:20.034691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:20.034691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:20.034691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:20.034691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:20.034691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:20.034691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:20.034691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:20.034691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:20.034691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:20.034691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:20.035779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:20.035779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:20.035779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:20.035779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:20.035779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 250/512] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:20.035779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41401612-3207-45fa-aef2-b47ac85d663d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:20.134640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01767229-f019-4469-b0fd-4543559a5288 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:20.138046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41401612-3207-45fa-aef2-b47ac85d663d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:20.168625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e01c2-76ee-4ded-bde1-8ac63a52e8ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:20.169272 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e01c2-76ee-4ded-bde1-8ac63a52e8ee None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:20.169560 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e01c2-76ee-4ded-bde1-8ac63a52e8ee None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:20.169838 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23e01c2-76ee-4ded-bde1-8ac63a52e8ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:20.172536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f592c-28fe-4fc8-b585-389e3b69679e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:20.173315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f592c-28fe-4fc8-b585-389e3b69679e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:20.173589 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f592c-28fe-4fc8-b585-389e3b69679e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:20.173867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f592c-28fe-4fc8-b585-389e3b69679e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:20.175843 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:20.185309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f592c-28fe-4fc8-b585-389e3b69679e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:20.186809 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e8f592c-28fe-4fc8-b585-389e3b69679e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:20.197615 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:20.203750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-1e8f592c-28fe-4fc8-b585-389e3b69679e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:20.203750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:20.203750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:20.203750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:20.203750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:20.203750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:20.203750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:20.203750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:20.203750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:20.203750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:20.203750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:20.203750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:20.203750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:20.203750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:20.203750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:20.204962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:20.204962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:20.204962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:20.204962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:20.204962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:20.204962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:20.204962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:20.204962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:20.204962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:20.204962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:20.204962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:20.204962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:20.204962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:20.204962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:20.204962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:20.204962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:20.204962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:20.205825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:20.205825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:20.205825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:20.205825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:20.205825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 251/513] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:20.205825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f592c-28fe-4fc8-b585-389e3b69679e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:20.239830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e01c2-76ee-4ded-bde1-8ac63a52e8ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:20.241608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23e01c2-76ee-4ded-bde1-8ac63a52e8ee None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:20.310530 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f592c-28fe-4fc8-b585-389e3b69679e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:20.341777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 263/514] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:20.342718 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e01c2-76ee-4ded-bde1-8ac63a52e8ee None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:20.348218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d80cfd-16ee-4c8f-9d93-1015cd7f1f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:20.348999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d80cfd-16ee-4c8f-9d93-1015cd7f1f21 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:20.349274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d80cfd-16ee-4c8f-9d93-1015cd7f1f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:20.349542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d80cfd-16ee-4c8f-9d93-1015cd7f1f21 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:20.357171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d80cfd-16ee-4c8f-9d93-1015cd7f1f21 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:20.359254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d80cfd-16ee-4c8f-9d93-1015cd7f1f21 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:20.373130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-76d80cfd-16ee-4c8f-9d93-1015cd7f1f21 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 19:16:20.373130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:20.373130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:20.373130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:20.373130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:20.373130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:20.373130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:20.373130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:20.373130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:20.373130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:20.373130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:20.373130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:20.373130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:20.373130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:20.373130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:20.373130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:20.374047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:20.375336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:20.375336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:20.375336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:20.375336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:20.375336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:20.375336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:20.375336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:20.375336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:20.375336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 19:16:20.375336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:20.375336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 252/515] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:20 2022] GET /identity/v3/users/cinder => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:20.375336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d80cfd-16ee-4c8f-9d93-1015cd7f1f21 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:20.409961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:20.422133 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:20.452049 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23e01c2-76ee-4ded-bde1-8ac63a52e8ee None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:20.475958 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d80cfd-16ee-4c8f-9d93-1015cd7f1f21 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:20.486918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb266c3-79ed-4384-90f3-3e9a631562e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:20.487709 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb266c3-79ed-4384-90f3-3e9a631562e3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:20.487988 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb266c3-79ed-4384-90f3-3e9a631562e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:20.488264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb266c3-79ed-4384-90f3-3e9a631562e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:20.495043 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb266c3-79ed-4384-90f3-3e9a631562e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:20.496503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb266c3-79ed-4384-90f3-3e9a631562e3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:20.509130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93178cdd-472e-49ad-83c3-ee0cb071d80a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:20.509783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93178cdd-472e-49ad-83c3-ee0cb071d80a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:20.510061 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93178cdd-472e-49ad-83c3-ee0cb071d80a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:20.510337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93178cdd-472e-49ad-83c3-ee0cb071d80a None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:20.511096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93178cdd-472e-49ad-83c3-ee0cb071d80a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:20.511189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-0cb266c3-79ed-4384-90f3-3e9a631562e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:20.511189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:20.511189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:20.511189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:20.511189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:20.511189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:20.511189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:20.511189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:20.511189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:20.511189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:20.511189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:20.511189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:20.511189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:20.511189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:20.511189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:20.512110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:20.512110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:20.512110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:20.512110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:20.512110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:20.512110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:20.512110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:20.512110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:20.512110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:20.512110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:20.512110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:20.512110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:20.512110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:20.512110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:20.512110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:20.512110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:20.512110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:20.512945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:20.512945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:20.512945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:20.512945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:20.512945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:20.512945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:20.512945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:20.512945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:20.513358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93178cdd-472e-49ad-83c3-ee0cb071d80a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:20.513438 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 264/516] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:20.513505 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93178cdd-472e-49ad-83c3-ee0cb071d80a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:20.513570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb266c3-79ed-4384-90f3-3e9a631562e3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:20.526990 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 253/517] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:20.527624 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93178cdd-472e-49ad-83c3-ee0cb071d80a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:20.621800 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb266c3-79ed-4384-90f3-3e9a631562e3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:20.627461 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93178cdd-472e-49ad-83c3-ee0cb071d80a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:20.634839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:20.639230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:20.657580 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412689c8-ceac-4f4d-b98e-4f483168f5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:20.658236 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412689c8-ceac-4f4d-b98e-4f483168f5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:20.658517 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412689c8-ceac-4f4d-b98e-4f483168f5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:20.658825 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412689c8-ceac-4f4d-b98e-4f483168f5d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:20.659581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412689c8-ceac-4f4d-b98e-4f483168f5d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:20.659852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412689c8-ceac-4f4d-b98e-4f483168f5d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:20.661297 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412689c8-ceac-4f4d-b98e-4f483168f5d7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:20.663082 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151b8cb-d647-4cb9-8c1a-f9091e5422e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:20.664381 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151b8cb-d647-4cb9-8c1a-f9091e5422e8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:20.664875 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151b8cb-d647-4cb9-8c1a-f9091e5422e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:20.665366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f151b8cb-d647-4cb9-8c1a-f9091e5422e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:20.672729 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 265/518] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:20.676590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412689c8-ceac-4f4d-b98e-4f483168f5d7 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:20.684412 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151b8cb-d647-4cb9-8c1a-f9091e5422e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:20.686023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f151b8cb-d647-4cb9-8c1a-f9091e5422e8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:20.704667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f151b8cb-d647-4cb9-8c1a-f9091e5422e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:20.704667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:20.704667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:20.704667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:20.704667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:20.704667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:20.704667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:20.704667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:20.704667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:20.704667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:20.704667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:20.704667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:20.704667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:20.704667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:20.704667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:20.705595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:20.705595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:20.705595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:20.705595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:20.705595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:20.705595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:20.705595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:20.705595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:20.705595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:20.705595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:20.705595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:20.705595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:20.705595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:20.705595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:20.705595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:20.705595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:20.705595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:20.706481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:20.706481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:20.706481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:20.706481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:20.706481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 254/519] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:20.707344 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151b8cb-d647-4cb9-8c1a-f9091e5422e8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:20.785681 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412689c8-ceac-4f4d-b98e-4f483168f5d7 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:20.810683 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f151b8cb-d647-4cb9-8c1a-f9091e5422e8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:20.820394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed20c4-cf04-445f-8588-85a622f3304f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:20.821065 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed20c4-cf04-445f-8588-85a622f3304f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:20.821348 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed20c4-cf04-445f-8588-85a622f3304f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:20.821624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ed20c4-cf04-445f-8588-85a622f3304f None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:20.822470 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed20c4-cf04-445f-8588-85a622f3304f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:20.822802 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed20c4-cf04-445f-8588-85a622f3304f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:20.824469 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ed20c4-cf04-445f-8588-85a622f3304f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:20.846268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e54fbb-839b-40c3-a35d-a2de36e2fd53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:20.846955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e54fbb-839b-40c3-a35d-a2de36e2fd53 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:20.847242 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e54fbb-839b-40c3-a35d-a2de36e2fd53 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:20.847522 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e54fbb-839b-40c3-a35d-a2de36e2fd53 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:20.848309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e54fbb-839b-40c3-a35d-a2de36e2fd53 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:20.848627 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e54fbb-839b-40c3-a35d-a2de36e2fd53 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:20.850061 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e54fbb-839b-40c3-a35d-a2de36e2fd53 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:20.862633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 266/520] 10.222.0.40 () {56 vars in 1137 bytes} [Fri Jul 15 19:16:20 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:20.863509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed20c4-cf04-445f-8588-85a622f3304f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:20.876219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 255/521] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:20.876219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e54fbb-839b-40c3-a35d-a2de36e2fd53 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:20.895675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:20.899603 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:20.963817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ed20c4-cf04-445f-8588-85a622f3304f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:20.978496 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e54fbb-839b-40c3-a35d-a2de36e2fd53 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:20.998858 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474f8aa-4d2f-4e51-8a16-8e1644fafdd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:20.999678 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474f8aa-4d2f-4e51-8a16-8e1644fafdd7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:20.999962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474f8aa-4d2f-4e51-8a16-8e1644fafdd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:21.000604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e474f8aa-4d2f-4e51-8a16-8e1644fafdd7 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:21.007331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474f8aa-4d2f-4e51-8a16-8e1644fafdd7 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:21.008774 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e474f8aa-4d2f-4e51-8a16-8e1644fafdd7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:21.012973 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e407ed-c572-4517-b4c7-6b544786f1f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:21.013634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e407ed-c572-4517-b4c7-6b544786f1f6 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:21.013920 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e407ed-c572-4517-b4c7-6b544786f1f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:21.014194 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e407ed-c572-4517-b4c7-6b544786f1f6 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:21.015608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e407ed-c572-4517-b4c7-6b544786f1f6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:21.017526 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e407ed-c572-4517-b4c7-6b544786f1f6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:21.025500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-e474f8aa-4d2f-4e51-8a16-8e1644fafdd7 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 19:16:21.025500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:21.025500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:21.025500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:21.025500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:21.025500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:21.025500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:21.025500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:21.025500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:21.025500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:21.025500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:21.025500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:21.025500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:21.025500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:21.025500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:21.025500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:21.026436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:21.027707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:21.027707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:21.027707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:21.027707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:21.027707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:21.027707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:21.027707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:21.027707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:21.027707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 19:16:21.027707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:21.027707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 267/522] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:20 2022] GET /identity/v3/users/neutron => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:21.027707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474f8aa-4d2f-4e51-8a16-8e1644fafdd7 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:21.113297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 256/523] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:16:20 2022] POST /identity/v3/users => generated 247 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:21.114133 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e407ed-c572-4517-b4c7-6b544786f1f6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:21.126579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:21.133390 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e474f8aa-4d2f-4e51-8a16-8e1644fafdd7 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:21.173779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b936d4-b743-4929-ba7c-430431fd59db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:21.174471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b936d4-b743-4929-ba7c-430431fd59db None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:21.174792 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b936d4-b743-4929-ba7c-430431fd59db None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:21.175132 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b936d4-b743-4929-ba7c-430431fd59db None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:21.175960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b936d4-b743-4929-ba7c-430431fd59db None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:21.176273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b936d4-b743-4929-ba7c-430431fd59db None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:21.177763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b936d4-b743-4929-ba7c-430431fd59db None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:21.191320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 268/524] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:21.192271 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b936d4-b743-4929-ba7c-430431fd59db None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:21.220148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:21.252084 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e407ed-c572-4517-b4c7-6b544786f1f6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:21.293799 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca926c-c53c-4f66-bedd-85fe5ba9679b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:21.294784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca926c-c53c-4f66-bedd-85fe5ba9679b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:21.294784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca926c-c53c-4f66-bedd-85fe5ba9679b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:21.295590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ca926c-c53c-4f66-bedd-85fe5ba9679b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:21.309960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b936d4-b743-4929-ba7c-430431fd59db None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:21.346497 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f2e93-e2b3-49f0-9305-f9dfe14d0d28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:21.347516 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f2e93-e2b3-49f0-9305-f9dfe14d0d28 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:21.348006 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f2e93-e2b3-49f0-9305-f9dfe14d0d28 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:21.348425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-316f2e93-e2b3-49f0-9305-f9dfe14d0d28 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:21.349398 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f2e93-e2b3-49f0-9305-f9dfe14d0d28 None admin] RBAC: Adding query filter params (role.id=579726a957a7468abecab3fbdb4351a9, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=850a32e590154968bfbbfc404450b70a) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:21.349847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f2e93-e2b3-49f0-9305-f9dfe14d0d28 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:21.351427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-316f2e93-e2b3-49f0-9305-f9dfe14d0d28 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:21.357296 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 269/525] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:21 2022] GET /identity/v3/role_assignments?user.id=850a32e590154968bfbbfc404450b70a&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=579726a957a7468abecab3fbdb4351a9 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:21.358374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f2e93-e2b3-49f0-9305-f9dfe14d0d28 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:21.380028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca926c-c53c-4f66-bedd-85fe5ba9679b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:21.381562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ca926c-c53c-4f66-bedd-85fe5ba9679b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:21.387629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:21.477740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:21.503855 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-316f2e93-e2b3-49f0-9305-f9dfe14d0d28 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:21.517690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 257/526] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:21.519310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca926c-c53c-4f66-bedd-85fe5ba9679b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:21.553567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0b1e3-f7cc-413e-9110-eedb05389e78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:21.554906 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0b1e3-f7cc-413e-9110-eedb05389e78 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:21.555341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0b1e3-f7cc-413e-9110-eedb05389e78 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:21.555741 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b0b1e3-f7cc-413e-9110-eedb05389e78 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:21.556896 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0b1e3-f7cc-413e-9110-eedb05389e78 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:21.557504 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0b1e3-f7cc-413e-9110-eedb05389e78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:21.559706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b0b1e3-f7cc-413e-9110-eedb05389e78 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:21.584221 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 270/527] 10.222.0.40 () {56 vars in 1139 bytes} [Fri Jul 15 19:16:21 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:21.585211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0b1e3-f7cc-413e-9110-eedb05389e78 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:21.647611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ca926c-c53c-4f66-bedd-85fe5ba9679b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:21.687188 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb5405-9416-4103-ad09-7882d096d316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:21.688354 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb5405-9416-4103-ad09-7882d096d316 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:21.688837 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb5405-9416-4103-ad09-7882d096d316 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:21.689282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdb5405-9416-4103-ad09-7882d096d316 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:21.695905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:21.697993 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb5405-9416-4103-ad09-7882d096d316 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:21.699662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdb5405-9416-4103-ad09-7882d096d316 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:21.715574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-bcdb5405-9416-4103-ad09-7882d096d316 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:21.715574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:21.715574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:21.715574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:21.715574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:21.715574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:21.715574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:21.715574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:21.715574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:21.715574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:21.715574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:21.715574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:21.715574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:21.715574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:21.715574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:21.716497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:21.716497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:21.716497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:21.716497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:21.716497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:21.716497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:21.716497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:21.716497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:21.716497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:21.716497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:21.716497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:21.716497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:21.716497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:21.716497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:21.716497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:21.716497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:21.716497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:21.717358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:21.717358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:21.717358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:21.717358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:21.717358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:21.717358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:21.717358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:21.717358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:21.720846 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 258/528] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:21.721866 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb5405-9416-4103-ad09-7882d096d316 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:21.728535 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b0b1e3-f7cc-413e-9110-eedb05389e78 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:21.762466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:21.776703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a67fb-defd-47ec-8955-20105e547c03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:21.777725 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a67fb-defd-47ec-8955-20105e547c03 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:21.778106 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a67fb-defd-47ec-8955-20105e547c03 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:21.778450 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652a67fb-defd-47ec-8955-20105e547c03 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:21.792656 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a67fb-defd-47ec-8955-20105e547c03 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:21.794641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652a67fb-defd-47ec-8955-20105e547c03 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:21.820494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-652a67fb-defd-47ec-8955-20105e547c03 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:21.820494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:21.820494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:21.820494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:21.820494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:21.820494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:21.820494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:21.820494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:21.820494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:21.820494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:21.820494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:21.820494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:21.820494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:21.820494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:21.820494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:21.821425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:21.821425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:21.821425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:21.821425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:21.821425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:21.821425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:21.821425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:21.821425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:21.821425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:21.821425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:21.821425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:21.821425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:21.821425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:21.821425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:21.821425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:21.821425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:21.821425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:21.822293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:21.822293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:21.822293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:21.822293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:21.822293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 271/529] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:21.822601 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a67fb-defd-47ec-8955-20105e547c03 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:21.848283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdb5405-9416-4103-ad09-7882d096d316 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:21.891093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a594a-af6a-4dfd-9114-734cd7a0844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:21.892278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a594a-af6a-4dfd-9114-734cd7a0844b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:21.892761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a594a-af6a-4dfd-9114-734cd7a0844b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:21.893050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a594a-af6a-4dfd-9114-734cd7a0844b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:21.955072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652a67fb-defd-47ec-8955-20105e547c03 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:21.987995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a594a-af6a-4dfd-9114-734cd7a0844b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:21.989774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853a594a-af6a-4dfd-9114-734cd7a0844b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:21.989906 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:21.996953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bc064-f312-4edb-8db9-2e44c60d37a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:21.997726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bc064-f312-4edb-8db9-2e44c60d37a8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:21.998287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bc064-f312-4edb-8db9-2e44c60d37a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:21.998897 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137bc064-f312-4edb-8db9-2e44c60d37a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:22.004971 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bc064-f312-4edb-8db9-2e44c60d37a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:22.004971 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bc064-f312-4edb-8db9-2e44c60d37a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:22.004971 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-137bc064-f312-4edb-8db9-2e44c60d37a8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:22.025527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 272/530] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:22.030880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:22.032768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bc064-f312-4edb-8db9-2e44c60d37a8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:22.123408 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 259/531] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:22.125348 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a594a-af6a-4dfd-9114-734cd7a0844b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:22.160698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137bc064-f312-4edb-8db9-2e44c60d37a8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:22.208112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdab2b-13af-4d25-ac72-d5acdba00137 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:22.208112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdab2b-13af-4d25-ac72-d5acdba00137 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:22.208112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdab2b-13af-4d25-ac72-d5acdba00137 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:22.208112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fdab2b-13af-4d25-ac72-d5acdba00137 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:22.208507 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdab2b-13af-4d25-ac72-d5acdba00137 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:22.208507 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdab2b-13af-4d25-ac72-d5acdba00137 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:22.209502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fdab2b-13af-4d25-ac72-d5acdba00137 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:22.226600 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 273/532] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:22.228298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdab2b-13af-4d25-ac72-d5acdba00137 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:22.250825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a594a-af6a-4dfd-9114-734cd7a0844b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:22.291854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:22.295385 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f094224-ed38-47ab-bc14-d02a36e4d967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:22.297406 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f094224-ed38-47ab-bc14-d02a36e4d967 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:22.297743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f094224-ed38-47ab-bc14-d02a36e4d967 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:22.298032 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f094224-ed38-47ab-bc14-d02a36e4d967 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:22.299197 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f094224-ed38-47ab-bc14-d02a36e4d967 None admin] RBAC: Adding query filter params (role.id=579726a957a7468abecab3fbdb4351a9, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=2352b5c2aa664bf0a7e321ff3a5038fd) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:22.304961 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f094224-ed38-47ab-bc14-d02a36e4d967 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:22.304961 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f094224-ed38-47ab-bc14-d02a36e4d967 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:22.309375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 260/533] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:22 2022] GET /identity/v3/role_assignments?user.id=2352b5c2aa664bf0a7e321ff3a5038fd&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=579726a957a7468abecab3fbdb4351a9 => generated 259 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:22.310272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f094224-ed38-47ab-bc14-d02a36e4d967 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:22.355375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:22.379715 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fdab2b-13af-4d25-ac72-d5acdba00137 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:22.455362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ee6a4-2799-452e-b653-79a45fc55fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:22.456232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ee6a4-2799-452e-b653-79a45fc55fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:22.456522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ee6a4-2799-452e-b653-79a45fc55fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:22.456806 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12ee6a4-2799-452e-b653-79a45fc55fc7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:22.475724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ee6a4-2799-452e-b653-79a45fc55fc7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:22.477125 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12ee6a4-2799-452e-b653-79a45fc55fc7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:22.516253 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f094224-ed38-47ab-bc14-d02a36e4d967 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:22.518432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-b12ee6a4-2799-452e-b653-79a45fc55fc7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:22.518432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:22.518432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:22.518432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:22.518432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:22.518432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:22.518432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:22.518432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:22.518432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:22.518432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:22.518432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:22.518432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:22.518432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:22.518432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:22.518432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:22.521300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:22.521300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:22.521300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:22.521300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:22.521300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:22.521300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:22.521300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:22.521300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:22.521300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:22.521300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:22.521300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:22.521300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:22.521300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:22.521300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:22.521300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:22.521300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:22.521300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:22.524695 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:22.524695 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:22.524695 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:22.524695 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:22.524695 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 274/534] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:22.526726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ee6a4-2799-452e-b653-79a45fc55fc7 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:22.573634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc3169-a877-4d40-83c7-4c0ff46879bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:22.574923 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc3169-a877-4d40-83c7-4c0ff46879bf None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:22.575445 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc3169-a877-4d40-83c7-4c0ff46879bf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:22.575916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82bc3169-a877-4d40-83c7-4c0ff46879bf None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:22.585012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc3169-a877-4d40-83c7-4c0ff46879bf None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:22.587020 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82bc3169-a877-4d40-83c7-4c0ff46879bf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:22.603195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-82bc3169-a877-4d40-83c7-4c0ff46879bf None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:22.603195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:22.603195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:22.603195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:22.603195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:22.603195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:22.603195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:22.603195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:22.603195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:22.603195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:22.603195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:22.603195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:22.603195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:22.603195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:22.603195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:22.604114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:22.604114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:22.604114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:22.604114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:22.604114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:22.604114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:22.604114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:22.604114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:22.604114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:22.604114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:22.604114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:22.604114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:22.604114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:22.604114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:22.604114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:22.604114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:22.604114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:22.605044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:22.605044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:22.605044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:22.605044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:22.605044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:22.605044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:22.605044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:22.605044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:22.605044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 261/535] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:22.611437 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc3169-a877-4d40-83c7-4c0ff46879bf None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:22.676591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:22.715059 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12ee6a4-2799-452e-b653-79a45fc55fc7 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:22.716779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:22.722227 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82bc3169-a877-4d40-83c7-4c0ff46879bf None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:22.767425 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5d09f-2540-4d3b-a181-fe9731b242c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:22.768409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5d09f-2540-4d3b-a181-fe9731b242c3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:22.768879 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5d09f-2540-4d3b-a181-fe9731b242c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:22.769343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a5d09f-2540-4d3b-a181-fe9731b242c3 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:22.770320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5d09f-2540-4d3b-a181-fe9731b242c3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:22.770838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5d09f-2540-4d3b-a181-fe9731b242c3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:22.772487 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a5d09f-2540-4d3b-a181-fe9731b242c3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:22.790849 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 262/536] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:22.793161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5d09f-2540-4d3b-a181-fe9731b242c3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:22.803573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0703b0-9192-4eb7-92e7-f6ac0a2267ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:22.804683 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0703b0-9192-4eb7-92e7-f6ac0a2267ae None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:22.804875 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0703b0-9192-4eb7-92e7-f6ac0a2267ae None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:22.805534 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0703b0-9192-4eb7-92e7-f6ac0a2267ae None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:22.806430 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0703b0-9192-4eb7-92e7-f6ac0a2267ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:22.806830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0703b0-9192-4eb7-92e7-f6ac0a2267ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:22.809306 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0703b0-9192-4eb7-92e7-f6ac0a2267ae None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:22.841317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 275/537] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:22.848224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0703b0-9192-4eb7-92e7-f6ac0a2267ae None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:22.930535 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a5d09f-2540-4d3b-a181-fe9731b242c3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:22.969639 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:23.007262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161c43e-baac-42b4-8a5d-07601ebdb7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:23.007937 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161c43e-baac-42b4-8a5d-07601ebdb7a9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:23.008222 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161c43e-baac-42b4-8a5d-07601ebdb7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:23.008502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b161c43e-baac-42b4-8a5d-07601ebdb7a9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:23.009363 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161c43e-baac-42b4-8a5d-07601ebdb7a9 None admin] RBAC: Adding query filter params (role.id=579726a957a7468abecab3fbdb4351a9, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=4776b70a88a04be7bfe6729e16c16647) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:23.009678 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161c43e-baac-42b4-8a5d-07601ebdb7a9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:23.011254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b161c43e-baac-42b4-8a5d-07601ebdb7a9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:23.023403 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 263/538] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:22 2022] GET /identity/v3/role_assignments?user.id=4776b70a88a04be7bfe6729e16c16647&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=579726a957a7468abecab3fbdb4351a9 => generated 259 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:23.097423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0703b0-9192-4eb7-92e7-f6ac0a2267ae None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:23.181231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b0453-4f8e-4d9e-a364-8f4276a67ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:23.182612 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b0453-4f8e-4d9e-a364-8f4276a67ee3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:23.183128 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b0453-4f8e-4d9e-a364-8f4276a67ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:23.183601 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b0453-4f8e-4d9e-a364-8f4276a67ee3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:23.195660 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b0453-4f8e-4d9e-a364-8f4276a67ee3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:23.197148 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b0453-4f8e-4d9e-a364-8f4276a67ee3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:23.215114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-d28b0453-4f8e-4d9e-a364-8f4276a67ee3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:23.215114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:23.215114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:23.215114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:23.215114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:23.215114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:23.215114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:23.215114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:23.215114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:23.215114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:23.215114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:23.215114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:23.215114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:23.215114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:23.215114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:23.216028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:23.216028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:23.216028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:23.216028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:23.216028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:23.216028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:23.216028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:23.216028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:23.216028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:23.216028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:23.216028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:23.216028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:23.216028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:23.216028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:23.216028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:23.216028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:23.216028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:23.216887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:23.216887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:23.216887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:23.216887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:23.216887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:23.216887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:23.216887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:23.216887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:23.216887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 276/539] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:23.225596 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161c43e-baac-42b4-8a5d-07601ebdb7a9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:23.409439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b161c43e-baac-42b4-8a5d-07601ebdb7a9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:23.470924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e0131f-b540-4e22-a14d-d2cb30a3e77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:23.471605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0131f-b540-4e22-a14d-d2cb30a3e77c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:23.471882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0131f-b540-4e22-a14d-d2cb30a3e77c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:23.472152 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e0131f-b540-4e22-a14d-d2cb30a3e77c None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:23.472950 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0131f-b540-4e22-a14d-d2cb30a3e77c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:23.473254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0131f-b540-4e22-a14d-d2cb30a3e77c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:23.474714 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e0131f-b540-4e22-a14d-d2cb30a3e77c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:23.489200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 264/540] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:23.494869 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b0453-4f8e-4d9e-a364-8f4276a67ee3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:23.544626 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:23.602237 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba14b7a-832b-4f8f-8b76-a3c9da349318 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:23.603231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba14b7a-832b-4f8f-8b76-a3c9da349318 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:23.603708 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba14b7a-832b-4f8f-8b76-a3c9da349318 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:23.605546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 265/541] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:23.612366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28233386-ab9b-4a09-843c-210bb8ee5dec None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:23.612966 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28233386-ab9b-4a09-843c-210bb8ee5dec None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:23.613445 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28233386-ab9b-4a09-843c-210bb8ee5dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:23.643603 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-28233386-ab9b-4a09-843c-210bb8ee5dec None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:23.645003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-28233386-ab9b-4a09-843c-210bb8ee5dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:23.677601 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b0453-4f8e-4d9e-a364-8f4276a67ee3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:23.710698 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:23.726424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8058ee8c-0317-405a-8317-f18b31714f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:23.727122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ee8c-0317-405a-8317-f18b31714f33 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:23.727411 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ee8c-0317-405a-8317-f18b31714f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:23.727689 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8058ee8c-0317-405a-8317-f18b31714f33 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:23.728603 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058ee8c-0317-405a-8317-f18b31714f33 None admin] RBAC: Adding query filter params (role.id=579726a957a7468abecab3fbdb4351a9, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=c99418232a0848a1b7a1a73966928769) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:23.729026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058ee8c-0317-405a-8317-f18b31714f33 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:23.730483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8058ee8c-0317-405a-8317-f18b31714f33 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:23.742894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 277/542] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:23 2022] GET /identity/v3/role_assignments?user.id=c99418232a0848a1b7a1a73966928769&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=579726a957a7468abecab3fbdb4351a9 => generated 259 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:23.744694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b61c8-a02b-47fd-9e31-f03c0639e547 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:23.744861 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 266/543] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:16:23.745063 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b61c8-a02b-47fd-9e31-f03c0639e547 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:23.745347 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014b61c8-a02b-47fd-9e31-f03c0639e547 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:23.752059 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 278/544] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:23.762933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a301644-3de4-4d9c-8fa4-bd2408aba2c0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:23.763436 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a301644-3de4-4d9c-8fa4-bd2408aba2c0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:23.763915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a301644-3de4-4d9c-8fa4-bd2408aba2c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:23.775173 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b61c8-a02b-47fd-9e31-f03c0639e547 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:23.800088 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9a301644-3de4-4d9c-8fa4-bd2408aba2c0 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:23.803594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9a301644-3de4-4d9c-8fa4-bd2408aba2c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:23.938857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 267/545] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:23.953371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:23.959029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a301644-3de4-4d9c-8fa4-bd2408aba2c0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:23.965889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014b61c8-a02b-47fd-9e31-f03c0639e547 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:24.016280 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40604fb0-1576-493c-ba84-cc6477742624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:24.017631 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40604fb0-1576-493c-ba84-cc6477742624 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:24.018060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40604fb0-1576-493c-ba84-cc6477742624 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:24.018481 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40604fb0-1576-493c-ba84-cc6477742624 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:24.038993 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40604fb0-1576-493c-ba84-cc6477742624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:24.052575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-40604fb0-1576-493c-ba84-cc6477742624 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:24.052575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:24.052575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:24.052575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:24.052575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:24.052575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:24.052575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:24.052575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:24.052575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:24.052575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:24.052575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:24.052575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:24.052575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:24.052575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:24.052575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:24.052575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:24.053753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:24.053753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:24.053753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:24.053753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:24.053753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:24.053753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:24.053753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:24.053753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:24.053753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:24.053753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:24.053753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:24.053753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:24.053753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:24.053753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:24.053753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:24.053753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:24.054775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:24.054775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:24.054775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:24.054775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:24.054775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:24.054775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:24.054775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:24.054775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:24.054775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:24.054775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:24.054775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:24.054775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:24.059477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 279/546] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:24.068353 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40604fb0-1576-493c-ba84-cc6477742624 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:24.143083 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a301644-3de4-4d9c-8fa4-bd2408aba2c0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:24.144863 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:24.209324 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ce01c-19bf-4898-8886-def2afe93a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:24.210028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ce01c-19bf-4898-8886-def2afe93a5f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:24.210304 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ce01c-19bf-4898-8886-def2afe93a5f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:24.210573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506ce01c-19bf-4898-8886-def2afe93a5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:24.245064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506ce01c-19bf-4898-8886-def2afe93a5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:24.255522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40604fb0-1576-493c-ba84-cc6477742624 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:24.263309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-506ce01c-19bf-4898-8886-def2afe93a5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:24.263309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:24.263309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:24.263309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:24.263309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:24.263309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:24.263309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:24.263309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:24.263309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:24.263309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:24.263309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:24.263309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:24.263309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:24.263309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:24.263309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:24.263309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:24.264332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:24.264332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:24.264332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:24.264332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:24.264332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:24.264332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:24.264332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:24.264332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:24.264332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:24.264332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:24.264332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:24.264332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:24.264332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:24.264332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:24.264332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:24.264332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:24.265196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:24.265196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:24.265196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:24.265196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:24.265196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:24.265196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:24.265196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:24.265196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:24.265196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:24.265196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:24.265196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:24.265196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:24.267275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 268/547] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:24.272957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ce01c-19bf-4898-8886-def2afe93a5f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:24.320548 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313125d-db40-4f4a-b358-a8bc27c29338 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:24.321230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313125d-db40-4f4a-b358-a8bc27c29338 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:24.321515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313125d-db40-4f4a-b358-a8bc27c29338 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:24.321792 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4313125d-db40-4f4a-b358-a8bc27c29338 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:24.322592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313125d-db40-4f4a-b358-a8bc27c29338 None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:24.323160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313125d-db40-4f4a-b358-a8bc27c29338 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:24.324314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4313125d-db40-4f4a-b358-a8bc27c29338 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:24.349348 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 280/548] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:24.354701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313125d-db40-4f4a-b358-a8bc27c29338 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:24.376847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:24.409600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506ce01c-19bf-4898-8886-def2afe93a5f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:24.446720 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3059ec-c2d7-496b-b69c-8d41646b66dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:24.447786 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3059ec-c2d7-496b-b69c-8d41646b66dc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:24.448259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3059ec-c2d7-496b-b69c-8d41646b66dc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:24.448809 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3059ec-c2d7-496b-b69c-8d41646b66dc None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:24.449897 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3059ec-c2d7-496b-b69c-8d41646b66dc None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:24.450385 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3059ec-c2d7-496b-b69c-8d41646b66dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:24.451995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3059ec-c2d7-496b-b69c-8d41646b66dc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:24.462577 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 269/549] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:24.469579 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3059ec-c2d7-496b-b69c-8d41646b66dc None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:24.498046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:24.584079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3059ec-c2d7-496b-b69c-8d41646b66dc None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:24.584950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4313125d-db40-4f4a-b358-a8bc27c29338 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:24.623107 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a92dc5-4cc6-4bd3-beaf-43dcadab4835 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:24.625006 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd895b28-8da5-4d9e-9d95-92798c09704d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:24.625588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a92dc5-4cc6-4bd3-beaf-43dcadab4835 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:24.625924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd895b28-8da5-4d9e-9d95-92798c09704d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:24.626248 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a92dc5-4cc6-4bd3-beaf-43dcadab4835 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:24.626365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd895b28-8da5-4d9e-9d95-92798c09704d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:24.626640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd895b28-8da5-4d9e-9d95-92798c09704d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:24.627011 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a92dc5-4cc6-4bd3-beaf-43dcadab4835 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:24.638287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd895b28-8da5-4d9e-9d95-92798c09704d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:24.638940 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a92dc5-4cc6-4bd3-beaf-43dcadab4835 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:24.640636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd895b28-8da5-4d9e-9d95-92798c09704d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:24.641845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a92dc5-4cc6-4bd3-beaf-43dcadab4835 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:24.660104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-fd895b28-8da5-4d9e-9d95-92798c09704d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:24.660104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:24.660104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:24.660104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:24.660104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:24.660104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:24.660104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:24.660104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:24.660104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:24.660104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:24.660104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:24.660104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:24.660104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:24.660104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:24.660104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:24.661051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:24.661051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:24.661051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:24.661051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:24.661051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:24.661051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:24.661051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:24.661051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:24.661051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:24.661051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:24.661051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:24.661051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:24.661051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:24.661051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:24.661051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:24.661051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:24.661051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:24.661992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:24.661992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:24.661992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:24.661992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:24.661992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 281/550] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:24.664824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-51a92dc5-4cc6-4bd3-beaf-43dcadab4835 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:24.664824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:24.664824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:24.664824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:24.664824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:24.664824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:24.664824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:24.664824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:24.664824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:24.664824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:24.664824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:24.664824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:24.664824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:24.664824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:24.664824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:24.665697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:24.665697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:24.665697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:24.665697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:24.665697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:24.665697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:24.665697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:24.665697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:24.665697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:24.665697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:24.665697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:24.665697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:24.665697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:24.665697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:24.665697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:24.665697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:24.665697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:24.666566 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:24.666566 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:24.666566 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:24.666566 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:24.666566 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 270/551] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:24.668175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd895b28-8da5-4d9e-9d95-92798c09704d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:24.672550 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a92dc5-4cc6-4bd3-beaf-43dcadab4835 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:24.738143 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:24.759809 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:24.825381 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a92dc5-4cc6-4bd3-beaf-43dcadab4835 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:24.833121 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd895b28-8da5-4d9e-9d95-92798c09704d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:24.871037 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d6e14-7ae3-4ab9-96ad-6db02ac63b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:24.872507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d6e14-7ae3-4ab9-96ad-6db02ac63b44 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:24.873267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d6e14-7ae3-4ab9-96ad-6db02ac63b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:24.874162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9d6e14-7ae3-4ab9-96ad-6db02ac63b44 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:24.875456 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d6e14-7ae3-4ab9-96ad-6db02ac63b44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:24.875998 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d6e14-7ae3-4ab9-96ad-6db02ac63b44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:24.877688 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9d6e14-7ae3-4ab9-96ad-6db02ac63b44 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:24.891179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 271/552] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:24.895546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f7177-7f69-4ab0-974d-e37eb7d1c462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:24.896236 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f7177-7f69-4ab0-974d-e37eb7d1c462 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:24.896517 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f7177-7f69-4ab0-974d-e37eb7d1c462 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:24.896801 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c23f7177-7f69-4ab0-974d-e37eb7d1c462 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:24.897556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f7177-7f69-4ab0-974d-e37eb7d1c462 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:24.897868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f7177-7f69-4ab0-974d-e37eb7d1c462 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:24.898265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d6e14-7ae3-4ab9-96ad-6db02ac63b44 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:24.899317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c23f7177-7f69-4ab0-974d-e37eb7d1c462 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:24.918863 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 282/553] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:24.924646 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f7177-7f69-4ab0-974d-e37eb7d1c462 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:25.013016 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9d6e14-7ae3-4ab9-96ad-6db02ac63b44 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:25.052039 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c23f7177-7f69-4ab0-974d-e37eb7d1c462 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:25.053595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f93bbd-30a8-4463-b1ca-a529a990c574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:25.054720 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f93bbd-30a8-4463-b1ca-a529a990c574 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:25.055227 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f93bbd-30a8-4463-b1ca-a529a990c574 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:25.055765 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f93bbd-30a8-4463-b1ca-a529a990c574 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:25.059091 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:25.068575 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f93bbd-30a8-4463-b1ca-a529a990c574 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:25.074269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f93bbd-30a8-4463-b1ca-a529a990c574 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:25.075141 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:25.091934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-e5f93bbd-30a8-4463-b1ca-a529a990c574 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:16:25.091934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:25.091934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:25.091934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:25.091934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:25.091934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:25.091934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:25.091934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:25.091934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:25.091934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:25.091934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:25.091934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:25.091934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:25.091934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:25.091934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:25.091934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:25.099598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:25.101086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:25.101086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:25.101086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:25.101086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:25.101086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:25.101086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:25.101086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:25.101086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:25.101086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:16:25.101086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:25.101086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 272/554] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:24 2022] GET /identity/v3/users/swift => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:25.101086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb855419-2560-4c8d-91b8-846723dceab7 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:25.101086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb855419-2560-4c8d-91b8-846723dceab7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:25.101896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb855419-2560-4c8d-91b8-846723dceab7 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:25.101896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 273/555] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:25.101896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb855419-2560-4c8d-91b8-846723dceab7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:25.106843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb8de56-72a6-4f59-a3ff-9bb323cdf64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:25.107900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8de56-72a6-4f59-a3ff-9bb323cdf64f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:25.108432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8de56-72a6-4f59-a3ff-9bb323cdf64f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:25.108914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb8de56-72a6-4f59-a3ff-9bb323cdf64f None admin] PATH_INFO: `/v3/users/nova` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:25.120813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8de56-72a6-4f59-a3ff-9bb323cdf64f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:25.123292 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb8de56-72a6-4f59-a3ff-9bb323cdf64f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:25.144483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-4eb8de56-72a6-4f59-a3ff-9bb323cdf64f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:16:25.144483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:25.144483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:25.144483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:25.144483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:25.144483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:25.144483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:25.144483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:25.144483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:25.144483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:25.144483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:25.144483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:25.144483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:25.144483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:25.144483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:25.144483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:25.145496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:25.146941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:25.146941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:25.146941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:25.146941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:25.146941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:25.146941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:25.146941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:25.146941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:25.146941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:16:25.146941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:25.148431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 283/556] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Jul 15 19:16:24 2022] GET /identity/v3/users/nova => generated 82 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:16:25.149665 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c8891-a0e9-4c02-a699-81812dbdae3a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:25.149948 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c8891-a0e9-4c02-a699-81812dbdae3a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:25.150220 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8c8891-a0e9-4c02-a699-81812dbdae3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:25.168984 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-2f8c8891-a0e9-4c02-a699-81812dbdae3a None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:25.170197 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2f8c8891-a0e9-4c02-a699-81812dbdae3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:25.234826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb855419-2560-4c8d-91b8-846723dceab7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:25.248367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 284/557] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:25.250472 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c8891-a0e9-4c02-a699-81812dbdae3a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:25.284852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48c6f3-9cfb-4b20-b9f1-43cef230c009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:25.285839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48c6f3-9cfb-4b20-b9f1-43cef230c009 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:25.286126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48c6f3-9cfb-4b20-b9f1-43cef230c009 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:25.286407 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c48c6f3-9cfb-4b20-b9f1-43cef230c009 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:25.287312 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48c6f3-9cfb-4b20-b9f1-43cef230c009 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:25.287628 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48c6f3-9cfb-4b20-b9f1-43cef230c009 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:25.289745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c48c6f3-9cfb-4b20-b9f1-43cef230c009 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:25.314223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 274/558] 10.222.0.40 () {56 vars in 1135 bytes} [Fri Jul 15 19:16:25 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:25.315545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48c6f3-9cfb-4b20-b9f1-43cef230c009 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:25.387861 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:25.395198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8c8891-a0e9-4c02-a699-81812dbdae3a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:25.411185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:25.444012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb2601-c7ce-4cb6-ba4c-778b2a2182d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:25.445163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb2601-c7ce-4cb6-ba4c-778b2a2182d0 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:25.445457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb2601-c7ce-4cb6-ba4c-778b2a2182d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:25.445733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eb2601-c7ce-4cb6-ba4c-778b2a2182d0 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:25.446866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb2601-c7ce-4cb6-ba4c-778b2a2182d0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:25.447175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb2601-c7ce-4cb6-ba4c-778b2a2182d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:25.448176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c48c6f3-9cfb-4b20-b9f1-43cef230c009 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:25.448591 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40eb2601-c7ce-4cb6-ba4c-778b2a2182d0 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:25.472856 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 285/559] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Jul 15 19:16:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:25.473709 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb2601-c7ce-4cb6-ba4c-778b2a2182d0 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:25.496747 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef5f0a-7f35-4f0d-8fed-f18bf3712310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:25.497707 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef5f0a-7f35-4f0d-8fed-f18bf3712310 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:25.497990 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef5f0a-7f35-4f0d-8fed-f18bf3712310 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:25.498267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ef5f0a-7f35-4f0d-8fed-f18bf3712310 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:25.512391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ef5f0a-7f35-4f0d-8fed-f18bf3712310 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:25.520982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-48ef5f0a-7f35-4f0d-8fed-f18bf3712310 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:25.520982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:25.520982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:25.520982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:25.520982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:25.520982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:25.520982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:25.520982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:25.520982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:25.520982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:25.520982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:25.520982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:25.520982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:25.520982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:25.520982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:25.520982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:25.522097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:25.522097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:25.522097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:25.522097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:25.522097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:25.522097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:25.522097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:25.522097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:25.522097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:25.522097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:25.522097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:25.522097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:25.522097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:25.522097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:25.522097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:25.522097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:25.522970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:25.522970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:25.522970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:25.522970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:25.522970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:25.522970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:25.522970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:25.522970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:25.522970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:25.522970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:25.522970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:25.522970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:25.522970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 275/560] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:25.523665 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef5f0a-7f35-4f0d-8fed-f18bf3712310 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:25.597610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eb2601-c7ce-4cb6-ba4c-778b2a2182d0 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:25.635105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ef5f0a-7f35-4f0d-8fed-f18bf3712310 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:25.637768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb8031-cc09-4e75-85f0-462c642deb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:25.638431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb8031-cc09-4e75-85f0-462c642deb80 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:25.638717 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb8031-cc09-4e75-85f0-462c642deb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:25.639040 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb8031-cc09-4e75-85f0-462c642deb80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:25.650065 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:25.672684 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66cfdfd-b477-4c73-9dfe-b241ffaaa46e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:25.673630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cfdfd-b477-4c73-9dfe-b241ffaaa46e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:25.674015 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cfdfd-b477-4c73-9dfe-b241ffaaa46e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:25.674301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66cfdfd-b477-4c73-9dfe-b241ffaaa46e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:25.678280 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:25.688009 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66cfdfd-b477-4c73-9dfe-b241ffaaa46e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:25.689613 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66cfdfd-b477-4c73-9dfe-b241ffaaa46e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:25.708660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f66cfdfd-b477-4c73-9dfe-b241ffaaa46e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:25.708660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:25.708660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:25.708660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:25.708660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:25.708660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:25.708660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:25.708660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:25.708660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:25.708660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:25.708660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:25.708660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:25.708660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:25.708660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:25.708660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:25.709935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:25.709935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:25.709935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:25.709935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:25.709935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:25.709935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:25.709935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:25.709935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:25.709935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:25.709935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:25.709935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:25.709935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:25.709935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:25.709935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:25.709935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:25.709935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:25.709935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:25.711685 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:25.711685 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:25.711685 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:25.711685 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:25.711685 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 276/561] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:25.711685 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e946d-1e32-4cb4-a766-46cbe284e036 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:25.711685 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e946d-1e32-4cb4-a766-46cbe284e036 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:25.711685 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192e946d-1e32-4cb4-a766-46cbe284e036 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:25.712888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 277/562] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:25.713595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e946d-1e32-4cb4-a766-46cbe284e036 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:25.718179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb8031-cc09-4e75-85f0-462c642deb80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:25.719709 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb8031-cc09-4e75-85f0-462c642deb80 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:25.827758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 286/563] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:25.829059 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb8031-cc09-4e75-85f0-462c642deb80 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:25.841029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192e946d-1e32-4cb4-a766-46cbe284e036 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:25.880392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f64a27ee-b9df-43bd-bb70-d0214eeec801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:25.881124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a27ee-b9df-43bd-bb70-d0214eeec801 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:25.881408 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a27ee-b9df-43bd-bb70-d0214eeec801 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:25.881793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f64a27ee-b9df-43bd-bb70-d0214eeec801 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:25.882445 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a27ee-b9df-43bd-bb70-d0214eeec801 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:25.882793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a27ee-b9df-43bd-bb70-d0214eeec801 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:25.884289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f64a27ee-b9df-43bd-bb70-d0214eeec801 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:25.897614 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 278/564] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:25.897614 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a75e68-0abc-4fcd-9874-d0a6b11f5b24 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:25.897614 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a75e68-0abc-4fcd-9874-d0a6b11f5b24 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:25.897614 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a75e68-0abc-4fcd-9874-d0a6b11f5b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:25.912352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:25.912778 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d8a75e68-0abc-4fcd-9874-d0a6b11f5b24 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:25.913993 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d8a75e68-0abc-4fcd-9874-d0a6b11f5b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:25.942740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:25.948119 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb8031-cc09-4e75-85f0-462c642deb80 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:25.984625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37144c22-0804-40f9-bfa6-680fb29df28e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:25.985293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37144c22-0804-40f9-bfa6-680fb29df28e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:25.985576 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37144c22-0804-40f9-bfa6-680fb29df28e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:25.985858 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37144c22-0804-40f9-bfa6-680fb29df28e None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:25.986582 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37144c22-0804-40f9-bfa6-680fb29df28e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:25.986951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37144c22-0804-40f9-bfa6-680fb29df28e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:25.988330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37144c22-0804-40f9-bfa6-680fb29df28e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:25.996666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 279/565] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:25.997779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a75e68-0abc-4fcd-9874-d0a6b11f5b24 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.010743 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 287/566] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:26.011844 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37144c22-0804-40f9-bfa6-680fb29df28e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.121072 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a75e68-0abc-4fcd-9874-d0a6b11f5b24 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.124819 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37144c22-0804-40f9-bfa6-680fb29df28e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.152604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:26.160265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8f5ab-3566-49ba-a858-5e611c8d9d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.160454 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a895f-f7e4-4721-a636-d01fc34bc1b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.161063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8f5ab-3566-49ba-a858-5e611c8d9d4e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.161187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a895f-f7e4-4721-a636-d01fc34bc1b3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.161356 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8f5ab-3566-49ba-a858-5e611c8d9d4e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.161453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a895f-f7e4-4721-a636-d01fc34bc1b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.161617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc8f5ab-3566-49ba-a858-5e611c8d9d4e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.161715 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762a895f-f7e4-4721-a636-d01fc34bc1b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.173527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8f5ab-3566-49ba-a858-5e611c8d9d4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:26.173737 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a895f-f7e4-4721-a636-d01fc34bc1b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:26.175625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-762a895f-f7e4-4721-a636-d01fc34bc1b3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:26.175754 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc8f5ab-3566-49ba-a858-5e611c8d9d4e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:26.194227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-762a895f-f7e4-4721-a636-d01fc34bc1b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:26.194227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:26.194227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:26.194227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:26.194227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:26.194227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:26.194227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:26.194227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:26.194227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:26.194227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:26.194227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:26.194227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:26.194227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:26.194227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:26.194227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:26.195418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:26.195418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:26.195418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:26.195418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:26.195418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:26.195418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:26.195418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:26.195418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:26.195418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:26.195418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:26.195418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:26.195418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:26.195418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:26.195418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:26.195418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:26.195418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:26.195418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:26.196343 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:26.196343 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:26.196343 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:26.196343 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:26.196343 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 288/567] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:26.196629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a895f-f7e4-4721-a636-d01fc34bc1b3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.197502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-dfc8f5ab-3566-49ba-a858-5e611c8d9d4e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:26.197502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:26.197502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:26.197502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:26.197502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:26.197502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:26.197502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:26.197502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:26.197502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:26.197502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:26.197502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:26.197502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:26.197502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:26.197502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:26.197502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:26.198531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:26.198531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:26.198531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:26.198531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:26.198531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:26.198531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:26.198531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:26.198531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:26.198531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:26.198531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:26.198531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:26.198531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:26.198531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:26.198531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:26.198531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:26.198531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:26.198531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:26.199486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:26.199486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:26.199486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:26.199486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:26.203187 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 280/568] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:26.207833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8f5ab-3566-49ba-a858-5e611c8d9d4e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.220522 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:26.299108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-762a895f-f7e4-4721-a636-d01fc34bc1b3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.308838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc8f5ab-3566-49ba-a858-5e611c8d9d4e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.333602 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7adf9-83f0-4db3-a2fb-dc09b25029dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.334383 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7adf9-83f0-4db3-a2fb-dc09b25029dd None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.334663 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7adf9-83f0-4db3-a2fb-dc09b25029dd None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.334966 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e7adf9-83f0-4db3-a2fb-dc09b25029dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.342174 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7adf9-83f0-4db3-a2fb-dc09b25029dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:26.343463 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b513bbb-6efb-4d64-ab08-a62dc02771b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.343640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e7adf9-83f0-4db3-a2fb-dc09b25029dd None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:26.344245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b513bbb-6efb-4d64-ab08-a62dc02771b9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.344519 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b513bbb-6efb-4d64-ab08-a62dc02771b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.344787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b513bbb-6efb-4d64-ab08-a62dc02771b9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.354810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b513bbb-6efb-4d64-ab08-a62dc02771b9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:26.357779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-d6e7adf9-83f0-4db3-a2fb-dc09b25029dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:26.357779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:26.357779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:26.357779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:26.357779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:26.357779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:26.357779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:26.357779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:26.357779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:26.357779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:26.357779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:26.357779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:26.357779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:26.357779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:26.357779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:26.359624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:26.359624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:26.359624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:26.359624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:26.359624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:26.359624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:26.359624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:26.359624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:26.359624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:26.359624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:26.359624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:26.359624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:26.359624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:26.359624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:26.359624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:26.359624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:26.359624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:26.365598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:26.365598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:26.365598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:26.365598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:26.365598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:26.365598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:26.365598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:26.365598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:26.365598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 289/569] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:26.365598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7adf9-83f0-4db3-a2fb-dc09b25029dd None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.366279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-9b513bbb-6efb-4d64-ab08-a62dc02771b9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:26.366279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:26.366279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:26.366279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:26.366279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:26.366279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:26.366279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:26.366279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:26.366279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:26.366279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:26.366279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:26.366279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:26.366279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:26.366279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:26.366279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:26.366279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:26.367372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:26.367372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:26.367372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:26.367372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:26.367372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:26.367372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:26.367372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:26.367372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:26.367372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:26.367372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:26.367372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:26.367372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:26.367372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:26.367372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:26.367372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:26.367372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:26.368483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:26.368483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:26.368483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:26.368483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:26.368483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:26.368483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:26.368483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:26.368483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:26.368483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:26.368483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:26.368483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:26.368483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:26.368483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 281/570] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:26.368483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b513bbb-6efb-4d64-ab08-a62dc02771b9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.405320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:26.441026 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:26.464689 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e7adf9-83f0-4db3-a2fb-dc09b25029dd None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.475244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b513bbb-6efb-4d64-ab08-a62dc02771b9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.499372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ac56bc-746b-45bc-b194-a1dd21a68568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.500034 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac56bc-746b-45bc-b194-a1dd21a68568 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.500319 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac56bc-746b-45bc-b194-a1dd21a68568 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.500597 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ac56bc-746b-45bc-b194-a1dd21a68568 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.501334 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac56bc-746b-45bc-b194-a1dd21a68568 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:26.501637 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac56bc-746b-45bc-b194-a1dd21a68568 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:26.503028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ac56bc-746b-45bc-b194-a1dd21a68568 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:26.508903 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ccb13-1a7e-45b9-882f-18a0d6fff1ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.509555 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ccb13-1a7e-45b9-882f-18a0d6fff1ee None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.509837 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ccb13-1a7e-45b9-882f-18a0d6fff1ee None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.510111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0ccb13-1a7e-45b9-882f-18a0d6fff1ee None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.510859 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ccb13-1a7e-45b9-882f-18a0d6fff1ee None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:26.511167 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ccb13-1a7e-45b9-882f-18a0d6fff1ee None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:26.512535 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0ccb13-1a7e-45b9-882f-18a0d6fff1ee None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:26.515800 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 290/571] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:26.517336 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5dac5-8720-4299-94cb-b27205c37d84 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.517628 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5dac5-8720-4299-94cb-b27205c37d84 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.517906 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d5dac5-8720-4299-94cb-b27205c37d84 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.523051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 291/572] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:26 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:26.524190 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5dac5-8720-4299-94cb-b27205c37d84 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.531405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 282/573] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:26.531405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ccb13-1a7e-45b9-882f-18a0d6fff1ee None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.624700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:26.627582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0ccb13-1a7e-45b9-882f-18a0d6fff1ee None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.628384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d5dac5-8720-4299-94cb-b27205c37d84 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.658291 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:26.663528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d38ec2d-746f-488e-8af4-7365f8b74b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.664183 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38ec2d-746f-488e-8af4-7365f8b74b33 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.664300 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44933bb-0ef9-47ee-ab60-d5cb45f3a612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.670018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38ec2d-746f-488e-8af4-7365f8b74b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.670018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d38ec2d-746f-488e-8af4-7365f8b74b33 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.670289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44933bb-0ef9-47ee-ab60-d5cb45f3a612 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.670289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44933bb-0ef9-47ee-ab60-d5cb45f3a612 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.670289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44933bb-0ef9-47ee-ab60-d5cb45f3a612 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.670536 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38ec2d-746f-488e-8af4-7365f8b74b33 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:26.670536 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38ec2d-746f-488e-8af4-7365f8b74b33 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:26.670698 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44933bb-0ef9-47ee-ab60-d5cb45f3a612 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:26.670698 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44933bb-0ef9-47ee-ab60-d5cb45f3a612 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:26.670908 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d38ec2d-746f-488e-8af4-7365f8b74b33 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:26.671000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44933bb-0ef9-47ee-ab60-d5cb45f3a612 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:26.676405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 283/574] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:26.677311 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44933bb-0ef9-47ee-ab60-d5cb45f3a612 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.683821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 292/575] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:26.685080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e4ea0-d5b6-43b0-bd54-2543a8cd486c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.685370 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e4ea0-d5b6-43b0-bd54-2543a8cd486c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.685640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97e4ea0-d5b6-43b0-bd54-2543a8cd486c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.701786 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f97e4ea0-d5b6-43b0-bd54-2543a8cd486c None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:26.703580 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f97e4ea0-d5b6-43b0-bd54-2543a8cd486c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:26.828645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44933bb-0ef9-47ee-ab60-d5cb45f3a612 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.830390 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 293/576] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:26.831486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e4ea0-d5b6-43b0-bd54-2543a8cd486c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.863296 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394ea4e-bc1b-4484-afcc-6fb0d74dfe90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.864080 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394ea4e-bc1b-4484-afcc-6fb0d74dfe90 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.864361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394ea4e-bc1b-4484-afcc-6fb0d74dfe90 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.864637 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2394ea4e-bc1b-4484-afcc-6fb0d74dfe90 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.872091 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394ea4e-bc1b-4484-afcc-6fb0d74dfe90 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:26.873533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2394ea4e-bc1b-4484-afcc-6fb0d74dfe90 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:26.888003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-2394ea4e-bc1b-4484-afcc-6fb0d74dfe90 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 19:16:26.888003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:26.888003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:26.888003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:26.888003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:26.888003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:26.888003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:26.888003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:26.888003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:26.888003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:26.888003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:26.888003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:26.888003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:26.888003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:26.888003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:26.888003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:26.889006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:26.890608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:26.890608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:26.890608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:26.890608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:26.890608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:26.890608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:26.890608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:26.890608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:26.890608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 19:16:26.890608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:26.890608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 284/577] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:26.891257 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394ea4e-bc1b-4484-afcc-6fb0d74dfe90 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:26.926254 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:26.935455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97e4ea0-d5b6-43b0-bd54-2543a8cd486c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.943048 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:26.970622 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3540e1-384e-4ec8-8445-8ef47795b8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:26.971460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3540e1-384e-4ec8-8445-8ef47795b8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:26.971738 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3540e1-384e-4ec8-8445-8ef47795b8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:26.972007 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc3540e1-384e-4ec8-8445-8ef47795b8c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:26.979538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3540e1-384e-4ec8-8445-8ef47795b8c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:26.980989 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc3540e1-384e-4ec8-8445-8ef47795b8c9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:26.992283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2394ea4e-bc1b-4484-afcc-6fb0d74dfe90 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:26.994914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-bc3540e1-384e-4ec8-8445-8ef47795b8c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:26.994914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:26.994914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:26.994914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:26.994914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:26.994914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:26.994914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:26.994914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:26.994914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:26.994914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:26.994914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:26.994914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:26.994914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:26.994914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:26.994914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:26.995881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:26.995881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:26.995881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:26.995881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:26.995881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:26.995881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:26.995881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:26.995881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:26.995881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:26.995881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:26.995881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:26.995881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:26.995881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:26.995881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:26.995881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:26.995881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:26.995881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:26.996782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:26.996782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:26.996782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:26.996782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:26.996782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:26.996782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:26.996782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:26.996782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:26.996782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 294/578] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:26.997806 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3540e1-384e-4ec8-8445-8ef47795b8c9 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:27.029126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbbfab-fe3a-456b-9105-09061ece2f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:27.029910 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbbfab-fe3a-456b-9105-09061ece2f0d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:27.030740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbbfab-fe3a-456b-9105-09061ece2f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:27.031041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebbbfab-fe3a-456b-9105-09061ece2f0d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:27.042146 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbbfab-fe3a-456b-9105-09061ece2f0d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:27.043638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebbbfab-fe3a-456b-9105-09061ece2f0d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:27.060977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8ebbbfab-fe3a-456b-9105-09061ece2f0d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:27.060977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:27.060977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:27.060977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:27.060977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:27.060977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:27.060977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:27.060977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:27.060977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:27.060977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:27.060977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:27.060977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:27.060977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:27.060977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:27.060977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:27.062673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:27.062673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:27.062673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:27.062673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:27.062673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:27.062673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:27.062673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:27.062673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:27.062673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:27.062673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:27.062673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:27.062673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:27.062673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:27.062673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:27.062673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:27.062673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:27.062673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:27.063638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:27.063638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:27.063638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:27.063638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:27.063638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 285/579] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:27.063638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbbfab-fe3a-456b-9105-09061ece2f0d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:27.105035 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc3540e1-384e-4ec8-8445-8ef47795b8c9 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:27.137985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033b6f3-ba22-4b56-b4a2-fc3ec024e9cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:27.138899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033b6f3-ba22-4b56-b4a2-fc3ec024e9cf None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:27.139176 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033b6f3-ba22-4b56-b4a2-fc3ec024e9cf None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:27.140025 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9033b6f3-ba22-4b56-b4a2-fc3ec024e9cf None admin] PATH_INFO: `/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/850a32e590154968bfbbfc404450b70a/roles/579726a957a7468abecab3fbdb4351a9` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:27.155984 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033b6f3-ba22-4b56-b4a2-fc3ec024e9cf None admin] RBAC: Authorizing `identity:create_grant(project_id=861de78bbfe84bd991c3ab54e85573a7, user_id=850a32e590154968bfbbfc404450b70a, role_id=579726a957a7468abecab3fbdb4351a9)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:27.157418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9033b6f3-ba22-4b56-b4a2-fc3ec024e9cf None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:27.164666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebbbfab-fe3a-456b-9105-09061ece2f0d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:27.167021 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:27.197022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702e76-0f39-42bf-adb6-14eb19fa7d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:27.197834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702e76-0f39-42bf-adb6-14eb19fa7d7b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:27.198112 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702e76-0f39-42bf-adb6-14eb19fa7d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:27.198379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c702e76-0f39-42bf-adb6-14eb19fa7d7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:27.208922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c702e76-0f39-42bf-adb6-14eb19fa7d7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:27.216533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-0c702e76-0f39-42bf-adb6-14eb19fa7d7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:27.216533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:27.216533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:27.216533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:27.216533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:27.216533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:27.216533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:27.216533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:27.216533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:27.216533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:27.216533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:27.216533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:27.216533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:27.216533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:27.216533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:27.216533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:27.220484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:27.220484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:27.220484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:27.220484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:27.220484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:27.220484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:27.220484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:27.220484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:27.220484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:27.220484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:27.220484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:27.220484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:27.220484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:27.220484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:27.220484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:27.220484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:27.221497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:27.221497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:27.221497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:27.221497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:27.221497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:27.221497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:27.221497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:27.221497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:27.221497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:27.221497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:27.221497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:27.221497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:27.221497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 286/580] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:27 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:27.221497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702e76-0f39-42bf-adb6-14eb19fa7d7b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:27.245671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:27.250236 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 295/581] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:16:26 2022] PUT /identity/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/850a32e590154968bfbbfc404450b70a/roles/579726a957a7468abecab3fbdb4351a9 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:27.251237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033b6f3-ba22-4b56-b4a2-fc3ec024e9cf None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:27.330419 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c702e76-0f39-42bf-adb6-14eb19fa7d7b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:27.367444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459ab20-d8fe-4fdd-afc9-5a8f452b8518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:27.368128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459ab20-d8fe-4fdd-afc9-5a8f452b8518 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:27.368412 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459ab20-d8fe-4fdd-afc9-5a8f452b8518 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:27.368688 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9459ab20-d8fe-4fdd-afc9-5a8f452b8518 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:27.369730 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459ab20-d8fe-4fdd-afc9-5a8f452b8518 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:27.370042 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459ab20-d8fe-4fdd-afc9-5a8f452b8518 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:27.371244 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9033b6f3-ba22-4b56-b4a2-fc3ec024e9cf None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:27.371562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9459ab20-d8fe-4fdd-afc9-5a8f452b8518 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:27.393225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 287/582] 10.222.0.40 () {56 vars in 1137 bytes} [Fri Jul 15 19:16:27 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:27.394114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459ab20-d8fe-4fdd-afc9-5a8f452b8518 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:27.416821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50575c43-34e0-4d9e-a6a8-3d9637ea24cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:27.417502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50575c43-34e0-4d9e-a6a8-3d9637ea24cc None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:27.417787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50575c43-34e0-4d9e-a6a8-3d9637ea24cc None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:27.418068 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50575c43-34e0-4d9e-a6a8-3d9637ea24cc None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:27.418968 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50575c43-34e0-4d9e-a6a8-3d9637ea24cc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:27.419285 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50575c43-34e0-4d9e-a6a8-3d9637ea24cc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:27.420802 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50575c43-34e0-4d9e-a6a8-3d9637ea24cc None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:27.422250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:27.433147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 296/583] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:27.434460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50575c43-34e0-4d9e-a6a8-3d9637ea24cc None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:27.500105 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:27.510116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9459ab20-d8fe-4fdd-afc9-5a8f452b8518 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:27.543254 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50575c43-34e0-4d9e-a6a8-3d9637ea24cc None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:27.548844 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc55ec6-7927-45b6-9fa7-2cde688c8baa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:27.549505 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55ec6-7927-45b6-9fa7-2cde688c8baa None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:27.549786 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55ec6-7927-45b6-9fa7-2cde688c8baa None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:27.550062 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc55ec6-7927-45b6-9fa7-2cde688c8baa None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:27.550811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc55ec6-7927-45b6-9fa7-2cde688c8baa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:27.551122 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc55ec6-7927-45b6-9fa7-2cde688c8baa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:27.552807 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc55ec6-7927-45b6-9fa7-2cde688c8baa None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:27.564938 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 288/584] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:27.565777 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc55ec6-7927-45b6-9fa7-2cde688c8baa None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:27.585272 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfdcdb-06c4-468a-b40c-44b4885148f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:27.585951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfdcdb-06c4-468a-b40c-44b4885148f7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:27.586238 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfdcdb-06c4-468a-b40c-44b4885148f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:27.586512 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dfdcdb-06c4-468a-b40c-44b4885148f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:27.587310 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfdcdb-06c4-468a-b40c-44b4885148f7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:27.587623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfdcdb-06c4-468a-b40c-44b4885148f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:27.588979 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dfdcdb-06c4-468a-b40c-44b4885148f7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:27.602147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 297/585] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:27.602147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfdcdb-06c4-468a-b40c-44b4885148f7 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:27.660143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:27.679740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc55ec6-7927-45b6-9fa7-2cde688c8baa None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:27.712747 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dfdcdb-06c4-468a-b40c-44b4885148f7 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:27.719554 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7054ff-20b5-4411-91e3-b8a08a922466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:27.720347 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7054ff-20b5-4411-91e3-b8a08a922466 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:27.720636 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7054ff-20b5-4411-91e3-b8a08a922466 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:27.720906 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc7054ff-20b5-4411-91e3-b8a08a922466 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:27.732374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7054ff-20b5-4411-91e3-b8a08a922466 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:27.734768 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc7054ff-20b5-4411-91e3-b8a08a922466 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:27.738520 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:27.758876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d40c1-e2b6-48f8-a905-9471e117f291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:27.758876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d40c1-e2b6-48f8-a905-9471e117f291 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:27.758876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d40c1-e2b6-48f8-a905-9471e117f291 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:27.758876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0d40c1-e2b6-48f8-a905-9471e117f291 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:27.759345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-cc7054ff-20b5-4411-91e3-b8a08a922466 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:27.759345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:27.759345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:27.759345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:27.759345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:27.759345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:27.759345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:27.759345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:27.759345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:27.759345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:27.759345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:27.759345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:27.759345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:27.759345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:27.759345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:27.760143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:27.760143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:27.760143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:27.760143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:27.760143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:27.760143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:27.760143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:27.760143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:27.760143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:27.760143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:27.760143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:27.760143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:27.760143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:27.760143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:27.760143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:27.760143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:27.760143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:27.761053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:27.761053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:27.761053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:27.761053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:27.761275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d40c1-e2b6-48f8-a905-9471e117f291 None admin] RBAC: Adding query filter params (role.id=579726a957a7468abecab3fbdb4351a9, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=0402e1bd20b042cdbdcb890616b22726) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:27.761275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d40c1-e2b6-48f8-a905-9471e117f291 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:27.761410 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 289/586] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:27.761479 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0d40c1-e2b6-48f8-a905-9471e117f291 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:27.761556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7054ff-20b5-4411-91e3-b8a08a922466 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:27.765394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 298/587] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:27 2022] GET /identity/v3/role_assignments?user.id=0402e1bd20b042cdbdcb890616b22726&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=579726a957a7468abecab3fbdb4351a9 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:27.766706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d40c1-e2b6-48f8-a905-9471e117f291 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:27.896406 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc7054ff-20b5-4411-91e3-b8a08a922466 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:27.929204 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0d40c1-e2b6-48f8-a905-9471e117f291 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:27.950070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbca61-2d0b-4840-bf2d-66b862d0b770 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:27.951579 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbca61-2d0b-4840-bf2d-66b862d0b770 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:27.952345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbca61-2d0b-4840-bf2d-66b862d0b770 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:27.952688 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cbca61-2d0b-4840-bf2d-66b862d0b770 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:27.964444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbca61-2d0b-4840-bf2d-66b862d0b770 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:27.965900 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cbca61-2d0b-4840-bf2d-66b862d0b770 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:27.967058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:27.980145 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e67666-6286-4492-a27d-697d4ec600b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:27.981888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e67666-6286-4492-a27d-697d4ec600b6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:27.981888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e67666-6286-4492-a27d-697d4ec600b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:27.981888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e67666-6286-4492-a27d-697d4ec600b6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:27.985874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-08cbca61-2d0b-4840-bf2d-66b862d0b770 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 19:16:27.985874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:27.985874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:27.985874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:27.985874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:27.985874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:27.985874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:27.985874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:27.985874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:27.985874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:27.985874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:27.985874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:27.985874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:27.985874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:27.985874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:27.985874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:27.986975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:27.987933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:27.987933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:27.987933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:27.987933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:27.987933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:27.987933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:27.987933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:27.987933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:27.987933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 19:16:27.987933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:27.987933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 290/588] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:27 2022] GET /identity/v3/users/cinder => generated 84 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:27.988535 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbca61-2d0b-4840-bf2d-66b862d0b770 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:27.997830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e67666-6286-4492-a27d-697d4ec600b6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:28.000994 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e67666-6286-4492-a27d-697d4ec600b6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:28.026515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-f3e67666-6286-4492-a27d-697d4ec600b6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:28.026515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:28.026515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:28.026515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:28.026515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:28.026515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:28.026515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:28.026515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:28.026515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:28.026515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:28.026515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:28.026515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:28.026515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:28.026515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:28.026515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:28.028152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:28.028152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:28.028152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:28.028152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:28.028152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:28.028152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:28.028152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:28.028152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:28.028152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:28.028152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:28.028152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:28.028152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:28.028152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:28.028152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:28.028152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:28.028152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:28.028152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:28.029978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:28.029978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:28.029978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:28.029978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:28.029978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 299/589] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:28.029978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e67666-6286-4492-a27d-697d4ec600b6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:28.093679 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:28.110615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cbca61-2d0b-4840-bf2d-66b862d0b770 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:28.149824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7b973-8952-49ce-89ce-99b84b1508d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:28.150493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b973-8952-49ce-89ce-99b84b1508d7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:28.150806 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b973-8952-49ce-89ce-99b84b1508d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:28.151089 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e7b973-8952-49ce-89ce-99b84b1508d7 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:28.151821 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7b973-8952-49ce-89ce-99b84b1508d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:28.152130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7b973-8952-49ce-89ce-99b84b1508d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:28.153610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e7b973-8952-49ce-89ce-99b84b1508d7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:28.172243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 291/590] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:28.172243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7b973-8952-49ce-89ce-99b84b1508d7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:28.186891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e67666-6286-4492-a27d-697d4ec600b6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:28.234391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:28.239797 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2242bfe-bd81-4281-b5e8-cec02b1062ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:28.240914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2242bfe-bd81-4281-b5e8-cec02b1062ee None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:28.241706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2242bfe-bd81-4281-b5e8-cec02b1062ee None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:28.242554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2242bfe-bd81-4281-b5e8-cec02b1062ee None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:28.243703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2242bfe-bd81-4281-b5e8-cec02b1062ee None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:28.244253 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2242bfe-bd81-4281-b5e8-cec02b1062ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:28.246663 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2242bfe-bd81-4281-b5e8-cec02b1062ee None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:28.275424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 300/591] 10.222.0.40 () {56 vars in 1137 bytes} [Fri Jul 15 19:16:28 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:28.277033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2242bfe-bd81-4281-b5e8-cec02b1062ee None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:28.288621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e7b973-8952-49ce-89ce-99b84b1508d7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:28.326420 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a077e1-26da-4ef0-a0cb-2adfee069508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:28.327281 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a077e1-26da-4ef0-a0cb-2adfee069508 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:28.327565 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a077e1-26da-4ef0-a0cb-2adfee069508 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:28.327880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a077e1-26da-4ef0-a0cb-2adfee069508 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:28.328643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a077e1-26da-4ef0-a0cb-2adfee069508 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:28.328956 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a077e1-26da-4ef0-a0cb-2adfee069508 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:28.330344 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a077e1-26da-4ef0-a0cb-2adfee069508 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:28.347926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 292/592] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:28.347926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a077e1-26da-4ef0-a0cb-2adfee069508 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:28.410723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2242bfe-bd81-4281-b5e8-cec02b1062ee None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:28.427000 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:28.451528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5049b2-7327-42c0-8044-85bb91400a65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:28.453268 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5049b2-7327-42c0-8044-85bb91400a65 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:28.453623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5049b2-7327-42c0-8044-85bb91400a65 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:28.453977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5049b2-7327-42c0-8044-85bb91400a65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:28.461616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5049b2-7327-42c0-8044-85bb91400a65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:28.463652 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5049b2-7327-42c0-8044-85bb91400a65 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:28.470518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a077e1-26da-4ef0-a0cb-2adfee069508 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:28.478546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-af5049b2-7327-42c0-8044-85bb91400a65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:28.478546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:28.478546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:28.478546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:28.478546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:28.478546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:28.478546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:28.478546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:28.478546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:28.478546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:28.478546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:28.478546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:28.478546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:28.478546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:28.478546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:28.479503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:28.479503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:28.479503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:28.479503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:28.479503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:28.479503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:28.479503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:28.479503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:28.479503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:28.479503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:28.479503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:28.479503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:28.479503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:28.479503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:28.479503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:28.479503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:28.479503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:28.480439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:28.480439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:28.480439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:28.480439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:28.480439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:28.480439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:28.480439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:28.480439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:28.485279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 301/593] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:28.486385 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5049b2-7327-42c0-8044-85bb91400a65 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:28.490363 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:28.522375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7602ec-7190-42fb-85dc-7192895fff81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:28.523296 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7602ec-7190-42fb-85dc-7192895fff81 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:28.523645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7602ec-7190-42fb-85dc-7192895fff81 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:28.523990 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7602ec-7190-42fb-85dc-7192895fff81 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:28.537790 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7602ec-7190-42fb-85dc-7192895fff81 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:28.539898 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7602ec-7190-42fb-85dc-7192895fff81 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:28.560766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ec7602ec-7190-42fb-85dc-7192895fff81 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:28.560766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:28.560766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:28.560766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:28.560766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:28.560766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:28.560766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:28.560766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:28.560766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:28.560766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:28.560766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:28.560766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:28.560766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:28.560766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:28.560766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:28.562267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:28.562267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:28.562267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:28.562267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:28.562267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:28.562267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:28.562267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:28.562267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:28.562267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:28.562267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:28.562267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:28.562267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:28.562267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:28.562267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:28.562267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:28.562267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:28.562267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:28.563378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:28.563378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:28.563378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:28.563378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:28.569982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 293/594] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:28.571181 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7602ec-7190-42fb-85dc-7192895fff81 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:28.610605 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5049b2-7327-42c0-8044-85bb91400a65 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:28.648260 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa5ae7-498b-44dc-a1d1-c1e8a501ad44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:28.649160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa5ae7-498b-44dc-a1d1-c1e8a501ad44 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:28.649543 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa5ae7-498b-44dc-a1d1-c1e8a501ad44 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:28.650138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5faa5ae7-498b-44dc-a1d1-c1e8a501ad44 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:28.658314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa5ae7-498b-44dc-a1d1-c1e8a501ad44 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:28.660025 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5faa5ae7-498b-44dc-a1d1-c1e8a501ad44 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:28.676081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-5faa5ae7-498b-44dc-a1d1-c1e8a501ad44 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 19:16:28.676081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:28.676081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:28.676081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:28.676081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:28.676081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:28.676081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:28.676081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:28.676081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:28.676081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:28.676081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:28.676081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:28.676081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:28.676081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:28.676081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:28.676081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:28.677066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:28.678014 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:28.678014 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:28.678014 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:28.678014 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:28.678014 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:28.678014 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:28.678014 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:28.678014 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:28.678014 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 19:16:28.678014 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:28.682196 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 302/595] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:28.683150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa5ae7-498b-44dc-a1d1-c1e8a501ad44 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:28.687698 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7602ec-7190-42fb-85dc-7192895fff81 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:28.704904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:28.728160 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010f47d-a0db-4b8d-8684-c18e2670c23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:28.729176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f47d-a0db-4b8d-8684-c18e2670c23e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:28.730002 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f47d-a0db-4b8d-8684-c18e2670c23e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:28.730002 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d010f47d-a0db-4b8d-8684-c18e2670c23e None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:28.731054 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010f47d-a0db-4b8d-8684-c18e2670c23e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:28.731552 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010f47d-a0db-4b8d-8684-c18e2670c23e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:28.733221 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d010f47d-a0db-4b8d-8684-c18e2670c23e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:28.747174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 294/596] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:28.748378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010f47d-a0db-4b8d-8684-c18e2670c23e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:28.782695 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:28.808760 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5faa5ae7-498b-44dc-a1d1-c1e8a501ad44 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:28.847969 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08684890-39d4-40a3-b96f-62ac4dc809ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:28.848881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08684890-39d4-40a3-b96f-62ac4dc809ea None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:28.849241 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08684890-39d4-40a3-b96f-62ac4dc809ea None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:28.849588 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08684890-39d4-40a3-b96f-62ac4dc809ea None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:28.850398 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08684890-39d4-40a3-b96f-62ac4dc809ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:28.850839 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08684890-39d4-40a3-b96f-62ac4dc809ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:28.852620 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08684890-39d4-40a3-b96f-62ac4dc809ea None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:28.862417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d010f47d-a0db-4b8d-8684-c18e2670c23e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:28.870814 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 303/597] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:28.870814 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08684890-39d4-40a3-b96f-62ac4dc809ea None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:28.905249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09160950-7f62-41c4-b55c-201c461ef10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:28.906422 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09160950-7f62-41c4-b55c-201c461ef10b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:28.906940 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09160950-7f62-41c4-b55c-201c461ef10b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:28.907488 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09160950-7f62-41c4-b55c-201c461ef10b None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:28.908554 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09160950-7f62-41c4-b55c-201c461ef10b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:28.909114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09160950-7f62-41c4-b55c-201c461ef10b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:28.910867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09160950-7f62-41c4-b55c-201c461ef10b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:28.935757 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 295/598] 10.222.0.40 () {56 vars in 1139 bytes} [Fri Jul 15 19:16:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:28.937582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09160950-7f62-41c4-b55c-201c461ef10b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:28.959163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:28.982829 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08684890-39d4-40a3-b96f-62ac4dc809ea None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:29.021514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5df76b-7730-4441-85bf-b78095ecdd82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:29.022391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5df76b-7730-4441-85bf-b78095ecdd82 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.022674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5df76b-7730-4441-85bf-b78095ecdd82 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.023068 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5df76b-7730-4441-85bf-b78095ecdd82 None admin] PATH_INFO: `/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/2352b5c2aa664bf0a7e321ff3a5038fd/roles/579726a957a7468abecab3fbdb4351a9` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.028574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:29.041141 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5df76b-7730-4441-85bf-b78095ecdd82 None admin] RBAC: Authorizing `identity:create_grant(project_id=861de78bbfe84bd991c3ab54e85573a7, user_id=2352b5c2aa664bf0a7e321ff3a5038fd, role_id=579726a957a7468abecab3fbdb4351a9)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:29.042639 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f5df76b-7730-4441-85bf-b78095ecdd82 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:29.046917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09160950-7f62-41c4-b55c-201c461ef10b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:29.090844 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 304/599] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:16:28 2022] PUT /identity/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/2352b5c2aa664bf0a7e321ff3a5038fd/roles/579726a957a7468abecab3fbdb4351a9 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:29.091958 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5df76b-7730-4441-85bf-b78095ecdd82 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:29.116090 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e7239-e28c-4be7-bf56-144438e00e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:29.117264 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e7239-e28c-4be7-bf56-144438e00e4d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.117878 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e7239-e28c-4be7-bf56-144438e00e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.118349 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e7239-e28c-4be7-bf56-144438e00e4d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.136287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e7239-e28c-4be7-bf56-144438e00e4d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:29.139942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e7239-e28c-4be7-bf56-144438e00e4d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:29.166717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-0a6e7239-e28c-4be7-bf56-144438e00e4d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:29.166717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:29.166717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:29.166717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:29.166717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:29.166717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:29.166717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:29.166717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:29.166717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:29.166717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:29.166717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:29.166717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:29.166717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:29.166717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:29.166717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:29.167717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:29.167717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:29.167717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:29.167717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:29.167717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:29.167717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:29.167717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:29.167717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:29.167717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:29.167717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:29.167717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:29.167717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:29.167717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:29.167717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:29.167717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:29.167717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:29.167717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:29.168615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:29.168615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:29.168615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:29.168615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:29.168615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:29.168615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:29.168615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:29.168615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:29.176040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 296/600] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:29.182284 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e7239-e28c-4be7-bf56-144438e00e4d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:29.304183 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5df76b-7730-4441-85bf-b78095ecdd82 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:29.333528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:29.344378 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b07858a-3290-46d0-ab88-dbf9e1b4c072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:29.348320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07858a-3290-46d0-ab88-dbf9e1b4c072 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.348320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07858a-3290-46d0-ab88-dbf9e1b4c072 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.348320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b07858a-3290-46d0-ab88-dbf9e1b4c072 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.352728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e7239-e28c-4be7-bf56-144438e00e4d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:29.357465 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07858a-3290-46d0-ab88-dbf9e1b4c072 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:29.359176 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b07858a-3290-46d0-ab88-dbf9e1b4c072 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:29.379429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-4b07858a-3290-46d0-ab88-dbf9e1b4c072 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:29.379429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:29.379429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:29.379429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:29.379429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:29.379429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:29.379429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:29.379429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:29.379429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:29.379429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:29.379429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:29.379429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:29.379429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:29.379429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:29.379429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:29.385172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:29.385172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:29.385172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:29.385172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:29.385172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:29.385172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:29.385172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:29.385172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:29.385172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:29.385172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:29.385172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:29.385172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:29.385172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:29.385172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:29.385172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:29.385172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:29.385172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:29.386335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:29.386335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:29.386335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:29.386335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:29.386335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 305/601] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:29.386335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616aa14a-5cd7-42cf-97f9-77c649af77b5 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.386335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616aa14a-5cd7-42cf-97f9-77c649af77b5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.386335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616aa14a-5cd7-42cf-97f9-77c649af77b5 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.386335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 306/602] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:29.386887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616aa14a-5cd7-42cf-97f9-77c649af77b5 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:29.404324 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-834bcb13-f714-4c9f-aa1d-67d4991470b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:29.406417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bcb13-f714-4c9f-aa1d-67d4991470b4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.407246 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bcb13-f714-4c9f-aa1d-67d4991470b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.407895 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834bcb13-f714-4c9f-aa1d-67d4991470b4 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.409010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bcb13-f714-4c9f-aa1d-67d4991470b4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:29.409668 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bcb13-f714-4c9f-aa1d-67d4991470b4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:29.412035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-834bcb13-f714-4c9f-aa1d-67d4991470b4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:29.428726 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 297/603] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:29.430887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9d11c-3801-442f-a641-1758a23c3c9d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.431427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9d11c-3801-442f-a641-1758a23c3c9d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.432020 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd9d11c-3801-442f-a641-1758a23c3c9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.439833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:29.454971 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2dd9d11c-3801-442f-a641-1758a23c3c9d None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:29.456470 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2dd9d11c-3801-442f-a641-1758a23c3c9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:29.516969 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616aa14a-5cd7-42cf-97f9-77c649af77b5 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:29.551062 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 298/604] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:29.551062 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9d11c-3801-442f-a641-1758a23c3c9d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:29.574127 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5cf7a-c5aa-4bac-86d4-dd05c29b270f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:29.575002 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5cf7a-c5aa-4bac-86d4-dd05c29b270f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.575289 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5cf7a-c5aa-4bac-86d4-dd05c29b270f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.575566 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d5cf7a-c5aa-4bac-86d4-dd05c29b270f None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.576708 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5cf7a-c5aa-4bac-86d4-dd05c29b270f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:29.577526 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5cf7a-c5aa-4bac-86d4-dd05c29b270f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:29.579390 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d5cf7a-c5aa-4bac-86d4-dd05c29b270f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:29.594766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 307/605] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:29.595856 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5cf7a-c5aa-4bac-86d4-dd05c29b270f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:29.647730 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:29.688035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd9d11c-3801-442f-a641-1758a23c3c9d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:29.726602 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d5cf7a-c5aa-4bac-86d4-dd05c29b270f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:29.735199 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e0cf1-a352-4d19-892b-08e27aa0d9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:29.736891 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e0cf1-a352-4d19-892b-08e27aa0d9e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.737376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e0cf1-a352-4d19-892b-08e27aa0d9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.737861 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9e0cf1-a352-4d19-892b-08e27aa0d9e9 None admin] PATH_INFO: `/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/4776b70a88a04be7bfe6729e16c16647/roles/579726a957a7468abecab3fbdb4351a9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.741633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:29.760331 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e0cf1-a352-4d19-892b-08e27aa0d9e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=861de78bbfe84bd991c3ab54e85573a7, user_id=4776b70a88a04be7bfe6729e16c16647, role_id=579726a957a7468abecab3fbdb4351a9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:29.762781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa9e0cf1-a352-4d19-892b-08e27aa0d9e9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:29.769864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0040a-ab8f-4bdb-b472-fc4be7f82691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:29.770744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0040a-ab8f-4bdb-b472-fc4be7f82691 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.771142 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0040a-ab8f-4bdb-b472-fc4be7f82691 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.771511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e0040a-ab8f-4bdb-b472-fc4be7f82691 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.783572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e0040a-ab8f-4bdb-b472-fc4be7f82691 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:29.791527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-23e0040a-ab8f-4bdb-b472-fc4be7f82691 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:29.791527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:29.791527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:29.791527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:29.791527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:29.791527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:29.791527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:29.791527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:29.791527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:29.791527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:29.791527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:29.791527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:29.791527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:29.791527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:29.791527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:29.791527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:29.792457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:29.792457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:29.792457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:29.792457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:29.792457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:29.792457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:29.792457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:29.792457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:29.792457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:29.792457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:29.792457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:29.792457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:29.792457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:29.792457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:29.792457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:29.792457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:29.793351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:29.793351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:29.793351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:29.793351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:29.793351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:29.793351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:29.793351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:29.793351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:29.793351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:29.793351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:29.793351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:29.793351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:29.798097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 308/606] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:29.798986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0040a-ab8f-4bdb-b472-fc4be7f82691 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:29.855099 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 299/607] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:16:29 2022] PUT /identity/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/4776b70a88a04be7bfe6729e16c16647/roles/579726a957a7468abecab3fbdb4351a9 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:29.856511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e0cf1-a352-4d19-892b-08e27aa0d9e9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:29.924890 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:29.929892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e0040a-ab8f-4bdb-b472-fc4be7f82691 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:29.970043 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01deafd5-4521-4142-98e4-cc742bb860e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:29.971196 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deafd5-4521-4142-98e4-cc742bb860e1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:29.971627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deafd5-4521-4142-98e4-cc742bb860e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:29.972037 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01deafd5-4521-4142-98e4-cc742bb860e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:29.980197 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01deafd5-4521-4142-98e4-cc742bb860e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:29.981932 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01deafd5-4521-4142-98e4-cc742bb860e1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:29.993366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9e0cf1-a352-4d19-892b-08e27aa0d9e9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:29.997471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-01deafd5-4521-4142-98e4-cc742bb860e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:29.997471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:29.997471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:29.997471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:29.997471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:29.997471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:29.997471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:29.997471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:29.997471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:29.997471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:29.997471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:29.997471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:29.997471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:29.997471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:29.997471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:29.999212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:29.999212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:29.999212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:29.999212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:29.999212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:29.999212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:29.999212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:29.999212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:29.999212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:29.999212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:29.999212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:29.999212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:29.999212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:29.999212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:29.999212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:29.999212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:29.999212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:30.000761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:30.000761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:30.000761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:30.000761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:30.000761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:30.000761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:30.000761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:30.000761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:30.002922 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 309/608] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:30.004395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3ebe6-c3b0-45c4-8dc7-a670b992060e None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.004855 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3ebe6-c3b0-45c4-8dc7-a670b992060e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.005287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c3ebe6-c3b0-45c4-8dc7-a670b992060e None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.011106 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 310/609] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:30.012135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3ebe6-c3b0-45c4-8dc7-a670b992060e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:30.038945 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac923833-4654-454f-b293-c7acc11c2998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:30.039619 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac923833-4654-454f-b293-c7acc11c2998 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.039901 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac923833-4654-454f-b293-c7acc11c2998 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.040176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac923833-4654-454f-b293-c7acc11c2998 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.040930 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac923833-4654-454f-b293-c7acc11c2998 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:30.041234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac923833-4654-454f-b293-c7acc11c2998 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:30.042607 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac923833-4654-454f-b293-c7acc11c2998 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:30.052432 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 300/610] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:30.058395 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e45e6b-851d-452a-832c-6146c61c3178 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.058678 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e45e6b-851d-452a-832c-6146c61c3178 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.059005 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e45e6b-851d-452a-832c-6146c61c3178 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.085542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a8e45e6b-851d-452a-832c-6146c61c3178 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:30.087038 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a8e45e6b-851d-452a-832c-6146c61c3178 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:30.128679 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c3ebe6-c3b0-45c4-8dc7-a670b992060e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:30.133767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:30.165219 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c2fb4-beab-4962-a071-97aae73ee19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:30.166156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c2fb4-beab-4962-a071-97aae73ee19d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.166599 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c2fb4-beab-4962-a071-97aae73ee19d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.167090 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946c2fb4-beab-4962-a071-97aae73ee19d None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.168012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 301/611] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:30.174811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e45e6b-851d-452a-832c-6146c61c3178 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:30.175004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c2fb4-beab-4962-a071-97aae73ee19d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:30.175257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c2fb4-beab-4962-a071-97aae73ee19d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:30.176818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946c2fb4-beab-4962-a071-97aae73ee19d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:30.207115 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 311/612] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:30.208045 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c2fb4-beab-4962-a071-97aae73ee19d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:30.229150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:30.306027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e45e6b-851d-452a-832c-6146c61c3178 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:30.330012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946c2fb4-beab-4962-a071-97aae73ee19d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:30.352629 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35118d4-ab68-4eda-9d93-9fb28c480294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:30.353577 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35118d4-ab68-4eda-9d93-9fb28c480294 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.353959 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35118d4-ab68-4eda-9d93-9fb28c480294 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.354330 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35118d4-ab68-4eda-9d93-9fb28c480294 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.369957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35118d4-ab68-4eda-9d93-9fb28c480294 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:30.371032 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ffaa9-63c5-410b-a760-21d14260fd44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:30.371728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35118d4-ab68-4eda-9d93-9fb28c480294 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:30.372174 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ffaa9-63c5-410b-a760-21d14260fd44 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.372612 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ffaa9-63c5-410b-a760-21d14260fd44 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.373024 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe4ffaa9-63c5-410b-a760-21d14260fd44 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.384566 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe4ffaa9-63c5-410b-a760-21d14260fd44 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:30.393586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-fe4ffaa9-63c5-410b-a760-21d14260fd44 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:30.393586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:30.393586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:30.393586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:30.393586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:30.393586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:30.393586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:30.393586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:30.393586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:30.393586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:30.393586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:30.393586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:30.393586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:30.393586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:30.393586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:30.393586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:30.394609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:30.394609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:30.394609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:30.394609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:30.394609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:30.394609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:30.394609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:30.394609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:30.394609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:30.394609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:30.394609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:30.394609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:30.394609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:30.394609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:30.394609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:30.394609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:30.395476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:30.395476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:30.395476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:30.395476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:30.395476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:30.395476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:30.395476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:30.395476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:30.395476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:30.395476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:30.395476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:30.395476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:30.396108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-d35118d4-ab68-4eda-9d93-9fb28c480294 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:30.396108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:30.396108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:30.396108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:30.396108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:30.396108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:30.396108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:30.396108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:30.396108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:30.396108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:30.396108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:30.396108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:30.396108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:30.396108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:30.396108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:30.396887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:30.396887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:30.396887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:30.396887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:30.396887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:30.396887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:30.396887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:30.396887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:30.396887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:30.396887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:30.396887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:30.396887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:30.396887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:30.396887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:30.396887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:30.396887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:30.396887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:30.399063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:30.399063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:30.399063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:30.399063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:30.399063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 302/613] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:30.399063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35118d4-ab68-4eda-9d93-9fb28c480294 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:30.401282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 312/614] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:30.402237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ffaa9-63c5-410b-a760-21d14260fd44 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:30.433568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:30.516029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:30.521158 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35118d4-ab68-4eda-9d93-9fb28c480294 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:30.539444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe4ffaa9-63c5-410b-a760-21d14260fd44 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:30.566901 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa189c7-09c5-4337-90ec-5e87b91f55ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:30.568060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa189c7-09c5-4337-90ec-5e87b91f55ad None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.568417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa189c7-09c5-4337-90ec-5e87b91f55ad None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.568762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa189c7-09c5-4337-90ec-5e87b91f55ad None admin] PATH_INFO: `/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/c99418232a0848a1b7a1a73966928769/roles/579726a957a7468abecab3fbdb4351a9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.577608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea110-327e-48ba-a749-6cd66029f53e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:30.578561 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea110-327e-48ba-a749-6cd66029f53e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.579055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea110-327e-48ba-a749-6cd66029f53e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.579501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ea110-327e-48ba-a749-6cd66029f53e None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.580442 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ea110-327e-48ba-a749-6cd66029f53e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:30.580946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ea110-327e-48ba-a749-6cd66029f53e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:30.582579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ea110-327e-48ba-a749-6cd66029f53e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:30.587239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa189c7-09c5-4337-90ec-5e87b91f55ad None admin] RBAC: Authorizing `identity:create_grant(project_id=861de78bbfe84bd991c3ab54e85573a7, user_id=c99418232a0848a1b7a1a73966928769, role_id=579726a957a7468abecab3fbdb4351a9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:30.588695 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa189c7-09c5-4337-90ec-5e87b91f55ad None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:30.596337 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 313/615] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:30.597467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea110-327e-48ba-a749-6cd66029f53e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:30.652449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 303/616] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:16:30 2022] PUT /identity/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/c99418232a0848a1b7a1a73966928769/roles/579726a957a7468abecab3fbdb4351a9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:30.653619 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa189c7-09c5-4337-90ec-5e87b91f55ad None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:30.759725 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ea110-327e-48ba-a749-6cd66029f53e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:30.832141 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:30.834744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace90614-4ca3-4d66-be9f-87593fecceb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:30.835679 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace90614-4ca3-4d66-be9f-87593fecceb3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.836164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace90614-4ca3-4d66-be9f-87593fecceb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.836637 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace90614-4ca3-4d66-be9f-87593fecceb3 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.837590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace90614-4ca3-4d66-be9f-87593fecceb3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:30.838139 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace90614-4ca3-4d66-be9f-87593fecceb3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:30.839768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace90614-4ca3-4d66-be9f-87593fecceb3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:30.846221 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:30.850357 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 314/617] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:30.856231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace90614-4ca3-4d66-be9f-87593fecceb3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:30.887561 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa189c7-09c5-4337-90ec-5e87b91f55ad None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:30.956777 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6749a8-1399-43de-92bf-6f8f47aaf0c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:30.957689 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6749a8-1399-43de-92bf-6f8f47aaf0c4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:30.957968 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6749a8-1399-43de-92bf-6f8f47aaf0c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:30.958237 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6749a8-1399-43de-92bf-6f8f47aaf0c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:30.970733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6749a8-1399-43de-92bf-6f8f47aaf0c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:30.972265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6749a8-1399-43de-92bf-6f8f47aaf0c4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:30.983503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace90614-4ca3-4d66-be9f-87593fecceb3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:30.995231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ba6749a8-1399-43de-92bf-6f8f47aaf0c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:16:30.995231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:30.995231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:30.995231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:30.995231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:30.995231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:30.995231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:30.995231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:30.995231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:30.995231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:30.995231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:30.995231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:30.995231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:30.995231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:30.995231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:30.995231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:30.996243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:30.998027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:30.998027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:30.998027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:30.998027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:30.998027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:30.998027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:30.998027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:30.998027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:30.998027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:16:30.998027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:30.998027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 304/618] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Jul 15 19:16:30 2022] GET /identity/v3/users/nova => generated 82 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:31.003241 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6749a8-1399-43de-92bf-6f8f47aaf0c4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:31.053885 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb63bb-c5d0-47f1-b90b-8f9019e274c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:31.055264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb63bb-c5d0-47f1-b90b-8f9019e274c2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:31.056616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb63bb-c5d0-47f1-b90b-8f9019e274c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:31.057845 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb63bb-c5d0-47f1-b90b-8f9019e274c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:31.082814 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb63bb-c5d0-47f1-b90b-8f9019e274c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:31.084291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb63bb-c5d0-47f1-b90b-8f9019e274c2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:31.103474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-0efb63bb-c5d0-47f1-b90b-8f9019e274c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:31.103474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:31.103474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:31.103474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:31.103474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:31.103474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:31.103474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:31.103474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:31.103474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:31.103474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:31.103474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:31.103474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:31.103474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:31.103474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:31.103474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:31.104460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:31.104460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:31.104460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:31.104460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:31.104460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:31.104460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:31.104460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:31.104460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:31.104460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:31.104460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:31.104460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:31.104460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:31.104460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:31.104460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:31.104460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:31.104460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:31.104460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:31.105528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:31.105528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:31.105528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:31.105528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:31.105528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 315/619] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:16:31.111335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb63bb-c5d0-47f1-b90b-8f9019e274c2 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:31.175131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:31.241368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6749a8-1399-43de-92bf-6f8f47aaf0c4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:31.267175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb63bb-c5d0-47f1-b90b-8f9019e274c2 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:31.301689 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab590091-50de-491f-a524-ad4a9bab4f2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:31.302666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab590091-50de-491f-a524-ad4a9bab4f2b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:31.303180 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab590091-50de-491f-a524-ad4a9bab4f2b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:31.303644 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab590091-50de-491f-a524-ad4a9bab4f2b None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:31.304677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab590091-50de-491f-a524-ad4a9bab4f2b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:31.305164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab590091-50de-491f-a524-ad4a9bab4f2b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:31.306810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab590091-50de-491f-a524-ad4a9bab4f2b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:31.316159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:31.327574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 305/620] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Jul 15 19:16:31 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 325 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:31.336301 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785addff-3caa-4d85-8438-b6282193d1ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:31.337497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab590091-50de-491f-a524-ad4a9bab4f2b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:31.337601 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785addff-3caa-4d85-8438-b6282193d1ce None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:31.337601 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785addff-3caa-4d85-8438-b6282193d1ce None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:31.337601 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785addff-3caa-4d85-8438-b6282193d1ce None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:31.338205 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785addff-3caa-4d85-8438-b6282193d1ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:31.338512 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785addff-3caa-4d85-8438-b6282193d1ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:31.341248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785addff-3caa-4d85-8438-b6282193d1ce None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:31.363143 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 316/621] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:31.364552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd4ca1-4fce-4401-881f-4d2ef0af2919 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:31.364842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd4ca1-4fce-4401-881f-4d2ef0af2919 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:31.365117 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcd4ca1-4fce-4401-881f-4d2ef0af2919 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:31.371496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 317/622] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:31 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:31.372522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd4ca1-4fce-4401-881f-4d2ef0af2919 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:31.458673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab590091-50de-491f-a524-ad4a9bab4f2b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:31.495063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67a27c-a0f5-46d6-aa98-ff1cb8287ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:31.495653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67a27c-a0f5-46d6-aa98-ff1cb8287ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:31.495930 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67a27c-a0f5-46d6-aa98-ff1cb8287ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:31.496198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac67a27c-a0f5-46d6-aa98-ff1cb8287ae2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:31.515042 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcd4ca1-4fce-4401-881f-4d2ef0af2919 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:31.533809 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:31.562042 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85204806-a9f3-470f-a35a-40c72e60d8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:31.563730 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:31.564211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85204806-a9f3-470f-a35a-40c72e60d8c5 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:31.564928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85204806-a9f3-470f-a35a-40c72e60d8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:31.565330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85204806-a9f3-470f-a35a-40c72e60d8c5 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:31.575391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85204806-a9f3-470f-a35a-40c72e60d8c5 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:31.576544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85204806-a9f3-470f-a35a-40c72e60d8c5 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:31.577532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67a27c-a0f5-46d6-aa98-ff1cb8287ae2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:31.579266 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac67a27c-a0f5-46d6-aa98-ff1cb8287ae2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:31.597590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-85204806-a9f3-470f-a35a-40c72e60d8c5 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:16:31.597590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:31.597590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:31.597590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:31.597590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:31.597590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:31.597590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:31.597590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:31.597590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:31.597590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:31.597590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:31.597590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:31.597590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:31.597590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:31.597590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:31.597590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:31.598657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:31.599731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:31.599731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:31.599731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:31.599731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:31.599731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:31.599731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:31.599731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:31.599731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:31.599731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:16:31.599731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:31.599731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 318/623] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:31 2022] GET /identity/v3/users/swift => generated 83 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:31.601239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f9c13-a6a7-4b9d-8e05-393803db07da None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:31.601965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f9c13-a6a7-4b9d-8e05-393803db07da None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:31.602268 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235f9c13-a6a7-4b9d-8e05-393803db07da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:31.625084 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-235f9c13-a6a7-4b9d-8e05-393803db07da None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:31.626301 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-235f9c13-a6a7-4b9d-8e05-393803db07da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:31.694351 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 306/624] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:31.695571 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67a27c-a0f5-46d6-aa98-ff1cb8287ae2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:31.722798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 319/625] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:31.722798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f9c13-a6a7-4b9d-8e05-393803db07da None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:31.821149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:31.827675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac67a27c-a0f5-46d6-aa98-ff1cb8287ae2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:31.851107 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235f9c13-a6a7-4b9d-8e05-393803db07da None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:31.853111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:31.871904 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3a695-8c18-4e95-bc1d-ee40a268ae45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:31.873180 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3a695-8c18-4e95-bc1d-ee40a268ae45 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:31.873688 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3a695-8c18-4e95-bc1d-ee40a268ae45 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:31.874817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b3a695-8c18-4e95-bc1d-ee40a268ae45 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:31.876213 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3a695-8c18-4e95-bc1d-ee40a268ae45 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:31.876677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3a695-8c18-4e95-bc1d-ee40a268ae45 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:31.879072 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b3a695-8c18-4e95-bc1d-ee40a268ae45 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:31.889978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becd8a4-a828-4b2f-984e-e666a6bae261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:31.891023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becd8a4-a828-4b2f-984e-e666a6bae261 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:31.891557 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becd8a4-a828-4b2f-984e-e666a6bae261 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:31.891923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5becd8a4-a828-4b2f-984e-e666a6bae261 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:31.902785 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becd8a4-a828-4b2f-984e-e666a6bae261 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:31.904249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 307/626] 10.222.0.40 () {56 vars in 1135 bytes} [Fri Jul 15 19:16:31 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:31.904577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5becd8a4-a828-4b2f-984e-e666a6bae261 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:31.905551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3a695-8c18-4e95-bc1d-ee40a268ae45 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:31.925133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-5becd8a4-a828-4b2f-984e-e666a6bae261 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:31.925133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:31.925133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:31.925133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:31.925133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:31.925133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:31.925133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:31.925133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:31.925133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:31.925133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:31.925133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:31.925133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:31.925133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:31.925133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:31.925133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:31.926300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:31.926300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:31.926300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:31.926300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:31.926300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:31.926300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:31.926300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:31.926300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:31.926300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:31.926300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:31.926300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:31.926300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:31.926300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:31.926300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:31.926300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:31.926300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:31.926300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:31.927408 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:31.927408 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:31.927408 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:31.927408 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:31.929053 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 320/627] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:31.929998 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becd8a4-a828-4b2f-984e-e666a6bae261 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:32.042102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5becd8a4-a828-4b2f-984e-e666a6bae261 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:32.051367 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b3a695-8c18-4e95-bc1d-ee40a268ae45 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:32.079906 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6355b-bdb1-4e99-9d66-c21a36412a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:32.080899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6355b-bdb1-4e99-9d66-c21a36412a2f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:32.081382 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6355b-bdb1-4e99-9d66-c21a36412a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:32.081808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d6355b-bdb1-4e99-9d66-c21a36412a2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:32.093132 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad32e8a1-1a54-4440-898f-6924b4927b6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:32.093920 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32e8a1-1a54-4440-898f-6924b4927b6b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:32.094194 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32e8a1-1a54-4440-898f-6924b4927b6b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:32.094463 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad32e8a1-1a54-4440-898f-6924b4927b6b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:32.094570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6355b-bdb1-4e99-9d66-c21a36412a2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:32.096136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d6355b-bdb1-4e99-9d66-c21a36412a2f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:32.105757 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad32e8a1-1a54-4440-898f-6924b4927b6b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:32.114260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ad32e8a1-1a54-4440-898f-6924b4927b6b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:32.114260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:32.114260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:32.114260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:32.114260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:32.114260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:32.114260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:32.114260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:32.114260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:32.114260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:32.114260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:32.114260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:32.114260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:32.114260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:32.114260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:32.114260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:32.115320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:32.115320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:32.115320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:32.115320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:32.115320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:32.115320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:32.115320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:32.115320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:32.115320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:32.115320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:32.115320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:32.115320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:32.115320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:32.115320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:32.115320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:32.115320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:32.116189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:32.116189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:32.116189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:32.116189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:32.116189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:32.116189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:32.116189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:32.116189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:32.116189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:32.116189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:32.116189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:32.116189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:32.116865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-96d6355b-bdb1-4e99-9d66-c21a36412a2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:32.116865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:32.116865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:32.116865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:32.116865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:32.116865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:32.116865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:32.116865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:32.116865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:32.116865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:32.116865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:32.116865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:32.116865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:32.116865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:32.116865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:32.117671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:32.117671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:32.117671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:32.117671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:32.117671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:32.117671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:32.117671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:32.117671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:32.117671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:32.117671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:32.117671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:32.117671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:32.117671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:32.117671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:32.117671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:32.117671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:32.117671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:32.119578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:32.119578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:32.119578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:32.119578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:32.120457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 321/629] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:32.120617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 308/629] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:32.121331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6355b-bdb1-4e99-9d66-c21a36412a2f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:32.121798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47603ffb-bc5b-4a59-a37b-a59cfaa3e62c None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:32.122127 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47603ffb-bc5b-4a59-a37b-a59cfaa3e62c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:32.122352 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47603ffb-bc5b-4a59-a37b-a59cfaa3e62c None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:32.126980 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 309/630] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:32.126980 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47603ffb-bc5b-4a59-a37b-a59cfaa3e62c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:32.133599 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:32.143763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:32.231547 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d6355b-bdb1-4e99-9d66-c21a36412a2f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:32.237074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47603ffb-bc5b-4a59-a37b-a59cfaa3e62c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:32.269666 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bf81b-a260-4ea0-9c03-f0c39d20aa17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:32.270330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bf81b-a260-4ea0-9c03-f0c39d20aa17 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:32.270608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bf81b-a260-4ea0-9c03-f0c39d20aa17 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:32.270906 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663bf81b-a260-4ea0-9c03-f0c39d20aa17 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:32.271626 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bf81b-a260-4ea0-9c03-f0c39d20aa17 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:32.271935 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bf81b-a260-4ea0-9c03-f0c39d20aa17 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:32.273284 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-663bf81b-a260-4ea0-9c03-f0c39d20aa17 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:32.277371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d2063e-33b5-4416-af65-1d4360847317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:32.278263 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2063e-33b5-4416-af65-1d4360847317 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:32.278731 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2063e-33b5-4416-af65-1d4360847317 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:32.279216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d2063e-33b5-4416-af65-1d4360847317 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:32.280896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2063e-33b5-4416-af65-1d4360847317 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:32.281396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2063e-33b5-4416-af65-1d4360847317 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:32.283693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d2063e-33b5-4416-af65-1d4360847317 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:32.285450 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 322/631] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:32.286074 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bf81b-a260-4ea0-9c03-f0c39d20aa17 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:32.297648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 310/632] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:32.299623 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c233336-0f4f-4245-9f89-5e4eb0b7745b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:32.300463 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c233336-0f4f-4245-9f89-5e4eb0b7745b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:32.300930 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c233336-0f4f-4245-9f89-5e4eb0b7745b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:32.322959 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8c233336-0f4f-4245-9f89-5e4eb0b7745b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:32.325281 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8c233336-0f4f-4245-9f89-5e4eb0b7745b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:32.355170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:32.394310 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663bf81b-a260-4ea0-9c03-f0c39d20aa17 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:32.410903 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 311/633] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:32.412506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c233336-0f4f-4245-9f89-5e4eb0b7745b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:32.425323 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:32.433612 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221a367-51bc-42d7-83bd-16f6655c800d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:32.437101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221a367-51bc-42d7-83bd-16f6655c800d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:32.437101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221a367-51bc-42d7-83bd-16f6655c800d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:32.437101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8221a367-51bc-42d7-83bd-16f6655c800d None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:32.437101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221a367-51bc-42d7-83bd-16f6655c800d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:32.437101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221a367-51bc-42d7-83bd-16f6655c800d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:32.437512 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8221a367-51bc-42d7-83bd-16f6655c800d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:32.450129 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 323/634] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:32.451108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221a367-51bc-42d7-83bd-16f6655c800d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:32.530621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c233336-0f4f-4245-9f89-5e4eb0b7745b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:32.566565 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8221a367-51bc-42d7-83bd-16f6655c800d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:32.568215 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fd7ef-ee45-4b58-b437-21020ac1ad17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:32.569022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fd7ef-ee45-4b58-b437-21020ac1ad17 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:32.569302 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fd7ef-ee45-4b58-b437-21020ac1ad17 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:32.569581 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78fd7ef-ee45-4b58-b437-21020ac1ad17 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:32.577649 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fd7ef-ee45-4b58-b437-21020ac1ad17 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:32.579347 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78fd7ef-ee45-4b58-b437-21020ac1ad17 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:32.594724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:32.595939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b78fd7ef-ee45-4b58-b437-21020ac1ad17 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:32.595939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:32.595939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:32.595939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:32.595939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:32.595939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:32.595939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:32.595939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:32.595939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:32.595939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:32.595939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:32.595939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:32.595939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:32.595939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:32.595939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:32.596838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:32.596838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:32.596838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:32.596838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:32.596838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:32.596838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:32.596838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:32.596838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:32.596838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:32.596838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:32.596838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:32.596838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:32.596838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:32.596838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:32.596838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:32.596838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:32.596838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:32.597767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:32.597767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:32.597767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:32.597767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:32.597767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:32.597767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:32.597767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:32.597767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:32.597767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 312/635] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:32.598810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fd7ef-ee45-4b58-b437-21020ac1ad17 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:32.613169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4127a-4f49-4935-a37f-5df70ce539df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:32.613970 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4127a-4f49-4935-a37f-5df70ce539df None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:32.614249 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4127a-4f49-4935-a37f-5df70ce539df None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:32.614524 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b4127a-4f49-4935-a37f-5df70ce539df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:32.625644 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4127a-4f49-4935-a37f-5df70ce539df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:32.627667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b4127a-4f49-4935-a37f-5df70ce539df None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:32.647026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-c1b4127a-4f49-4935-a37f-5df70ce539df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:32.647026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:32.647026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:32.647026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:32.647026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:32.647026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:32.647026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:32.647026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:32.647026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:32.647026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:32.647026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:32.647026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:32.647026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:32.647026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:32.647026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:32.648122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:32.648122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:32.648122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:32.648122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:32.648122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:32.648122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:32.648122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:32.648122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:32.648122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:32.648122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:32.648122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:32.648122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:32.648122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:32.648122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:32.648122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:32.648122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:32.648122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:32.649055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:32.649055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:32.649055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:32.649055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:32.649055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 324/636] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:32.649055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4127a-4f49-4935-a37f-5df70ce539df None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:32.674633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:32.714851 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78fd7ef-ee45-4b58-b437-21020ac1ad17 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:32.752309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07de203-5c17-4e6c-8714-f186fef8c5e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:32.753116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07de203-5c17-4e6c-8714-f186fef8c5e8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:32.753397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07de203-5c17-4e6c-8714-f186fef8c5e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:32.753675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b07de203-5c17-4e6c-8714-f186fef8c5e8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:32.757987 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b4127a-4f49-4935-a37f-5df70ce539df None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:32.765583 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b07de203-5c17-4e6c-8714-f186fef8c5e8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:32.774305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b07de203-5c17-4e6c-8714-f186fef8c5e8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:32.774305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:32.774305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:32.774305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:32.774305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:32.774305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:32.774305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:32.774305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:32.774305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:32.774305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:32.774305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:32.774305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:32.774305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:32.774305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:32.774305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:32.774305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:32.775320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:32.775320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:32.775320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:32.775320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:32.775320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:32.775320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:32.775320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:32.775320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:32.775320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:32.775320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:32.775320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:32.775320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:32.775320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:32.775320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:32.775320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:32.775320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:32.776301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:32.776301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:32.776301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:32.776301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:32.776301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:32.776301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:32.776301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:32.776301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:32.776301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:32.776301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:32.776301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:32.776301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:32.776301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 313/637] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:32.777667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07de203-5c17-4e6c-8714-f186fef8c5e8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:32.800242 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bd835-ba56-4f7f-8989-4df894ea329a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:32.801446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd835-ba56-4f7f-8989-4df894ea329a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:32.801889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd835-ba56-4f7f-8989-4df894ea329a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:32.802173 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7bd835-ba56-4f7f-8989-4df894ea329a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:32.809189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bd835-ba56-4f7f-8989-4df894ea329a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:32.810620 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7bd835-ba56-4f7f-8989-4df894ea329a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:32.824959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-af7bd835-ba56-4f7f-8989-4df894ea329a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:32.824959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:32.824959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:32.824959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:32.824959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:32.824959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:32.824959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:32.824959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:32.824959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:32.824959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:32.824959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:32.824959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:32.824959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:32.824959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:32.824959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:32.826131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:32.826131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:32.826131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:32.826131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:32.826131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:32.826131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:32.826131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:32.826131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:32.826131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:32.826131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:32.826131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:32.826131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:32.826131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:32.826131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:32.826131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:32.826131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:32.826131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:32.827954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:32.827954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:32.827954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:32.827954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:32.827954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:32.827954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:32.827954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:32.827954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:32.831852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 325/638] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:32.832584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bd835-ba56-4f7f-8989-4df894ea329a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:32.875926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:32.904236 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b07de203-5c17-4e6c-8714-f186fef8c5e8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:32.934739 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:32.944591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c467fd8-56be-4f33-aba9-9809f69a1466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:32.944807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7bd835-ba56-4f7f-8989-4df894ea329a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:32.945280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c467fd8-56be-4f33-aba9-9809f69a1466 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:32.945569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c467fd8-56be-4f33-aba9-9809f69a1466 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:32.945847 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c467fd8-56be-4f33-aba9-9809f69a1466 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:32.946846 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c467fd8-56be-4f33-aba9-9809f69a1466 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:32.947914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c467fd8-56be-4f33-aba9-9809f69a1466 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:32.948609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c467fd8-56be-4f33-aba9-9809f69a1466 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:32.961716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 314/639] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:32.962586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c467fd8-56be-4f33-aba9-9809f69a1466 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:32.980162 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc84da4-04f3-4520-9f08-2dce1d43be19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:32.980830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc84da4-04f3-4520-9f08-2dce1d43be19 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:32.981117 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc84da4-04f3-4520-9f08-2dce1d43be19 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:32.981402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc84da4-04f3-4520-9f08-2dce1d43be19 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:32.982131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc84da4-04f3-4520-9f08-2dce1d43be19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:32.982441 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc84da4-04f3-4520-9f08-2dce1d43be19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:32.984271 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc84da4-04f3-4520-9f08-2dce1d43be19 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:32.996632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 326/640] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:32.997265 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc84da4-04f3-4520-9f08-2dce1d43be19 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:33.080149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c467fd8-56be-4f33-aba9-9809f69a1466 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:33.103059 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:33.107529 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc84da4-04f3-4520-9f08-2dce1d43be19 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:33.115283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1342f51-31f1-4f2b-a852-6a880ee8d7bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:33.115951 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1342f51-31f1-4f2b-a852-6a880ee8d7bf None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.116230 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1342f51-31f1-4f2b-a852-6a880ee8d7bf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.117665 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1342f51-31f1-4f2b-a852-6a880ee8d7bf None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.117665 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1342f51-31f1-4f2b-a852-6a880ee8d7bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:33.117665 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1342f51-31f1-4f2b-a852-6a880ee8d7bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:33.118909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1342f51-31f1-4f2b-a852-6a880ee8d7bf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:33.128549 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 315/641] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:33.129863 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b941f37-24b8-434d-a5ff-8f5f8a822935 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.130148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b941f37-24b8-434d-a5ff-8f5f8a822935 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.130421 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b941f37-24b8-434d-a5ff-8f5f8a822935 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.131687 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 316/642] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:33.132421 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b941f37-24b8-434d-a5ff-8f5f8a822935 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:33.150146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e688d1-6c51-4b9f-8b9e-c215764dca8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:33.150868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e688d1-6c51-4b9f-8b9e-c215764dca8e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.151158 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e688d1-6c51-4b9f-8b9e-c215764dca8e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.151438 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e688d1-6c51-4b9f-8b9e-c215764dca8e None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.152232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e688d1-6c51-4b9f-8b9e-c215764dca8e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:33.152547 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e688d1-6c51-4b9f-8b9e-c215764dca8e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:33.154004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e688d1-6c51-4b9f-8b9e-c215764dca8e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:33.166207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 327/643] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:33.167043 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e688d1-6c51-4b9f-8b9e-c215764dca8e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:33.188936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:33.242437 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b941f37-24b8-434d-a5ff-8f5f8a822935 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:33.272318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e688d1-6c51-4b9f-8b9e-c215764dca8e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:33.277243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f81d88-942a-4dc9-a85e-f1561839c88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:33.277887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f81d88-942a-4dc9-a85e-f1561839c88f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.278176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f81d88-942a-4dc9-a85e-f1561839c88f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.278448 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f81d88-942a-4dc9-a85e-f1561839c88f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.279316 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f81d88-942a-4dc9-a85e-f1561839c88f None admin] RBAC: Adding query filter params (role.id=579726a957a7468abecab3fbdb4351a9, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=850a32e590154968bfbbfc404450b70a) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:33.279631 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f81d88-942a-4dc9-a85e-f1561839c88f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:33.281108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f81d88-942a-4dc9-a85e-f1561839c88f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:33.287049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 317/644] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:33 2022] GET /identity/v3/role_assignments?user.id=850a32e590154968bfbbfc404450b70a&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=579726a957a7468abecab3fbdb4351a9 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:33.287862 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f81d88-942a-4dc9-a85e-f1561839c88f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:33.309446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05a2068b-22cc-49ae-adb9-a729396aa1b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:33.310256 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2068b-22cc-49ae-adb9-a729396aa1b0 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.310534 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2068b-22cc-49ae-adb9-a729396aa1b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.310841 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05a2068b-22cc-49ae-adb9-a729396aa1b0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.320236 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2068b-22cc-49ae-adb9-a729396aa1b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:33.321722 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05a2068b-22cc-49ae-adb9-a729396aa1b0 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:33.337047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-05a2068b-22cc-49ae-adb9-a729396aa1b0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 15 19:16:33.337047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:33.337047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:33.337047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:33.337047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:33.337047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:33.337047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:33.337047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:33.337047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:33.337047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:33.337047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:33.337047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:33.337047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:33.337047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:33.337047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:33.337047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:33.338050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:33.339711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:33.339711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:33.339711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:33.339711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:33.339711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:33.339711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:33.339711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:33.339711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:33.339711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 15 19:16:33.339711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:33.339711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 328/645] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:33.339711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115f6b9-ffeb-4695-af92-89cac652f3c0 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.340400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115f6b9-ffeb-4695-af92-89cac652f3c0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.340400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9115f6b9-ffeb-4695-af92-89cac652f3c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.357683 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-9115f6b9-ffeb-4695-af92-89cac652f3c0 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:33.359485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9115f6b9-ffeb-4695-af92-89cac652f3c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:33.378535 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:33.416315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f81d88-942a-4dc9-a85e-f1561839c88f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:33.432225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:33.443692 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 329/646] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:33.443692 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115f6b9-ffeb-4695-af92-89cac652f3c0 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:33.461948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e106b-6d23-44f3-8210-2f447c5f8865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:33.461948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e106b-6d23-44f3-8210-2f447c5f8865 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.461948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e106b-6d23-44f3-8210-2f447c5f8865 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.462301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e106b-6d23-44f3-8210-2f447c5f8865 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.475500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e106b-6d23-44f3-8210-2f447c5f8865 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:33.477493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4e106b-6d23-44f3-8210-2f447c5f8865 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:33.496963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-9a4e106b-6d23-44f3-8210-2f447c5f8865 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:33.496963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:33.496963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:33.496963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:33.496963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:33.496963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:33.496963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:33.496963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:33.496963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:33.496963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:33.496963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:33.496963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:33.496963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:33.496963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:33.496963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:33.497917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:33.497917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:33.497917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:33.497917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:33.497917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:33.497917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:33.497917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:33.497917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:33.497917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:33.497917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:33.497917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:33.497917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:33.497917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:33.497917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:33.497917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:33.497917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:33.497917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:33.499482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:33.499482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:33.499482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:33.499482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:33.502143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 318/647] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:33.502143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e106b-6d23-44f3-8210-2f447c5f8865 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:33.569152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9115f6b9-ffeb-4695-af92-89cac652f3c0 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:33.603846 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ff397-d721-4a1e-8000-2cbe60520103 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:33.604657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ff397-d721-4a1e-8000-2cbe60520103 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.604937 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ff397-d721-4a1e-8000-2cbe60520103 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.605211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ff397-d721-4a1e-8000-2cbe60520103 None admin] PATH_INFO: `/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/0402e1bd20b042cdbdcb890616b22726/roles/579726a957a7468abecab3fbdb4351a9` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.617129 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e106b-6d23-44f3-8210-2f447c5f8865 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:33.621278 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ff397-d721-4a1e-8000-2cbe60520103 None admin] RBAC: Authorizing `identity:create_grant(project_id=861de78bbfe84bd991c3ab54e85573a7, user_id=0402e1bd20b042cdbdcb890616b22726, role_id=579726a957a7468abecab3fbdb4351a9)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:33.622733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-293ff397-d721-4a1e-8000-2cbe60520103 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:33.657847 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086836b5-3dc3-48a2-beef-a56bf7d19956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:33.658510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086836b5-3dc3-48a2-beef-a56bf7d19956 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.658822 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086836b5-3dc3-48a2-beef-a56bf7d19956 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.659099 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086836b5-3dc3-48a2-beef-a56bf7d19956 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.659933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086836b5-3dc3-48a2-beef-a56bf7d19956 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:33.660241 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086836b5-3dc3-48a2-beef-a56bf7d19956 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:33.661670 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-086836b5-3dc3-48a2-beef-a56bf7d19956 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:33.680739 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 319/648] 10.222.0.40 () {56 vars in 1137 bytes} [Fri Jul 15 19:16:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:33.681679 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086836b5-3dc3-48a2-beef-a56bf7d19956 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:33.690066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:33.697427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 330/649] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:16:33 2022] PUT /identity/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/0402e1bd20b042cdbdcb890616b22726/roles/579726a957a7468abecab3fbdb4351a9 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:33.699368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ff397-d721-4a1e-8000-2cbe60520103 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:33.708890 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:33.811412 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-086836b5-3dc3-48a2-beef-a56bf7d19956 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:33.865157 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26571b-568a-4d62-9da4-54ae1271b379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:33.866497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26571b-568a-4d62-9da4-54ae1271b379 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.866999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26571b-568a-4d62-9da4-54ae1271b379 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.867417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26571b-568a-4d62-9da4-54ae1271b379 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.869478 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-293ff397-d721-4a1e-8000-2cbe60520103 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:33.882436 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac26571b-568a-4d62-9da4-54ae1271b379 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:33.892506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ac26571b-568a-4d62-9da4-54ae1271b379 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:33.892506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:33.892506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:33.892506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:33.892506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:33.892506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:33.892506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:33.892506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:33.892506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:33.892506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:33.892506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:33.892506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:33.892506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:33.892506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:33.892506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:33.892506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:33.893594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:33.893594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:33.893594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:33.893594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:33.893594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:33.893594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:33.893594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:33.893594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:33.893594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:33.893594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:33.893594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:33.893594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:33.893594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:33.893594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:33.893594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:33.893594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:33.894466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:33.894466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:33.894466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:33.894466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:33.894466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:33.894466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:33.894466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:33.894466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:33.894466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:33.894466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:33.894466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:33.894466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:33.894466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 320/650] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:33.895280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26571b-568a-4d62-9da4-54ae1271b379 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:33.926552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38df31-5cce-4538-95a3-c9fc756758be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:33.927737 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38df31-5cce-4538-95a3-c9fc756758be None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:33.928235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38df31-5cce-4538-95a3-c9fc756758be None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:33.928729 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f38df31-5cce-4538-95a3-c9fc756758be None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:33.929573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38df31-5cce-4538-95a3-c9fc756758be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:33.929986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38df31-5cce-4538-95a3-c9fc756758be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:33.931500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f38df31-5cce-4538-95a3-c9fc756758be None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:33.947900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 331/651] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:33.951780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38df31-5cce-4538-95a3-c9fc756758be None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:34.004567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:34.025481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26571b-568a-4d62-9da4-54ae1271b379 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:34.036017 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:34.089160 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdc37b-ea8f-4c09-9160-321ec6d15111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:34.089820 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdc37b-ea8f-4c09-9160-321ec6d15111 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:34.090102 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdc37b-ea8f-4c09-9160-321ec6d15111 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:34.090375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbdc37b-ea8f-4c09-9160-321ec6d15111 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:34.100421 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f38df31-5cce-4538-95a3-c9fc756758be None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:34.150093 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8facb70-8d13-4172-988c-b742e81494cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:34.152345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8facb70-8d13-4172-988c-b742e81494cb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:34.152818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8facb70-8d13-4172-988c-b742e81494cb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:34.153286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8facb70-8d13-4172-988c-b742e81494cb None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:34.154278 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8facb70-8d13-4172-988c-b742e81494cb None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:34.155368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8facb70-8d13-4172-988c-b742e81494cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:34.157781 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8facb70-8d13-4172-988c-b742e81494cb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:34.176425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 332/652] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:34.176425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8facb70-8d13-4172-988c-b742e81494cb None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:34.182121 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdc37b-ea8f-4c09-9160-321ec6d15111 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:34.183924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbdc37b-ea8f-4c09-9160-321ec6d15111 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:34.283686 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:34.284597 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8facb70-8d13-4172-988c-b742e81494cb None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:34.305394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:34.309159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 321/653] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 414 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:34.310154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdc37b-ea8f-4c09-9160-321ec6d15111 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:34.320795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf5dc4-8072-4966-b6a1-b27e43a487e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:34.321594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf5dc4-8072-4966-b6a1-b27e43a487e2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:34.321879 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf5dc4-8072-4966-b6a1-b27e43a487e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:34.322156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdf5dc4-8072-4966-b6a1-b27e43a487e2 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:34.330483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf5dc4-8072-4966-b6a1-b27e43a487e2 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:34.331980 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdf5dc4-8072-4966-b6a1-b27e43a487e2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:34.347418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-ffdf5dc4-8072-4966-b6a1-b27e43a487e2 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 19:16:34.347418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:34.347418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:34.347418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:34.347418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:34.347418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:34.347418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:34.347418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:34.347418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:34.347418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:34.347418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:34.347418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:34.347418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:34.347418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:34.347418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:34.347418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:34.348586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:34.349556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:34.349556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:34.349556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:34.349556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:34.349556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:34.349556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:34.349556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:34.349556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:34.349556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 19:16:34.349556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:34.349556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 333/654] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:34 2022] GET /identity/v3/users/cinder => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:34.350150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf5dc4-8072-4966-b6a1-b27e43a487e2 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:34.421366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbdc37b-ea8f-4c09-9160-321ec6d15111 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:34.468298 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4dc2c-ab98-4559-9619-210ac01a5ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:34.469365 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4dc2c-ab98-4559-9619-210ac01a5ef6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:34.469645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4dc2c-ab98-4559-9619-210ac01a5ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:34.470335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c4dc2c-ab98-4559-9619-210ac01a5ef6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:34.473780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdf5dc4-8072-4966-b6a1-b27e43a487e2 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:34.483033 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4dc2c-ab98-4559-9619-210ac01a5ef6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:34.485295 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c4dc2c-ab98-4559-9619-210ac01a5ef6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:34.515044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-93c4dc2c-ab98-4559-9619-210ac01a5ef6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:34.515044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:34.515044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:34.515044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:34.515044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:34.515044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:34.515044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:34.515044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:34.515044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:34.515044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:34.515044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:34.515044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:34.515044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:34.515044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:34.515044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:34.516402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:34.516402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:34.516402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:34.516402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:34.516402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:34.516402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:34.516402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:34.516402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:34.516402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:34.516402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:34.516402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:34.516402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:34.516402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:34.516402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:34.516402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:34.516402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:34.516402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:34.517308 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:34.517308 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:34.517308 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:34.517308 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:34.517308 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 322/655] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:34.518129 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4dc2c-ab98-4559-9619-210ac01a5ef6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:34.520658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7b03d-d573-4e71-aad0-ec051b7f20c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:34.520658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b03d-d573-4e71-aad0-ec051b7f20c8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:34.520658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b03d-d573-4e71-aad0-ec051b7f20c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:34.520658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac7b03d-d573-4e71-aad0-ec051b7f20c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:34.536557 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7b03d-d573-4e71-aad0-ec051b7f20c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:34.538239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac7b03d-d573-4e71-aad0-ec051b7f20c8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:34.559769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:34.560653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-aac7b03d-d573-4e71-aad0-ec051b7f20c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:34.560653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:34.560653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:34.560653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:34.560653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:34.560653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:34.560653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:34.560653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:34.560653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:34.560653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:34.560653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:34.560653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:34.560653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:34.560653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:34.560653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:34.562925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:34.562925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:34.562925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:34.562925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:34.562925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:34.562925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:34.562925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:34.562925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:34.562925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:34.562925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:34.562925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:34.562925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:34.562925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:34.562925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:34.562925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:34.562925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:34.562925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:34.564807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:34.564807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:34.564807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:34.564807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:34.564807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 334/656] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:34.564807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7b03d-d573-4e71-aad0-ec051b7f20c8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:34.607082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:34.649053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c4dc2c-ab98-4559-9619-210ac01a5ef6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:34.689176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce928d-3b9c-411a-af4b-3e49310b6d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:34.690176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce928d-3b9c-411a-af4b-3e49310b6d01 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:34.690664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce928d-3b9c-411a-af4b-3e49310b6d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:34.690949 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac7b03d-d573-4e71-aad0-ec051b7f20c8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:34.691425 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fce928d-3b9c-411a-af4b-3e49310b6d01 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:34.692488 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce928d-3b9c-411a-af4b-3e49310b6d01 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:34.693004 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce928d-3b9c-411a-af4b-3e49310b6d01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:34.694630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fce928d-3b9c-411a-af4b-3e49310b6d01 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:34.713800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 323/657] 10.222.0.40 () {56 vars in 1137 bytes} [Fri Jul 15 19:16:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:34.715096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce928d-3b9c-411a-af4b-3e49310b6d01 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:34.727755 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32107de8-0ecb-4be1-9428-243fa73ad026 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:34.728414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32107de8-0ecb-4be1-9428-243fa73ad026 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:34.728696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32107de8-0ecb-4be1-9428-243fa73ad026 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:34.728970 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32107de8-0ecb-4be1-9428-243fa73ad026 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:34.729698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32107de8-0ecb-4be1-9428-243fa73ad026 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:34.730004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32107de8-0ecb-4be1-9428-243fa73ad026 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:34.731387 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32107de8-0ecb-4be1-9428-243fa73ad026 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:34.744834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 335/658] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:34.745760 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32107de8-0ecb-4be1-9428-243fa73ad026 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:34.840128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:34.852345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fce928d-3b9c-411a-af4b-3e49310b6d01 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:34.855718 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:34.866020 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32107de8-0ecb-4be1-9428-243fa73ad026 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:34.898542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ac4e9-fce6-4f38-9735-aa0581c98483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:34.899509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ac4e9-fce6-4f38-9735-aa0581c98483 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:34.900277 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ac4e9-fce6-4f38-9735-aa0581c98483 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:34.900949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019ac4e9-fce6-4f38-9735-aa0581c98483 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:34.901818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ac4e9-fce6-4f38-9735-aa0581c98483 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:34.902421 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ac4e9-fce6-4f38-9735-aa0581c98483 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:34.904684 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019ac4e9-fce6-4f38-9735-aa0581c98483 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:34.911842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6d4b4-3935-4929-b0e9-4f861b9e1929 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:34.912526 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6d4b4-3935-4929-b0e9-4f861b9e1929 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:34.912869 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6d4b4-3935-4929-b0e9-4f861b9e1929 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:34.913158 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c6d4b4-3935-4929-b0e9-4f861b9e1929 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:34.921528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 324/659] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:34.923275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ac4e9-fce6-4f38-9735-aa0581c98483 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:34.992906 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6d4b4-3935-4929-b0e9-4f861b9e1929 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:34.994079 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c6d4b4-3935-4929-b0e9-4f861b9e1929 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:35.038326 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019ac4e9-fce6-4f38-9735-aa0581c98483 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:35.084361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afabf2-2644-4370-b934-6fd3cdf24aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:35.084361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afabf2-2644-4370-b934-6fd3cdf24aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:35.084361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afabf2-2644-4370-b934-6fd3cdf24aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:35.084361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11afabf2-2644-4370-b934-6fd3cdf24aa6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:35.089604 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afabf2-2644-4370-b934-6fd3cdf24aa6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:35.091084 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11afabf2-2644-4370-b934-6fd3cdf24aa6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:35.096894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:35.106286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-11afabf2-2644-4370-b934-6fd3cdf24aa6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 19:16:35.106286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:35.106286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:35.106286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:35.106286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:35.106286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:35.106286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:35.106286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:35.106286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:35.106286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:35.106286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:35.106286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:35.106286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:35.106286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:35.106286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:35.106286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:35.114451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:35.115466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:35.115466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:35.115466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:35.115466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:35.115466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:35.115466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:35.115466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:35.115466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:35.115466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 15 19:16:35.115466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:35.116023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 336/660] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:35.116103 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 325/661] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:35.116172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6d4b4-3935-4929-b0e9-4f861b9e1929 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:35.116254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afabf2-2644-4370-b934-6fd3cdf24aa6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:35.130173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:35.221506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11afabf2-2644-4370-b934-6fd3cdf24aa6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:35.224547 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c6d4b4-3935-4929-b0e9-4f861b9e1929 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:35.258049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcd3b2-2dfd-4837-91a2-5d42443dad63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:35.258847 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcd3b2-2dfd-4837-91a2-5d42443dad63 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:35.259189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcd3b2-2dfd-4837-91a2-5d42443dad63 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:35.259522 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebdcd3b2-2dfd-4837-91a2-5d42443dad63 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:35.260527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdcd3b2-2dfd-4837-91a2-5d42443dad63 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:35.260995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdcd3b2-2dfd-4837-91a2-5d42443dad63 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:35.262291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0899ead-4b1c-4b35-9083-5edaade7e70b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:35.262572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebdcd3b2-2dfd-4837-91a2-5d42443dad63 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:35.263454 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0899ead-4b1c-4b35-9083-5edaade7e70b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:35.263914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0899ead-4b1c-4b35-9083-5edaade7e70b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:35.264386 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0899ead-4b1c-4b35-9083-5edaade7e70b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:35.272650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0899ead-4b1c-4b35-9083-5edaade7e70b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:35.274484 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0899ead-4b1c-4b35-9083-5edaade7e70b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:35.283399 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 326/662] 10.222.0.40 () {56 vars in 1139 bytes} [Fri Jul 15 19:16:35 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:35.284442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcd3b2-2dfd-4837-91a2-5d42443dad63 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:35.291257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-c0899ead-4b1c-4b35-9083-5edaade7e70b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:35.291257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:35.291257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:35.291257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:35.291257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:35.291257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:35.291257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:35.291257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:35.291257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:35.291257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:35.291257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:35.291257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:35.291257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:35.291257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:35.291257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:35.292171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:35.292171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:35.292171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:35.292171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:35.292171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:35.292171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:35.292171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:35.292171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:35.292171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:35.292171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:35.292171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:35.292171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:35.292171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:35.292171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:35.292171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:35.292171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:35.292171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:35.293069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:35.293069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:35.293069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:35.293069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:35.293069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:35.293069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:35.293069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:35.293069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:35.295748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 337/663] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:35.296965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0899ead-4b1c-4b35-9083-5edaade7e70b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:35.358012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:35.359262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:35.392482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebdcd3b2-2dfd-4837-91a2-5d42443dad63 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:35.411915 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0899ead-4b1c-4b35-9083-5edaade7e70b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:35.428935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb1775-40c1-49e5-9b2e-0f681ad40b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:35.430056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb1775-40c1-49e5-9b2e-0f681ad40b58 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:35.430056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb1775-40c1-49e5-9b2e-0f681ad40b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:35.430412 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fb1775-40c1-49e5-9b2e-0f681ad40b58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:35.442192 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb1775-40c1-49e5-9b2e-0f681ad40b58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:35.443785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fb1775-40c1-49e5-9b2e-0f681ad40b58 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:35.453868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7215439-a2ec-4f18-922c-3ae3ad78dee1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:35.454546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7215439-a2ec-4f18-922c-3ae3ad78dee1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:35.454824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7215439-a2ec-4f18-922c-3ae3ad78dee1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:35.455106 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7215439-a2ec-4f18-922c-3ae3ad78dee1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:35.462389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-38fb1775-40c1-49e5-9b2e-0f681ad40b58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:35.462389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:35.462389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:35.462389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:35.462389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:35.462389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:35.462389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:35.462389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:35.462389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:35.462389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:35.462389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:35.462389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:35.462389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:35.462389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:35.462389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:35.464472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:35.464472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:35.464472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:35.464472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:35.464472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:35.464472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:35.464472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:35.464472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:35.464472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:35.464472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:35.464472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:35.464472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:35.464472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:35.464472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:35.464472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:35.464472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:35.464472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:35.466800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:35.466800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:35.466800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:35.466800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:35.468659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 327/664] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:35.469413 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb1775-40c1-49e5-9b2e-0f681ad40b58 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:35.526729 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7215439-a2ec-4f18-922c-3ae3ad78dee1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:35.528132 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7215439-a2ec-4f18-922c-3ae3ad78dee1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:35.582927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:35.588236 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fb1775-40c1-49e5-9b2e-0f681ad40b58 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:35.613736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:35.629327 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824945e-6929-4a34-a1d4-17d963176b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:35.629999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824945e-6929-4a34-a1d4-17d963176b0a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:35.630286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824945e-6929-4a34-a1d4-17d963176b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:35.630610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1824945e-6929-4a34-a1d4-17d963176b0a None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:35.631460 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824945e-6929-4a34-a1d4-17d963176b0a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:35.631786 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824945e-6929-4a34-a1d4-17d963176b0a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:35.633304 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1824945e-6929-4a34-a1d4-17d963176b0a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:35.639822 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 338/665] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:35.642496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaacbe6-0866-40cf-b928-ddfb82e58c30 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:35.642952 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaacbe6-0866-40cf-b928-ddfb82e58c30 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:35.643873 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbaacbe6-0866-40cf-b928-ddfb82e58c30 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:35.645907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 339/666] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:35.647039 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaacbe6-0866-40cf-b928-ddfb82e58c30 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:35.651366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 328/667] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:35.652253 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824945e-6929-4a34-a1d4-17d963176b0a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:35.758678 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1824945e-6929-4a34-a1d4-17d963176b0a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:35.761640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbaacbe6-0866-40cf-b928-ddfb82e58c30 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:35.795719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a84da-cf23-4d66-96c3-545dc470f22e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:35.796542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a84da-cf23-4d66-96c3-545dc470f22e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:35.796892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a84da-cf23-4d66-96c3-545dc470f22e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:35.797196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7a84da-cf23-4d66-96c3-545dc470f22e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:35.800807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f49d71-83f8-4c5a-b9d3-e88f5fcf89fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:35.801695 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f49d71-83f8-4c5a-b9d3-e88f5fcf89fb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:35.802157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f49d71-83f8-4c5a-b9d3-e88f5fcf89fb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:35.802607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f49d71-83f8-4c5a-b9d3-e88f5fcf89fb None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:35.803541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f49d71-83f8-4c5a-b9d3-e88f5fcf89fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:35.804174 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f49d71-83f8-4c5a-b9d3-e88f5fcf89fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:35.805541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f49d71-83f8-4c5a-b9d3-e88f5fcf89fb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:35.807950 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a84da-cf23-4d66-96c3-545dc470f22e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:35.809423 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca7a84da-cf23-4d66-96c3-545dc470f22e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:35.818583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 340/668] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:35.820076 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcda40-dfff-4181-8a77-f4bcbcd71e89 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:35.820360 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcda40-dfff-4181-8a77-f4bcbcd71e89 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:35.820634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcda40-dfff-4181-8a77-f4bcbcd71e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:35.832499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ca7a84da-cf23-4d66-96c3-545dc470f22e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:35.832499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:35.832499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:35.832499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:35.832499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:35.832499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:35.832499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:35.832499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:35.832499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:35.832499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:35.832499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:35.832499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:35.832499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:35.832499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:35.832499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:35.833475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:35.833475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:35.833475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:35.833475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:35.833475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:35.833475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:35.833475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:35.833475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:35.833475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:35.833475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:35.833475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:35.833475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:35.833475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:35.833475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:35.833475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:35.833475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:35.833475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:35.834397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:35.834397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:35.834397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:35.834397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:35.834397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 329/669] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:35.835683 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a84da-cf23-4d66-96c3-545dc470f22e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:35.844265 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d9fcda40-dfff-4181-8a77-f4bcbcd71e89 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:35.845472 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d9fcda40-dfff-4181-8a77-f4bcbcd71e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:35.854416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:35.875395 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:35.916835 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 341/670] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:35.917670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcda40-dfff-4181-8a77-f4bcbcd71e89 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:35.952298 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7a84da-cf23-4d66-96c3-545dc470f22e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:35.987104 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b29ee7-e003-461c-b196-0d27924774c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:35.987747 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b29ee7-e003-461c-b196-0d27924774c1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:35.988037 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b29ee7-e003-461c-b196-0d27924774c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:35.988313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b29ee7-e003-461c-b196-0d27924774c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:35.989149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b29ee7-e003-461c-b196-0d27924774c1 None admin] RBAC: Adding query filter params (role.id=579726a957a7468abecab3fbdb4351a9, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=2352b5c2aa664bf0a7e321ff3a5038fd) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:35.989458 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b29ee7-e003-461c-b196-0d27924774c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:35.990943 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b29ee7-e003-461c-b196-0d27924774c1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:35.996889 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 330/671] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:35 2022] GET /identity/v3/role_assignments?user.id=2352b5c2aa664bf0a7e321ff3a5038fd&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=579726a957a7468abecab3fbdb4351a9 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:35.999756 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b29ee7-e003-461c-b196-0d27924774c1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:36.020468 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcda40-dfff-4181-8a77-f4bcbcd71e89 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:36.065233 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b98b9bad-5801-4847-a6b5-19600f256444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:36.065964 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b9bad-5801-4847-a6b5-19600f256444 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:36.066242 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b9bad-5801-4847-a6b5-19600f256444 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:36.066518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b98b9bad-5801-4847-a6b5-19600f256444 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:36.077723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b9bad-5801-4847-a6b5-19600f256444 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:36.079374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b98b9bad-5801-4847-a6b5-19600f256444 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:36.094982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-b98b9bad-5801-4847-a6b5-19600f256444 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:36.094982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:36.094982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:36.094982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:36.094982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:36.094982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:36.094982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:36.094982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:36.094982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:36.094982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:36.094982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:36.094982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:36.094982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:36.094982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:36.094982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:36.095977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:36.095977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:36.095977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:36.095977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:36.095977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:36.095977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:36.095977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:36.095977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:36.095977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:36.095977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:36.095977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:36.095977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:36.095977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:36.095977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:36.095977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:36.095977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:36.095977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:36.096985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:36.096985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:36.096985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:36.096985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:36.096985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:36.096985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:36.096985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:36.096985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:36.096985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 342/672] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:36.098210 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f608c5-701e-4dbc-b4e4-1cce7517ac40 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:36.098497 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f608c5-701e-4dbc-b4e4-1cce7517ac40 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:36.098865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f608c5-701e-4dbc-b4e4-1cce7517ac40 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:36.100270 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 343/673] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:36.103682 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f608c5-701e-4dbc-b4e4-1cce7517ac40 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:36.109578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:36.129663 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:36.134187 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b29ee7-e003-461c-b196-0d27924774c1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:36.177614 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652e477-17b0-48f5-a7d6-210313f38298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:36.178405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652e477-17b0-48f5-a7d6-210313f38298 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:36.178690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652e477-17b0-48f5-a7d6-210313f38298 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:36.179076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4652e477-17b0-48f5-a7d6-210313f38298 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:36.179808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652e477-17b0-48f5-a7d6-210313f38298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:36.180162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652e477-17b0-48f5-a7d6-210313f38298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:36.181546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4652e477-17b0-48f5-a7d6-210313f38298 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:36.196617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 331/674] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:36.197495 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652e477-17b0-48f5-a7d6-210313f38298 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:36.234592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f608c5-701e-4dbc-b4e4-1cce7517ac40 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:36.274985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb00376-225a-4f70-b70d-19dcbf53a03f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:36.275978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb00376-225a-4f70-b70d-19dcbf53a03f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:36.276320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb00376-225a-4f70-b70d-19dcbf53a03f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:36.276657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb00376-225a-4f70-b70d-19dcbf53a03f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:36.288411 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb00376-225a-4f70-b70d-19dcbf53a03f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:36.296977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-eeb00376-225a-4f70-b70d-19dcbf53a03f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:36.296977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:36.296977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:36.296977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:36.296977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:36.296977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:36.296977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:36.296977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:36.296977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:36.296977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:36.296977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:36.296977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:36.296977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:36.296977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:36.296977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:36.296977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:36.298295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:36.298295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:36.298295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:36.298295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:36.298295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:36.298295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:36.298295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:36.298295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:36.298295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:36.298295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:36.298295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:36.298295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:36.298295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:36.298295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:36.298295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:36.298295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:36.299369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:36.299369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:36.299369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:36.299369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:36.299369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:36.299369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:36.299369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:36.299369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:36.299369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:36.299369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:36.299369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:36.299369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:36.300499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 344/675] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:36.301877 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4e22b-6683-4e1c-bac5-84752ee3d702 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:36.302164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4e22b-6683-4e1c-bac5-84752ee3d702 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:36.302439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e4e22b-6683-4e1c-bac5-84752ee3d702 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:36.318303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4652e477-17b0-48f5-a7d6-210313f38298 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:36.319568 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-78e4e22b-6683-4e1c-bac5-84752ee3d702 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:36.320832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-78e4e22b-6683-4e1c-bac5-84752ee3d702 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:36.355235 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08438aa9-a3ce-4f56-93f9-21e463ecb5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:36.356147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08438aa9-a3ce-4f56-93f9-21e463ecb5cf None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:36.356432 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08438aa9-a3ce-4f56-93f9-21e463ecb5cf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:36.356740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08438aa9-a3ce-4f56-93f9-21e463ecb5cf None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:36.357479 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08438aa9-a3ce-4f56-93f9-21e463ecb5cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:36.358295 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08438aa9-a3ce-4f56-93f9-21e463ecb5cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:36.359724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08438aa9-a3ce-4f56-93f9-21e463ecb5cf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:36.377592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 332/676] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:36.377592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08438aa9-a3ce-4f56-93f9-21e463ecb5cf None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:36.390212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:36.398374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:36.401582 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 345/677] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:36.409567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4e22b-6683-4e1c-bac5-84752ee3d702 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:36.491372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08438aa9-a3ce-4f56-93f9-21e463ecb5cf None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:36.521698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e4e22b-6683-4e1c-bac5-84752ee3d702 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:36.527992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9b35a-548d-4430-b756-ee7ca251de2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:36.528790 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9b35a-548d-4430-b756-ee7ca251de2c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:36.529070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9b35a-548d-4430-b756-ee7ca251de2c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:36.529342 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab9b35a-548d-4430-b756-ee7ca251de2c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:36.540037 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9b35a-548d-4430-b756-ee7ca251de2c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:36.541477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab9b35a-548d-4430-b756-ee7ca251de2c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:36.556203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-2ab9b35a-548d-4430-b756-ee7ca251de2c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:36.556203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:36.556203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:36.556203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:36.556203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:36.556203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:36.556203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:36.556203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:36.556203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:36.556203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:36.556203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:36.556203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:36.556203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:36.556203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:36.556203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:36.557159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:36.557159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:36.557159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:36.557159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:36.557159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:36.557159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:36.557159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:36.557159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:36.557159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:36.557159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:36.557159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:36.557159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:36.557159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:36.557159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:36.557159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:36.557159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:36.557159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:36.558059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:36.558059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:36.558059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:36.558059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:36.558059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:36.558059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:36.558059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:36.558059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:36.558059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 333/678] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:36.559007 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9b35a-548d-4430-b756-ee7ca251de2c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:36.565770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebcd33-b2a4-491f-a844-71431da990ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:36.566447 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebcd33-b2a4-491f-a844-71431da990ff None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:36.566733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebcd33-b2a4-491f-a844-71431da990ff None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:36.567039 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ebcd33-b2a4-491f-a844-71431da990ff None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:36.567792 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebcd33-b2a4-491f-a844-71431da990ff None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:36.568101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebcd33-b2a4-491f-a844-71431da990ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:36.569518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ebcd33-b2a4-491f-a844-71431da990ff None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:36.578206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 346/679] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:36.579029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebcd33-b2a4-491f-a844-71431da990ff None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:36.636210 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:36.650314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:36.674211 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab9b35a-548d-4430-b756-ee7ca251de2c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:36.685847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ebcd33-b2a4-491f-a844-71431da990ff None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:36.711204 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09627d07-e37a-4554-a631-8fdcfad14bc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:36.712288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09627d07-e37a-4554-a631-8fdcfad14bc3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:36.712850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09627d07-e37a-4554-a631-8fdcfad14bc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:36.713136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09627d07-e37a-4554-a631-8fdcfad14bc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:36.714245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09627d07-e37a-4554-a631-8fdcfad14bc3 None admin] RBAC: Adding query filter params (role.id=579726a957a7468abecab3fbdb4351a9, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=4776b70a88a04be7bfe6729e16c16647) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:36.714582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09627d07-e37a-4554-a631-8fdcfad14bc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:36.716752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09627d07-e37a-4554-a631-8fdcfad14bc3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:36.723275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc424d7e-a66b-4b32-95b8-358f55b6f52b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:36.724112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc424d7e-a66b-4b32-95b8-358f55b6f52b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:36.724479 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc424d7e-a66b-4b32-95b8-358f55b6f52b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:36.724755 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc424d7e-a66b-4b32-95b8-358f55b6f52b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:36.731298 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 334/680] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:36 2022] GET /identity/v3/role_assignments?user.id=4776b70a88a04be7bfe6729e16c16647&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=579726a957a7468abecab3fbdb4351a9 => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:36.733145 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09627d07-e37a-4554-a631-8fdcfad14bc3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:36.737653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc424d7e-a66b-4b32-95b8-358f55b6f52b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:36.745956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-dc424d7e-a66b-4b32-95b8-358f55b6f52b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:36.745956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:36.745956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:36.745956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:36.745956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:36.745956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:36.745956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:36.745956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:36.745956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:36.745956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:36.745956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:36.745956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:36.745956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:36.745956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:36.745956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:36.745956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:36.747239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:36.747239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:36.747239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:36.747239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:36.747239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:36.747239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:36.747239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:36.747239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:36.747239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:36.747239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:36.747239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:36.747239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:36.747239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:36.747239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:36.747239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:36.747239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:36.748836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:36.748836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:36.748836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:36.748836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:36.748836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:36.748836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:36.748836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:36.748836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:36.748836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:36.748836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:36.748836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:36.748836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:36.756281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 347/681] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:36.757810 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc424d7e-a66b-4b32-95b8-358f55b6f52b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:36.882340 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09627d07-e37a-4554-a631-8fdcfad14bc3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:36.894208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc424d7e-a66b-4b32-95b8-358f55b6f52b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:36.912175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:36.924806 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e3f03-e1c0-4958-969b-e24b34038304 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:36.925568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e3f03-e1c0-4958-969b-e24b34038304 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:36.925750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e3f03-e1c0-4958-969b-e24b34038304 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:36.926023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909e3f03-e1c0-4958-969b-e24b34038304 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:36.928828 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e3f03-e1c0-4958-969b-e24b34038304 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:36.928828 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e3f03-e1c0-4958-969b-e24b34038304 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:36.928828 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909e3f03-e1c0-4958-969b-e24b34038304 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:36.934453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb89c8e-ba88-41fd-951a-40dcd9865915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:36.935358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb89c8e-ba88-41fd-951a-40dcd9865915 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:36.935732 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb89c8e-ba88-41fd-951a-40dcd9865915 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:36.936177 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb89c8e-ba88-41fd-951a-40dcd9865915 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:36.942788 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 335/682] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:36.943442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e3f03-e1c0-4958-969b-e24b34038304 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:36.947260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:36.949813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb89c8e-ba88-41fd-951a-40dcd9865915 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:36.951992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb89c8e-ba88-41fd-951a-40dcd9865915 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:36.973264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-9fb89c8e-ba88-41fd-951a-40dcd9865915 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:36.973264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:36.973264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:36.973264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:36.973264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:36.973264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:36.973264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:36.973264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:36.973264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:36.973264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:36.973264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:36.973264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:36.973264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:36.973264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:36.973264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:36.974434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:36.974434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:36.974434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:36.974434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:36.974434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:36.974434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:36.974434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:36.974434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:36.974434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:36.974434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:36.974434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:36.974434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:36.974434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:36.974434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:36.974434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:36.974434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:36.974434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:36.975592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:36.975592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:36.975592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:36.975592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:36.976118 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 348/683] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:36.978500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb89c8e-ba88-41fd-951a-40dcd9865915 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:37.082342 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909e3f03-e1c0-4958-969b-e24b34038304 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:37.101330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb89c8e-ba88-41fd-951a-40dcd9865915 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:37.126513 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ea194-dc3e-493f-8fe6-7c7402269d5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:37.127470 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ea194-dc3e-493f-8fe6-7c7402269d5f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:37.127765 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ea194-dc3e-493f-8fe6-7c7402269d5f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:37.128044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-272ea194-dc3e-493f-8fe6-7c7402269d5f None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:37.129235 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ea194-dc3e-493f-8fe6-7c7402269d5f None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:37.129552 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ea194-dc3e-493f-8fe6-7c7402269d5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:37.131227 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-272ea194-dc3e-493f-8fe6-7c7402269d5f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:37.142560 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a25a2-1a69-4534-9ce1-26b90e157d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:37.143062 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 336/684] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:37.143915 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a25a2-1a69-4534-9ce1-26b90e157d2f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:37.144026 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ea194-dc3e-493f-8fe6-7c7402269d5f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:37.144520 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a25a2-1a69-4534-9ce1-26b90e157d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:37.144995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91a25a2-1a69-4534-9ce1-26b90e157d2f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:37.146034 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a25a2-1a69-4534-9ce1-26b90e157d2f None admin] RBAC: Adding query filter params (role.id=579726a957a7468abecab3fbdb4351a9, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=c99418232a0848a1b7a1a73966928769) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:37.146795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a25a2-1a69-4534-9ce1-26b90e157d2f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:37.149422 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91a25a2-1a69-4534-9ce1-26b90e157d2f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:37.157822 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 349/685] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:36 2022] GET /identity/v3/role_assignments?user.id=c99418232a0848a1b7a1a73966928769&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=579726a957a7468abecab3fbdb4351a9 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:37.157822 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a25a2-1a69-4534-9ce1-26b90e157d2f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:37.240122 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:37.260553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:37.277643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-272ea194-dc3e-493f-8fe6-7c7402269d5f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:37.325633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72de6fe-ac55-420f-9084-a45143af6a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:37.326389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72de6fe-ac55-420f-9084-a45143af6a4b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:37.326723 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72de6fe-ac55-420f-9084-a45143af6a4b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:37.327267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72de6fe-ac55-420f-9084-a45143af6a4b None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:37.328104 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72de6fe-ac55-420f-9084-a45143af6a4b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:37.328449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72de6fe-ac55-420f-9084-a45143af6a4b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:37.329849 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72de6fe-ac55-420f-9084-a45143af6a4b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:37.344294 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 337/686] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:37.350961 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72de6fe-ac55-420f-9084-a45143af6a4b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:37.391556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91a25a2-1a69-4534-9ce1-26b90e157d2f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:37.438970 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65e9d0-2e3f-4dfb-8cb8-1abacd2791bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:37.439771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65e9d0-2e3f-4dfb-8cb8-1abacd2791bf None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:37.440045 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65e9d0-2e3f-4dfb-8cb8-1abacd2791bf None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:37.440316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65e9d0-2e3f-4dfb-8cb8-1abacd2791bf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:37.454567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65e9d0-2e3f-4dfb-8cb8-1abacd2791bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:37.456394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da65e9d0-2e3f-4dfb-8cb8-1abacd2791bf None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:37.478003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-da65e9d0-2e3f-4dfb-8cb8-1abacd2791bf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:37.478003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:37.478003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:37.478003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:37.478003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:37.478003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:37.478003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:37.478003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:37.478003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:37.478003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:37.478003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:37.478003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:37.478003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:37.478003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:37.478003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:37.479008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:37.479008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:37.479008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:37.479008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:37.479008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:37.479008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:37.479008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:37.479008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:37.479008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:37.479008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:37.479008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:37.479008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:37.479008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:37.479008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:37.479008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:37.479008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:37.479008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:37.480658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:37.480658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:37.480658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:37.480658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:37.480658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 350/687] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:37.485626 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65e9d0-2e3f-4dfb-8cb8-1abacd2791bf None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:37.485904 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72de6fe-ac55-420f-9084-a45143af6a4b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:37.518642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:37.527192 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803fb70-a2c4-4496-81e7-40d84cb6af51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:37.528522 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803fb70-a2c4-4496-81e7-40d84cb6af51 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:37.529047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803fb70-a2c4-4496-81e7-40d84cb6af51 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:37.531143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5803fb70-a2c4-4496-81e7-40d84cb6af51 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:37.540339 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803fb70-a2c4-4496-81e7-40d84cb6af51 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:37.542831 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5803fb70-a2c4-4496-81e7-40d84cb6af51 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:37.564834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-5803fb70-a2c4-4496-81e7-40d84cb6af51 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:16:37.564834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:37.564834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:37.564834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:37.564834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:37.564834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:37.564834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:37.564834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:37.564834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:37.564834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:37.564834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:37.564834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:37.564834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:37.564834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:37.564834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:37.564834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:37.565914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:37.566887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:37.566887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:37.566887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:37.566887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:37.566887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:37.566887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:37.566887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:37.566887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:37.566887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:16:37.566887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:37.569604 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 338/688] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Jul 15 19:16:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:37.574929 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803fb70-a2c4-4496-81e7-40d84cb6af51 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:37.600859 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:37.632466 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65e9d0-2e3f-4dfb-8cb8-1abacd2791bf None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:37.700009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699b7bd-a333-4ee5-9da5-c0dbfda3692c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:37.700594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699b7bd-a333-4ee5-9da5-c0dbfda3692c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:37.700874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699b7bd-a333-4ee5-9da5-c0dbfda3692c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:37.701159 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f699b7bd-a333-4ee5-9da5-c0dbfda3692c None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:37.702407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699b7bd-a333-4ee5-9da5-c0dbfda3692c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:37.702892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699b7bd-a333-4ee5-9da5-c0dbfda3692c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:37.704281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f699b7bd-a333-4ee5-9da5-c0dbfda3692c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:37.731599 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 351/689] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:37.738165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699b7bd-a333-4ee5-9da5-c0dbfda3692c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:37.738674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5803fb70-a2c4-4496-81e7-40d84cb6af51 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:37.776365 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb272a-8ff4-4f0f-9b99-c1b2a4458e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:37.777493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb272a-8ff4-4f0f-9b99-c1b2a4458e89 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:37.778030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb272a-8ff4-4f0f-9b99-c1b2a4458e89 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:37.778506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60eb272a-8ff4-4f0f-9b99-c1b2a4458e89 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:37.780219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb272a-8ff4-4f0f-9b99-c1b2a4458e89 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:37.780754 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb272a-8ff4-4f0f-9b99-c1b2a4458e89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:37.782646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60eb272a-8ff4-4f0f-9b99-c1b2a4458e89 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:37.802064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 339/690] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Jul 15 19:16:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:37.807332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb272a-8ff4-4f0f-9b99-c1b2a4458e89 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:37.859191 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:37.935707 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60eb272a-8ff4-4f0f-9b99-c1b2a4458e89 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:37.940948 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f699b7bd-a333-4ee5-9da5-c0dbfda3692c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:37.976891 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb59ea0-524d-4db5-a5c4-0704d6a0ecfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:37.977628 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb59ea0-524d-4db5-a5c4-0704d6a0ecfd None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:37.978015 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb59ea0-524d-4db5-a5c4-0704d6a0ecfd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:37.978394 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb59ea0-524d-4db5-a5c4-0704d6a0ecfd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:38.057062 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb59ea0-524d-4db5-a5c4-0704d6a0ecfd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:38.059185 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb59ea0-524d-4db5-a5c4-0704d6a0ecfd None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:38.082606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7922e-7b3c-4720-9179-63886ee3d8f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:38.083479 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7922e-7b3c-4720-9179-63886ee3d8f9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:38.083772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7922e-7b3c-4720-9179-63886ee3d8f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:38.084053 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c7922e-7b3c-4720-9179-63886ee3d8f9 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:38.107201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:38.111072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7922e-7b3c-4720-9179-63886ee3d8f9 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:38.112533 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69c7922e-7b3c-4720-9179-63886ee3d8f9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:38.143761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-69c7922e-7b3c-4720-9179-63886ee3d8f9 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:16:38.143761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:38.143761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:38.143761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:38.143761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:38.143761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:38.143761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:38.143761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:38.143761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:38.143761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:38.143761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:38.143761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:38.143761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:38.143761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:38.143761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:38.143761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:38.144898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:38.146163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:38.146163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:38.146163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:38.146163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:38.146163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:38.146163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:38.146163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:38.146163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:38.146163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:16:38.146163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:38.146163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 352/691] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:37 2022] GET /identity/v3/users/swift => generated 83 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:38.156162 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7922e-7b3c-4720-9179-63886ee3d8f9 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:38.169170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:38.173705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 340/692] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:38.179873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb59ea0-524d-4db5-a5c4-0704d6a0ecfd None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:38.290336 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c7922e-7b3c-4720-9179-63886ee3d8f9 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:38.294592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb59ea0-524d-4db5-a5c4-0704d6a0ecfd None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:38.329553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdaf8e7f-c3fe-451a-8b9a-1d31389ac7cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:38.330473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8e7f-c3fe-451a-8b9a-1d31389ac7cf None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:38.330953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8e7f-c3fe-451a-8b9a-1d31389ac7cf None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:38.331383 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdaf8e7f-c3fe-451a-8b9a-1d31389ac7cf None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:38.332327 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aac83d9-5d36-4a81-bcec-a12e23848550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:38.332547 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf8e7f-c3fe-451a-8b9a-1d31389ac7cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:38.332998 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf8e7f-c3fe-451a-8b9a-1d31389ac7cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:38.333447 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac83d9-5d36-4a81-bcec-a12e23848550 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:38.333822 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac83d9-5d36-4a81-bcec-a12e23848550 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:38.334222 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aac83d9-5d36-4a81-bcec-a12e23848550 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:38.335098 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdaf8e7f-c3fe-451a-8b9a-1d31389ac7cf None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:38.349099 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac83d9-5d36-4a81-bcec-a12e23848550 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:38.351137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aac83d9-5d36-4a81-bcec-a12e23848550 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:38.352667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:38.361191 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 353/693] 10.222.0.40 () {56 vars in 1135 bytes} [Fri Jul 15 19:16:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:38.362818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262cd6b-8156-4d70-95b9-a6c242c95b86 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:38.363305 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262cd6b-8156-4d70-95b9-a6c242c95b86 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:38.363727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b262cd6b-8156-4d70-95b9-a6c242c95b86 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:38.365344 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 354/694] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:38.370110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262cd6b-8156-4d70-95b9-a6c242c95b86 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:38.370925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-1aac83d9-5d36-4a81-bcec-a12e23848550 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:38.370925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:38.370925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:38.370925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:38.370925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:38.370925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:38.370925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:38.370925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:38.370925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:38.370925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:38.370925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:38.370925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:38.370925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:38.370925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:38.370925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:38.372486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:38.372486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:38.372486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:38.372486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:38.372486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:38.372486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:38.372486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:38.372486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:38.372486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:38.372486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:38.372486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:38.372486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:38.372486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:38.372486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:38.372486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:38.372486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:38.372486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:38.374372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:38.374372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:38.374372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:38.374372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:38.374372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 341/695] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:38.375692 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9412b7c-7bdb-48bc-931a-e73c8c7f12b1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:38.376043 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9412b7c-7bdb-48bc-931a-e73c8c7f12b1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:38.376390 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9412b7c-7bdb-48bc-931a-e73c8c7f12b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:38.393909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c9412b7c-7bdb-48bc-931a-e73c8c7f12b1 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:38.395282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c9412b7c-7bdb-48bc-931a-e73c8c7f12b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:38.441382 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:38.478784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 342/696] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:38.478784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9412b7c-7bdb-48bc-931a-e73c8c7f12b1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:38.504769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b262cd6b-8156-4d70-95b9-a6c242c95b86 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:38.552285 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7cabe-5de6-417b-9a66-a056cddee55c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:38.553248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7cabe-5de6-417b-9a66-a056cddee55c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:38.553713 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7cabe-5de6-417b-9a66-a056cddee55c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:38.554166 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90b7cabe-5de6-417b-9a66-a056cddee55c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:38.586243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9412b7c-7bdb-48bc-931a-e73c8c7f12b1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:38.613752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:38.626003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efca3a-53ea-40e5-8a2d-a0c3a2c0a065 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:38.629448 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efca3a-53ea-40e5-8a2d-a0c3a2c0a065 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:38.629448 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efca3a-53ea-40e5-8a2d-a0c3a2c0a065 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:38.629448 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1efca3a-53ea-40e5-8a2d-a0c3a2c0a065 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:38.629448 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efca3a-53ea-40e5-8a2d-a0c3a2c0a065 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:38.629738 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7cabe-5de6-417b-9a66-a056cddee55c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:38.629818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efca3a-53ea-40e5-8a2d-a0c3a2c0a065 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:38.631129 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1efca3a-53ea-40e5-8a2d-a0c3a2c0a065 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:38.631695 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90b7cabe-5de6-417b-9a66-a056cddee55c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:38.656830 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 343/697] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:38.657775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efca3a-53ea-40e5-8a2d-a0c3a2c0a065 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:38.708505 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:38.767842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 355/698] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 15 19:16:38.769111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7cabe-5de6-417b-9a66-a056cddee55c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:38.783999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1efca3a-53ea-40e5-8a2d-a0c3a2c0a065 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:38.823618 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed86e84-9054-4cda-8d48-2e9d044a3c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:38.824361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed86e84-9054-4cda-8d48-2e9d044a3c51 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:38.824639 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed86e84-9054-4cda-8d48-2e9d044a3c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:38.824908 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed86e84-9054-4cda-8d48-2e9d044a3c51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:38.837195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed86e84-9054-4cda-8d48-2e9d044a3c51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:38.838777 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed86e84-9054-4cda-8d48-2e9d044a3c51 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:38.858490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-fed86e84-9054-4cda-8d48-2e9d044a3c51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:38.858490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:38.858490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:38.858490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:38.858490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:38.858490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:38.858490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:38.858490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:38.858490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:38.858490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:38.858490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:38.858490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:38.858490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:38.858490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:38.858490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:38.859511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:38.859511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:38.859511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:38.859511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:38.859511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:38.859511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:38.859511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:38.859511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:38.859511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:38.859511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:38.859511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:38.859511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:38.859511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:38.859511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:38.859511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:38.859511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:38.859511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:38.860416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:38.860416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:38.860416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:38.860416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:38.864832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 344/699] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:38.865707 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed86e84-9054-4cda-8d48-2e9d044a3c51 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:38.900818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90b7cabe-5de6-417b-9a66-a056cddee55c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:38.912188 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:38.939158 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a873d3-455f-416d-bfb3-dc8e21454a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:38.939944 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a873d3-455f-416d-bfb3-dc8e21454a46 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:38.940224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a873d3-455f-416d-bfb3-dc8e21454a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:38.940497 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a873d3-455f-416d-bfb3-dc8e21454a46 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:38.947954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a873d3-455f-416d-bfb3-dc8e21454a46 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:38.949397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a873d3-455f-416d-bfb3-dc8e21454a46 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:38.963749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-25a873d3-455f-416d-bfb3-dc8e21454a46 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:38.963749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:38.963749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:38.963749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:38.963749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:38.963749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:38.963749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:38.963749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:38.963749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:38.963749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:38.963749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:38.963749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:38.963749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:38.963749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:38.963749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:38.964698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:38.964698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:38.964698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:38.964698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:38.964698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:38.964698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:38.964698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:38.964698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:38.964698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:38.964698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:38.964698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:38.964698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:38.964698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:38.964698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:38.964698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:38.964698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:38.964698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:38.965629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:38.965629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:38.965629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:38.965629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:38.965629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:38.965629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:38.965629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:38.965629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:38.971692 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 356/700] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:38.972570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a873d3-455f-416d-bfb3-dc8e21454a46 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:38.998691 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:39.005494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed86e84-9054-4cda-8d48-2e9d044a3c51 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:39.056026 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c217f8-2e9f-4ac0-af1a-b79319dc4623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:39.056832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c217f8-2e9f-4ac0-af1a-b79319dc4623 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:39.057111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c217f8-2e9f-4ac0-af1a-b79319dc4623 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:39.057381 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c217f8-2e9f-4ac0-af1a-b79319dc4623 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:39.074720 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c217f8-2e9f-4ac0-af1a-b79319dc4623 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:39.076202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c217f8-2e9f-4ac0-af1a-b79319dc4623 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:39.100555 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a873d3-455f-416d-bfb3-dc8e21454a46 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:39.100748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-84c217f8-2e9f-4ac0-af1a-b79319dc4623 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:39.100748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:39.100748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:39.100748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:39.100748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:39.100748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:39.100748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:39.100748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:39.100748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:39.100748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:39.100748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:39.100748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:39.100748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:39.100748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:39.100748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:39.101705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:39.101705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:39.101705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:39.101705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:39.101705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:39.101705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:39.101705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:39.101705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:39.101705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:39.101705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:39.101705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:39.101705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:39.101705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:39.101705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:39.101705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:39.101705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:39.101705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:39.102655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:39.102655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:39.102655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:39.102655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:39.102927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 345/701] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:39.103710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c217f8-2e9f-4ac0-af1a-b79319dc4623 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:39.141783 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929eff23-88e5-4a86-8782-6e47d86b42fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:39.143116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929eff23-88e5-4a86-8782-6e47d86b42fc None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:39.143116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929eff23-88e5-4a86-8782-6e47d86b42fc None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:39.143116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929eff23-88e5-4a86-8782-6e47d86b42fc None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:39.143744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929eff23-88e5-4a86-8782-6e47d86b42fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:39.144055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929eff23-88e5-4a86-8782-6e47d86b42fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:39.145424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929eff23-88e5-4a86-8782-6e47d86b42fc None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:39.163616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 357/702] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:39.163616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4168cd5-dfb1-45cc-b894-de960822a7bf None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:39.163616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4168cd5-dfb1-45cc-b894-de960822a7bf None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:39.163616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4168cd5-dfb1-45cc-b894-de960822a7bf None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:39.163616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 358/703] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:39.163616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4168cd5-dfb1-45cc-b894-de960822a7bf None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:39.208774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:39.222071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c217f8-2e9f-4ac0-af1a-b79319dc4623 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:39.252440 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:39.257864 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b9c77-149e-45ad-bf2c-acf171c56047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:39.258522 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b9c77-149e-45ad-bf2c-acf171c56047 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:39.258833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b9c77-149e-45ad-bf2c-acf171c56047 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:39.259113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a72b9c77-149e-45ad-bf2c-acf171c56047 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:39.259907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b9c77-149e-45ad-bf2c-acf171c56047 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:39.260214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b9c77-149e-45ad-bf2c-acf171c56047 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:39.261711 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a72b9c77-149e-45ad-bf2c-acf171c56047 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:39.274602 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4168cd5-dfb1-45cc-b894-de960822a7bf None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:39.279719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 346/704] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:39.279719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b9c77-149e-45ad-bf2c-acf171c56047 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:39.320213 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20e5626-5c74-4c7e-ace6-23968a6f8007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:39.320979 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e5626-5c74-4c7e-ace6-23968a6f8007 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:39.321152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e5626-5c74-4c7e-ace6-23968a6f8007 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:39.321414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20e5626-5c74-4c7e-ace6-23968a6f8007 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:39.322134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e5626-5c74-4c7e-ace6-23968a6f8007 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:39.322438 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e5626-5c74-4c7e-ace6-23968a6f8007 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:39.323943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20e5626-5c74-4c7e-ace6-23968a6f8007 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:39.340260 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 359/705] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:39.340260 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b6596-b86d-45af-b584-6d03e6db4b20 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:39.340260 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b6596-b86d-45af-b584-6d03e6db4b20 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:39.340260 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171b6596-b86d-45af-b584-6d03e6db4b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:39.355560 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-171b6596-b86d-45af-b584-6d03e6db4b20 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:39.356737 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-171b6596-b86d-45af-b584-6d03e6db4b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:39.394942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a72b9c77-149e-45ad-bf2c-acf171c56047 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:39.432878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 360/706] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:39.433725 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b6596-b86d-45af-b584-6d03e6db4b20 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:39.437685 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9aca3-2661-42e8-a9d8-7d562fe6ac7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:39.439211 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9aca3-2661-42e8-a9d8-7d562fe6ac7d None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:39.439704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9aca3-2661-42e8-a9d8-7d562fe6ac7d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:39.440208 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a9aca3-2661-42e8-a9d8-7d562fe6ac7d None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:39.441134 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9aca3-2661-42e8-a9d8-7d562fe6ac7d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:39.443419 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a9aca3-2661-42e8-a9d8-7d562fe6ac7d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:39.505908 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:39.536936 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171b6596-b86d-45af-b584-6d03e6db4b20 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:39.554338 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 347/707] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:16:39 2022] POST /identity/v3/users => generated 254 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:39.555523 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9aca3-2661-42e8-a9d8-7d562fe6ac7d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:39.560307 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:39.589101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42addcec-8eb6-4073-8569-00ee7e25a079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:39.589778 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42addcec-8eb6-4073-8569-00ee7e25a079 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:39.590396 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42addcec-8eb6-4073-8569-00ee7e25a079 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:39.590640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42addcec-8eb6-4073-8569-00ee7e25a079 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:39.592432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42addcec-8eb6-4073-8569-00ee7e25a079 None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=850a32e590154968bfbbfc404450b70a) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:39.592432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42addcec-8eb6-4073-8569-00ee7e25a079 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:39.593954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42addcec-8eb6-4073-8569-00ee7e25a079 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:39.610280 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 361/708] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:39 2022] GET /identity/v3/role_assignments?user.id=850a32e590154968bfbbfc404450b70a&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:39.610280 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42addcec-8eb6-4073-8569-00ee7e25a079 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:39.725383 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a9aca3-2661-42e8-a9d8-7d562fe6ac7d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:39.760424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42addcec-8eb6-4073-8569-00ee7e25a079 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:39.772485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cba1c46-4c29-4fff-b5a4-6b046b6c45f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:39.774143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba1c46-4c29-4fff-b5a4-6b046b6c45f2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:39.774143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba1c46-4c29-4fff-b5a4-6b046b6c45f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:39.774143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cba1c46-4c29-4fff-b5a4-6b046b6c45f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:39.784068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba1c46-4c29-4fff-b5a4-6b046b6c45f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:39.785607 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cba1c46-4c29-4fff-b5a4-6b046b6c45f2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:39.803093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-0cba1c46-4c29-4fff-b5a4-6b046b6c45f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:39.803093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:39.803093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:39.803093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:39.803093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:39.803093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:39.803093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:39.803093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:39.803093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:39.803093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:39.803093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:39.803093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:39.803093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:39.803093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:39.803093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:39.804063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:39.804063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:39.804063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:39.804063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:39.804063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:39.804063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:39.804063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:39.804063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:39.804063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:39.804063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:39.804063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:39.804063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:39.804063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:39.804063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:39.804063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:39.804063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:39.804063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:39.804962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:39.804962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:39.804962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:39.804962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:39.804962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:39.804962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:39.804962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:39.804962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:39.804962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 348/709] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:39.805927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc3206-6330-4367-99d8-73f01ca7f42e None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:39.805927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc3206-6330-4367-99d8-73f01ca7f42e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:39.806096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babc3206-6330-4367-99d8-73f01ca7f42e None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:39.809463 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 349/710] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:39.812310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc3206-6330-4367-99d8-73f01ca7f42e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:39.846866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7abe8f3-d49e-47e7-b328-8f6eff903ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:39.846866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abe8f3-d49e-47e7-b328-8f6eff903ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:39.846866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abe8f3-d49e-47e7-b328-8f6eff903ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:39.846866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7abe8f3-d49e-47e7-b328-8f6eff903ce4 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:39.847260 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abe8f3-d49e-47e7-b328-8f6eff903ce4 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:39.847360 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7abe8f3-d49e-47e7-b328-8f6eff903ce4 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:39.849914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:39.864374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-e7abe8f3-d49e-47e7-b328-8f6eff903ce4 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:16:39.864374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:39.864374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:16:39.864374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:16:39.864374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:16:39.864374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:16:39.864374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:16:39.864374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:39.864374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:16:39.864374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:39.864374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:16:39.864374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:39.864374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:39.864374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:39.864374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:39.864374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:39.865402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:39.865402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:39.865402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:39.865402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:39.865402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:39.865402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:39.865402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:39.865402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:16:39.865402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:16:39.865402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:16:39.865402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:16:39.865402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:39.865402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:39.865402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:39.865402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:39.865402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:39.866248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:39.866248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:39.866248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:39.866248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:39.866248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:39.866248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:39.866248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:39.866248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:39.866248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:39.866248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:39.866248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:39.866248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:16:39.866248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:39.866248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:16:39.866248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:39.866248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 362/711] 10.222.0.40 () {56 vars in 1129 bytes} [Fri Jul 15 19:16:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:39.867610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876ae77-0f57-4f4b-a89d-0d267586e989 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:39.868305 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876ae77-0f57-4f4b-a89d-0d267586e989 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:39.870463 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9876ae77-0f57-4f4b-a89d-0d267586e989 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:39.889712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-9876ae77-0f57-4f4b-a89d-0d267586e989 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:39.891463 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9876ae77-0f57-4f4b-a89d-0d267586e989 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:39.894531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:39.944192 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babc3206-6330-4367-99d8-73f01ca7f42e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:39.980516 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 363/712] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:39.981459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876ae77-0f57-4f4b-a89d-0d267586e989 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:40.008088 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4597344-e5b8-4261-8aa5-43d9e4e22cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:40.008766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4597344-e5b8-4261-8aa5-43d9e4e22cef None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.009044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4597344-e5b8-4261-8aa5-43d9e4e22cef None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.009315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4597344-e5b8-4261-8aa5-43d9e4e22cef None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.010116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4597344-e5b8-4261-8aa5-43d9e4e22cef None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:40.010427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4597344-e5b8-4261-8aa5-43d9e4e22cef None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:40.011919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4597344-e5b8-4261-8aa5-43d9e4e22cef None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:40.030082 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 350/713] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:40.031120 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4597344-e5b8-4261-8aa5-43d9e4e22cef None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:40.100340 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9876ae77-0f57-4f4b-a89d-0d267586e989 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:40.140142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4597344-e5b8-4261-8aa5-43d9e4e22cef None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:40.146771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032d78c-4ac1-4fa2-859d-97c668195803 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:40.147458 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032d78c-4ac1-4fa2-859d-97c668195803 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.148282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032d78c-4ac1-4fa2-859d-97c668195803 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.148572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032d78c-4ac1-4fa2-859d-97c668195803 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.149299 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032d78c-4ac1-4fa2-859d-97c668195803 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:40.149639 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032d78c-4ac1-4fa2-859d-97c668195803 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:40.151891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032d78c-4ac1-4fa2-859d-97c668195803 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:40.159107 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:40.163219 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 364/714] 10.222.0.40 () {56 vars in 1124 bytes} [Fri Jul 15 19:16:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:40.164533 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032d78c-4ac1-4fa2-859d-97c668195803 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:40.173862 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:40.186631 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdeb67-f625-4e5f-b32d-151bf771b711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:40.188133 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdeb67-f625-4e5f-b32d-151bf771b711 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.188592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdeb67-f625-4e5f-b32d-151bf771b711 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.188967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abdeb67-f625-4e5f-b32d-151bf771b711 None admin] PATH_INFO: `/v3/services/network` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.189783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abdeb67-f625-4e5f-b32d-151bf771b711 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:40.191488 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abdeb67-f625-4e5f-b32d-151bf771b711 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:40.208124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-1abdeb67-f625-4e5f-b32d-151bf771b711 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:16:40.208124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:40.208124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:16:40.208124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:16:40.208124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:16:40.208124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:16:40.208124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:16:40.208124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:40.208124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:16:40.208124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:40.208124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:16:40.208124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:40.208124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:40.208124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:40.208124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:40.208124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:40.208124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:40.209995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:40.209995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:40.209995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:40.209995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:40.209995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:40.209995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:40.209995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:16:40.209995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:16:40.209995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:16:40.209995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:16:40.209995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:40.209995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:40.209995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:40.209995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:40.209995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:40.209995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:40.211086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:40.211086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:40.211086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:40.211086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:40.211086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:40.211086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:40.211086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:40.211086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:40.211086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:40.211086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:40.211086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:16:40.211086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:40.211086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:16:40.211086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:40.215767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 351/715] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:40 2022] GET /identity/v3/services/network => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:40.216977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdeb67-f625-4e5f-b32d-151bf771b711 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:40.294702 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032d78c-4ac1-4fa2-859d-97c668195803 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:40.339286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcc903-4791-4673-9e65-aebb2d750602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:40.341384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcc903-4791-4673-9e65-aebb2d750602 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.342479 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcc903-4791-4673-9e65-aebb2d750602 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.343123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dcc903-4791-4673-9e65-aebb2d750602 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.344251 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcc903-4791-4673-9e65-aebb2d750602 None admin] RBAC: Adding query filter params (role.id=579726a957a7468abecab3fbdb4351a9, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=0402e1bd20b042cdbdcb890616b22726) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:40.344943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcc903-4791-4673-9e65-aebb2d750602 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:40.347298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32dcc903-4791-4673-9e65-aebb2d750602 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:40.354636 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abdeb67-f625-4e5f-b32d-151bf771b711 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:40.356596 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 365/716] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:40 2022] GET /identity/v3/role_assignments?user.id=0402e1bd20b042cdbdcb890616b22726&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=579726a957a7468abecab3fbdb4351a9 => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:40.357666 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcc903-4791-4673-9e65-aebb2d750602 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:40.431379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:40.441895 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310d49d-b9a9-4ec8-bfde-3d3bf14e332b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:40.442703 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310d49d-b9a9-4ec8-bfde-3d3bf14e332b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.443129 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310d49d-b9a9-4ec8-bfde-3d3bf14e332b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.443416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2310d49d-b9a9-4ec8-bfde-3d3bf14e332b None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.444228 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310d49d-b9a9-4ec8-bfde-3d3bf14e332b None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:40.444442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310d49d-b9a9-4ec8-bfde-3d3bf14e332b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:40.445979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2310d49d-b9a9-4ec8-bfde-3d3bf14e332b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:40.461208 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 352/717] 10.222.0.40 () {56 vars in 1124 bytes} [Fri Jul 15 19:16:40 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:40.486500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dcc903-4791-4673-9e65-aebb2d750602 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:40.552902 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bf9acf-2b64-4639-9bf6-5a9d699ec8d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:40.553917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9acf-2b64-4639-9bf6-5a9d699ec8d6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.554389 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9acf-2b64-4639-9bf6-5a9d699ec8d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.554942 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bf9acf-2b64-4639-9bf6-5a9d699ec8d6 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.555857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf9acf-2b64-4639-9bf6-5a9d699ec8d6 None admin] RBAC: Adding query filter params (name=network) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:40.556354 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf9acf-2b64-4639-9bf6-5a9d699ec8d6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:40.557940 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bf9acf-2b64-4639-9bf6-5a9d699ec8d6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:40.567064 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 366/718] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Jul 15 19:16:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:40.573078 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310d49d-b9a9-4ec8-bfde-3d3bf14e332b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:40.658773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:40.712298 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2310d49d-b9a9-4ec8-bfde-3d3bf14e332b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:40.752439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b4c7ce-43a9-487d-8685-3493ba2f2362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:40.753114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4c7ce-43a9-487d-8685-3493ba2f2362 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:40.753397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4c7ce-43a9-487d-8685-3493ba2f2362 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:40.753670 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b4c7ce-43a9-487d-8685-3493ba2f2362 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:40.754389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4c7ce-43a9-487d-8685-3493ba2f2362 None admin] RBAC: Adding query filter params (type=network) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:40.754696 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4c7ce-43a9-487d-8685-3493ba2f2362 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:40.756095 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b4c7ce-43a9-487d-8685-3493ba2f2362 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:40.767046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 353/719] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Jul 15 19:16:40 2022] GET /identity/v3/services?type=network => generated 124 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:41.946373 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b403d-bcc5-44f2-bd55-f35af8137533 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:41.946940 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b403d-bcc5-44f2-bd55-f35af8137533 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:41.947019 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949b403d-bcc5-44f2-bd55-f35af8137533 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:41.948672 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 367/720] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:41.954878 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adcc6b-15d5-4fb0-912c-ffc02a8ea324 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:41.955358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adcc6b-15d5-4fb0-912c-ffc02a8ea324 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:41.955434 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42adcc6b-15d5-4fb0-912c-ffc02a8ea324 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:41.970288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf74f7-5748-473f-b3df-c704b9ea94e2 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:41.970621 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf74f7-5748-473f-b3df-c704b9ea94e2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:41.970884 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecf74f7-5748-473f-b3df-c704b9ea94e2 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:41.972552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 368/721] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:41.977900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ee673-f462-4186-87a6-8af0cc1aae2d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:41.978189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ee673-f462-4186-87a6-8af0cc1aae2d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:41.978471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864ee673-f462-4186-87a6-8af0cc1aae2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:41.985995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-42adcc6b-15d5-4fb0-912c-ffc02a8ea324 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:41.988171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-42adcc6b-15d5-4fb0-912c-ffc02a8ea324 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:42.009797 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-864ee673-f462-4186-87a6-8af0cc1aae2d None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:42.011018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-864ee673-f462-4186-87a6-8af0cc1aae2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:42.140512 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 354/722] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:42.145412 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 369/723] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 15 19:16:42.168849 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adcc6b-15d5-4fb0-912c-ffc02a8ea324 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:42.173188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ee673-f462-4186-87a6-8af0cc1aae2d None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:42.239824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:42.288075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:42.302481 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864ee673-f462-4186-87a6-8af0cc1aae2d None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:42.340030 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f9c51-99c0-43c9-81aa-b043ba85d951 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:42.340887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f9c51-99c0-43c9-81aa-b043ba85d951 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:42.341182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f9c51-99c0-43c9-81aa-b043ba85d951 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:42.341466 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24f9c51-99c0-43c9-81aa-b043ba85d951 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:42.353958 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24f9c51-99c0-43c9-81aa-b043ba85d951 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:42.362216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-d24f9c51-99c0-43c9-81aa-b043ba85d951 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:42.362216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:42.362216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:42.362216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:42.362216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:42.362216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:42.362216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:42.362216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:42.362216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:42.362216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:42.362216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:42.362216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:42.362216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:42.362216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:42.362216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:42.362216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:42.363377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:42.363377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:42.363377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:42.363377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:42.363377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:42.363377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:42.363377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:42.363377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:42.363377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:42.363377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:42.363377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:42.363377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:42.363377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:42.363377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:42.363377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:42.363377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:42.364427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:42.364427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:42.364427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:42.364427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:42.364427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:42.364427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:42.364427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:42.364427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:42.364427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:42.364427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:42.364427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:42.364427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:42.364427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 370/724] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:42.371261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f9c51-99c0-43c9-81aa-b043ba85d951 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:42.460773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42adcc6b-15d5-4fb0-912c-ffc02a8ea324 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:42.518302 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d2815-3eb2-4813-aa7d-2f589bfa6180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:42.519317 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d2815-3eb2-4813-aa7d-2f589bfa6180 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:42.519693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d2815-3eb2-4813-aa7d-2f589bfa6180 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:42.519997 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932d2815-3eb2-4813-aa7d-2f589bfa6180 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:42.520578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24f9c51-99c0-43c9-81aa-b043ba85d951 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:42.535723 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932d2815-3eb2-4813-aa7d-2f589bfa6180 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:42.546952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-932d2815-3eb2-4813-aa7d-2f589bfa6180 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:42.546952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:42.546952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:42.546952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:42.546952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:42.546952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:42.546952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:42.546952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:42.546952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:42.546952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:42.546952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:42.546952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:42.546952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:42.546952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:42.546952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:42.546952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:42.548075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:42.548075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:42.548075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:42.548075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:42.548075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:42.548075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:42.548075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:42.548075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:42.548075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:42.548075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:42.548075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:42.548075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:42.548075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:42.548075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:42.548075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:42.548075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:42.548941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:42.548941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:42.548941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:42.548941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:42.548941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:42.548941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:42.548941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:42.548941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:42.548941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:42.548941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:42.548941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:42.548941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:42.548941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 355/725] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:42 2022] GET /identity/v3/roles/service => generated 85 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:42.556170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:42.562887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d2815-3eb2-4813-aa7d-2f589bfa6180 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:42.608820 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be363c-5192-4c50-a96d-13c35ed19d88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:42.609555 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be363c-5192-4c50-a96d-13c35ed19d88 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:42.609840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be363c-5192-4c50-a96d-13c35ed19d88 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:42.610113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57be363c-5192-4c50-a96d-13c35ed19d88 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:42.610897 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be363c-5192-4c50-a96d-13c35ed19d88 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:42.611211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be363c-5192-4c50-a96d-13c35ed19d88 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:42.612607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57be363c-5192-4c50-a96d-13c35ed19d88 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:42.631235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 371/726] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:42.642586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be363c-5192-4c50-a96d-13c35ed19d88 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:42.758280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932d2815-3eb2-4813-aa7d-2f589bfa6180 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:42.790581 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:42.824493 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57be363c-5192-4c50-a96d-13c35ed19d88 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:42.868447 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b20ff-152d-4cef-8224-011fa3d0354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:42.869244 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b20ff-152d-4cef-8224-011fa3d0354d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:42.869530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b20ff-152d-4cef-8224-011fa3d0354d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:42.869804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040b20ff-152d-4cef-8224-011fa3d0354d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:42.876214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cddcda-c40a-407c-a6c2-78cb58dcac1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:42.876894 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cddcda-c40a-407c-a6c2-78cb58dcac1e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:42.877171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cddcda-c40a-407c-a6c2-78cb58dcac1e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:42.877443 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9cddcda-c40a-407c-a6c2-78cb58dcac1e None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:42.878203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cddcda-c40a-407c-a6c2-78cb58dcac1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:42.878506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cddcda-c40a-407c-a6c2-78cb58dcac1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:42.879937 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9cddcda-c40a-407c-a6c2-78cb58dcac1e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:42.898156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b20ff-152d-4cef-8224-011fa3d0354d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:42.899651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040b20ff-152d-4cef-8224-011fa3d0354d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:42.904044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 356/727] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:42.911514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cddcda-c40a-407c-a6c2-78cb58dcac1e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:42.926573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-040b20ff-152d-4cef-8224-011fa3d0354d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:42.926573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:42.926573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:42.926573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:42.926573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:42.926573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:42.926573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:42.926573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:42.926573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:42.926573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:42.926573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:42.926573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:42.926573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:42.926573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:42.926573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:42.927581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:42.927581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:42.927581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:42.927581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:42.927581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:42.927581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:42.927581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:42.927581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:42.927581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:42.927581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:42.927581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:42.927581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:42.927581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:42.927581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:42.927581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:42.927581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:42.927581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:42.928471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:42.928471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:42.928471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:42.928471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:42.933556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 372/728] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:42.939807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b20ff-152d-4cef-8224-011fa3d0354d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:43.000143 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:43.119941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040b20ff-152d-4cef-8224-011fa3d0354d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:43.161917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026991a6-0ac4-414b-bb16-09f9a2215cef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:43.162601 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026991a6-0ac4-414b-bb16-09f9a2215cef None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:43.162918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026991a6-0ac4-414b-bb16-09f9a2215cef None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:43.163192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026991a6-0ac4-414b-bb16-09f9a2215cef None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:43.163939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026991a6-0ac4-414b-bb16-09f9a2215cef None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:43.164249 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026991a6-0ac4-414b-bb16-09f9a2215cef None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:43.165648 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026991a6-0ac4-414b-bb16-09f9a2215cef None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:43.180232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 373/729] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:43.182787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d5664-eea7-45b5-8c72-ae753fd5b9e8 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:43.182787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d5664-eea7-45b5-8c72-ae753fd5b9e8 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:43.182787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d5664-eea7-45b5-8c72-ae753fd5b9e8 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:43.183730 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 374/730] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:43.184950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d1a20-40ff-4419-b20c-e74d6c9c96f7 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:43.185258 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d1a20-40ff-4419-b20c-e74d6c9c96f7 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:43.185598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91d1a20-40ff-4419-b20c-e74d6c9c96f7 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:43.187241 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 375/731] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:43.187988 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d1a20-40ff-4419-b20c-e74d6c9c96f7 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:43.252210 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9cddcda-c40a-407c-a6c2-78cb58dcac1e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:43.288281 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b066a57-bd38-45c8-b302-9c92272437cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:43.289074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b066a57-bd38-45c8-b302-9c92272437cd None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:43.289354 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b066a57-bd38-45c8-b302-9c92272437cd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:43.289634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b066a57-bd38-45c8-b302-9c92272437cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:43.291650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:43.300290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b066a57-bd38-45c8-b302-9c92272437cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:43.301794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b066a57-bd38-45c8-b302-9c92272437cd None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:43.309975 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91d1a20-40ff-4419-b20c-e74d6c9c96f7 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:43.322010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-3b066a57-bd38-45c8-b302-9c92272437cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:43.322010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:43.322010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:43.322010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:43.322010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:43.322010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:43.322010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:43.322010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:43.322010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:43.322010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:43.322010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:43.322010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:43.322010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:43.322010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:43.322010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:43.322952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:43.322952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:43.322952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:43.322952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:43.322952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:43.322952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:43.322952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:43.322952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:43.322952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:43.322952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:43.322952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:43.322952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:43.322952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:43.322952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:43.322952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:43.322952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:43.322952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:43.324289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:43.324289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:43.324289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:43.324289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:43.324289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 357/732] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 411 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:43.324289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ad302-44ba-4b2d-820f-a02cb8edc7e0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:43.324289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ad302-44ba-4b2d-820f-a02cb8edc7e0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:43.324289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571ad302-44ba-4b2d-820f-a02cb8edc7e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:43.343632 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-571ad302-44ba-4b2d-820f-a02cb8edc7e0 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:43.344913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-571ad302-44ba-4b2d-820f-a02cb8edc7e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:43.351193 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaa603dd-5c9a-46c0-814d-67970b167b27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:43.351988 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa603dd-5c9a-46c0-814d-67970b167b27 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:43.352267 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa603dd-5c9a-46c0-814d-67970b167b27 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:43.352534 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa603dd-5c9a-46c0-814d-67970b167b27 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:43.360078 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:43.360254 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa603dd-5c9a-46c0-814d-67970b167b27 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:43.361621 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaa603dd-5c9a-46c0-814d-67970b167b27 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:43.376834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-aaa603dd-5c9a-46c0-814d-67970b167b27 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:16:43.376834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:43.376834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:43.376834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:43.376834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:43.376834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:43.376834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:43.376834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:43.376834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:43.376834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:43.376834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:43.376834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:43.376834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:43.376834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:43.376834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:43.376834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:43.377887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:43.379157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:43.379157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:43.379157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:43.379157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:43.379157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:43.379157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:43.379157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:43.379157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:43.379157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:16:43.379157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:43.379157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 376/733] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Jul 15 19:16:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:43.379773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffcccc-459b-4268-b8fe-18b0b2613ffb None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:43.379773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffcccc-459b-4268-b8fe-18b0b2613ffb None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:43.379911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acffcccc-459b-4268-b8fe-18b0b2613ffb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:43.399446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-acffcccc-459b-4268-b8fe-18b0b2613ffb None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:43.400806 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-acffcccc-459b-4268-b8fe-18b0b2613ffb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:43.420682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 358/734] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:43.422110 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9327df-ca2a-40ca-a958-a1697364f730 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:43.422314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9327df-ca2a-40ca-a958-a1697364f730 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:43.422588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9327df-ca2a-40ca-a958-a1697364f730 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:43.423860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 359/735] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:43.424552 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9327df-ca2a-40ca-a958-a1697364f730 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:43.484756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 377/736] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:43.485647 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffcccc-459b-4268-b8fe-18b0b2613ffb None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:43.546646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9327df-ca2a-40ca-a958-a1697364f730 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:43.567796 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:43.589429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ae2f55-bdef-41e0-af11-4010cea9912a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:43.589429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae2f55-bdef-41e0-af11-4010cea9912a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:43.589429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae2f55-bdef-41e0-af11-4010cea9912a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:43.589429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ae2f55-bdef-41e0-af11-4010cea9912a None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:43.589993 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae2f55-bdef-41e0-af11-4010cea9912a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:43.589993 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae2f55-bdef-41e0-af11-4010cea9912a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:43.589993 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ae2f55-bdef-41e0-af11-4010cea9912a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:43.594001 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acffcccc-459b-4268-b8fe-18b0b2613ffb None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:43.601752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 360/737] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:43.603073 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2eb772-cd60-4246-8db1-fc7c4ce2d6f9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:43.603358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2eb772-cd60-4246-8db1-fc7c4ce2d6f9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:43.603627 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2eb772-cd60-4246-8db1-fc7c4ce2d6f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:43.620897 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fa2eb772-cd60-4246-8db1-fc7c4ce2d6f9 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:43.622096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fa2eb772-cd60-4246-8db1-fc7c4ce2d6f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:43.626152 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:43.636892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8aeb7-f96b-4bf2-a7ec-0400a9cfa09c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:43.637566 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8aeb7-f96b-4bf2-a7ec-0400a9cfa09c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:43.637849 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8aeb7-f96b-4bf2-a7ec-0400a9cfa09c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:43.638262 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c8aeb7-f96b-4bf2-a7ec-0400a9cfa09c None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:43.639247 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8aeb7-f96b-4bf2-a7ec-0400a9cfa09c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:43.639485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8aeb7-f96b-4bf2-a7ec-0400a9cfa09c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:43.641323 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c8aeb7-f96b-4bf2-a7ec-0400a9cfa09c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:43.667625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 378/738] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Jul 15 19:16:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:43.668867 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8aeb7-f96b-4bf2-a7ec-0400a9cfa09c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:43.709178 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 361/739] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 15 19:16:43.710023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2eb772-cd60-4246-8db1-fc7c4ce2d6f9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:43.802370 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c8aeb7-f96b-4bf2-a7ec-0400a9cfa09c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:43.821477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2eb772-cd60-4246-8db1-fc7c4ce2d6f9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:43.835671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:43.841179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1749148-9207-47b7-8da7-b74451293780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:43.841982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1749148-9207-47b7-8da7-b74451293780 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:43.842298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1749148-9207-47b7-8da7-b74451293780 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:43.842561 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1749148-9207-47b7-8da7-b74451293780 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:43.843300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1749148-9207-47b7-8da7-b74451293780 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:43.844719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1749148-9207-47b7-8da7-b74451293780 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:43.858715 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd65320-6d33-4c23-be9a-ab13a20203a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:43.859401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65320-6d33-4c23-be9a-ab13a20203a0 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:43.859683 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65320-6d33-4c23-be9a-ab13a20203a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:43.859956 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd65320-6d33-4c23-be9a-ab13a20203a0 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:43.860676 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd65320-6d33-4c23-be9a-ab13a20203a0 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:43.862034 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd65320-6d33-4c23-be9a-ab13a20203a0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:43.958188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 379/740] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Jul 15 19:16:43 2022] POST /identity/v3/services => generated 251 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:43.959045 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1749148-9207-47b7-8da7-b74451293780 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:43.984667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:44.001312 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 362/741] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Jul 15 19:16:43 2022] POST /identity/v3/services => generated 240 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:44.002598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd65320-6d33-4c23-be9a-ab13a20203a0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:44.168201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1749148-9207-47b7-8da7-b74451293780 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:44.177091 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd65320-6d33-4c23-be9a-ab13a20203a0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:44.221149 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d97c1a-bb63-40fe-8eba-ddf3cb3894f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:44.222023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d97c1a-bb63-40fe-8eba-ddf3cb3894f7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:44.222310 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d97c1a-bb63-40fe-8eba-ddf3cb3894f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:44.222551 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d97c1a-bb63-40fe-8eba-ddf3cb3894f7 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:44.235156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c54321-07a8-4eca-a1e4-223f822dccc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:44.235556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d97c1a-bb63-40fe-8eba-ddf3cb3894f7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:44.236565 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c54321-07a8-4eca-a1e4-223f822dccc2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:44.236942 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d97c1a-bb63-40fe-8eba-ddf3cb3894f7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:44.237292 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c54321-07a8-4eca-a1e4-223f822dccc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:44.237928 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c54321-07a8-4eca-a1e4-223f822dccc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:44.251158 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c54321-07a8-4eca-a1e4-223f822dccc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:44.253000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c54321-07a8-4eca-a1e4-223f822dccc2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:44.253710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-22d97c1a-bb63-40fe-8eba-ddf3cb3894f7 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:16:44.253710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:44.253710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:44.253710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:44.253710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:44.253710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:44.253710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:44.253710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:44.253710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:44.253710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:44.253710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:44.253710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:44.253710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:44.253710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:44.253710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:44.253710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:44.254659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:44.255939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:44.255939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:44.255939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:44.255939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:44.255939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:44.255939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:44.255939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:44.255939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:44.255939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:16:44.255939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:44.255939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 380/742] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Jul 15 19:16:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:44.256551 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d97c1a-bb63-40fe-8eba-ddf3cb3894f7 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:44.274674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f0c54321-07a8-4eca-a1e4-223f822dccc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:44.274674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:44.274674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:44.274674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:44.274674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:44.274674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:44.274674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:44.274674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:44.274674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:44.274674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:44.274674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:44.274674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:44.274674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:44.274674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:44.274674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:44.275850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:44.275850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:44.275850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:44.275850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:44.275850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:44.275850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:44.275850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:44.275850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:44.275850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:44.275850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:44.275850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:44.275850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:44.275850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:44.275850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:44.275850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:44.275850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:44.275850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:44.276852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:44.276852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:44.276852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:44.276852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:44.277615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 363/743] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:44.278519 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c54321-07a8-4eca-a1e4-223f822dccc2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:44.339136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:44.340143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:44.401982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d97c1a-bb63-40fe-8eba-ddf3cb3894f7 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:44.406562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c54321-07a8-4eca-a1e4-223f822dccc2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:44.445476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dcc00-0643-45a0-a7a2-8728c17cdbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:44.446290 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dcc00-0643-45a0-a7a2-8728c17cdbfc None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:44.446714 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dcc00-0643-45a0-a7a2-8728c17cdbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:44.447109 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346dcc00-0643-45a0-a7a2-8728c17cdbfc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:44.448133 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07aac1-657c-41ff-b374-90e9254f805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:44.449350 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07aac1-657c-41ff-b374-90e9254f805c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:44.449854 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07aac1-657c-41ff-b374-90e9254f805c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:44.450355 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af07aac1-657c-41ff-b374-90e9254f805c None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:44.452275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07aac1-657c-41ff-b374-90e9254f805c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:44.452883 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07aac1-657c-41ff-b374-90e9254f805c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:44.456060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af07aac1-657c-41ff-b374-90e9254f805c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:44.459869 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346dcc00-0643-45a0-a7a2-8728c17cdbfc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:44.469653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-346dcc00-0643-45a0-a7a2-8728c17cdbfc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:44.469653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:44.469653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:44.469653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:44.469653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:44.469653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:44.469653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:44.469653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:44.469653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:44.469653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:44.469653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:44.469653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:44.469653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:44.469653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:44.469653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:44.469653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:44.470794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:44.470794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:44.470794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:44.470794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:44.470794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:44.470794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:44.470794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:44.470794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:44.470794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:44.470794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:44.470794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:44.470794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:44.470794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:44.470794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:44.470794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:44.470794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:44.471749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:44.471749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:44.471749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:44.471749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:44.471749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:44.471749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:44.471749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:44.471749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:44.471749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:44.471749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:44.471749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:44.471749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:44.479012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 381/744] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:44.480154 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dcc00-0643-45a0-a7a2-8728c17cdbfc None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:44.496297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 364/745] 10.222.0.40 () {56 vars in 1149 bytes} [Fri Jul 15 19:16:44 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:44.497394 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07aac1-657c-41ff-b374-90e9254f805c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:44.616584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346dcc00-0643-45a0-a7a2-8728c17cdbfc None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:44.629712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:44.633893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af07aac1-657c-41ff-b374-90e9254f805c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:44.655178 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:44.657944 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c869c4-bfc6-40a5-b194-8ba6d078c6bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:44.658620 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c869c4-bfc6-40a5-b194-8ba6d078c6bc None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:44.658932 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c869c4-bfc6-40a5-b194-8ba6d078c6bc None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:44.659375 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c869c4-bfc6-40a5-b194-8ba6d078c6bc None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:44.660649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c869c4-bfc6-40a5-b194-8ba6d078c6bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:44.661410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c869c4-bfc6-40a5-b194-8ba6d078c6bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:44.663105 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c869c4-bfc6-40a5-b194-8ba6d078c6bc None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:44.677718 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 382/746] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:44.678922 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c869c4-bfc6-40a5-b194-8ba6d078c6bc None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:44.686776 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fbd3d-a3b4-422c-a620-b5bc00916420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:44.687830 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fbd3d-a3b4-422c-a620-b5bc00916420 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:44.688265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fbd3d-a3b4-422c-a620-b5bc00916420 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:44.688692 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fbd3d-a3b4-422c-a620-b5bc00916420 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:44.690306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fbd3d-a3b4-422c-a620-b5bc00916420 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:44.690816 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fbd3d-a3b4-422c-a620-b5bc00916420 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:44.692873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fbd3d-a3b4-422c-a620-b5bc00916420 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:44.710822 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 365/747] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:44.711717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fbd3d-a3b4-422c-a620-b5bc00916420 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:44.816304 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c869c4-bfc6-40a5-b194-8ba6d078c6bc None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:44.834972 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fbd3d-a3b4-422c-a620-b5bc00916420 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:44.870987 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe537e-92ec-4232-adaa-add1af55db5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:44.872069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe537e-92ec-4232-adaa-add1af55db5a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:44.872707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe537e-92ec-4232-adaa-add1af55db5a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:44.873468 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ebe537e-92ec-4232-adaa-add1af55db5a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:44.874478 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3736ab-6fbd-4949-af81-4a7f8d0aa53d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:44.875412 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3736ab-6fbd-4949-af81-4a7f8d0aa53d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:44.875694 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3736ab-6fbd-4949-af81-4a7f8d0aa53d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:44.875967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3736ab-6fbd-4949-af81-4a7f8d0aa53d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:44.883719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3736ab-6fbd-4949-af81-4a7f8d0aa53d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:44.885179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3736ab-6fbd-4949-af81-4a7f8d0aa53d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:44.902036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-1e3736ab-6fbd-4949-af81-4a7f8d0aa53d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:44.902036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:44.902036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:44.902036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:44.902036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:44.902036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:44.902036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:44.902036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:44.902036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:44.902036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:44.902036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:44.902036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:44.902036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:44.902036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:44.902036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:44.903029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:44.903029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:44.903029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:44.903029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:44.903029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:44.903029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:44.903029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:44.903029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:44.903029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:44.903029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:44.903029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:44.903029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:44.903029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:44.903029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:44.903029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:44.903029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:44.903029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:44.904477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:44.904477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:44.904477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:44.904477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:44.904477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:44.904477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:44.904477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:44.904477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:44.904477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 366/748] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:44.905471 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3736ab-6fbd-4949-af81-4a7f8d0aa53d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:44.924790 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:44.939017 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:44.971380 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe537e-92ec-4232-adaa-add1af55db5a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:44.973757 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ebe537e-92ec-4232-adaa-add1af55db5a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:45.059421 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3736ab-6fbd-4949-af81-4a7f8d0aa53d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:45.104902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04562c0-815f-47cc-8fe0-14473b26cbc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:45.105969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04562c0-815f-47cc-8fe0-14473b26cbc8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.106315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04562c0-815f-47cc-8fe0-14473b26cbc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.106654 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04562c0-815f-47cc-8fe0-14473b26cbc8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.112755 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 383/749] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:44 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:16:45.113910 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe537e-92ec-4232-adaa-add1af55db5a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:45.131199 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04562c0-815f-47cc-8fe0-14473b26cbc8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:45.133203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a04562c0-815f-47cc-8fe0-14473b26cbc8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:45.154570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-a04562c0-815f-47cc-8fe0-14473b26cbc8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:45.154570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:45.154570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:45.154570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:45.154570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:45.154570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:45.154570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:45.154570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:45.154570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:45.154570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:45.154570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:45.154570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:45.154570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:45.154570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:45.154570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:45.155634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:45.155634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:45.155634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:45.155634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:45.155634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:45.155634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:45.155634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:45.155634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:45.155634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:45.155634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:45.155634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:45.155634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:45.155634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:45.155634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:45.155634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:45.155634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:45.155634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:45.156568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:45.156568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:45.156568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:45.156568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:45.156568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 367/750] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:45.157287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04562c0-815f-47cc-8fe0-14473b26cbc8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:45.201882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:45.240580 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ebe537e-92ec-4232-adaa-add1af55db5a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:45.275877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:45.288042 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f8354-5337-4249-9b9e-0384b969d507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:45.289192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f8354-5337-4249-9b9e-0384b969d507 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.290159 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f8354-5337-4249-9b9e-0384b969d507 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.290539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f8354-5337-4249-9b9e-0384b969d507 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.291758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f8354-5337-4249-9b9e-0384b969d507 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:45.292156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f8354-5337-4249-9b9e-0384b969d507 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:45.294427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271f8354-5337-4249-9b9e-0384b969d507 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:45.298250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a04562c0-815f-47cc-8fe0-14473b26cbc8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:45.318785 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 384/751] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:45.318785 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f8354-5337-4249-9b9e-0384b969d507 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:45.342913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86a807-7b2c-4ffd-80a8-59eaf40a418e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:45.343962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86a807-7b2c-4ffd-80a8-59eaf40a418e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.344419 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86a807-7b2c-4ffd-80a8-59eaf40a418e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.344840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86a807-7b2c-4ffd-80a8-59eaf40a418e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.356047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86a807-7b2c-4ffd-80a8-59eaf40a418e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:45.357829 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc86a807-7b2c-4ffd-80a8-59eaf40a418e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:45.376794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-fc86a807-7b2c-4ffd-80a8-59eaf40a418e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:45.376794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:45.376794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:45.376794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:45.376794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:45.376794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:45.376794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:45.376794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:45.376794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:45.376794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:45.376794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:45.376794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:45.376794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:45.376794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:45.376794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:45.377761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:45.377761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:45.377761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:45.377761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:45.377761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:45.377761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:45.377761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:45.377761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:45.377761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:45.377761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:45.377761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:45.377761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:45.377761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:45.377761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:45.377761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:45.377761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:45.377761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:45.378676 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:45.378676 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:45.378676 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:45.378676 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:45.380781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 368/752] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:45.381912 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86a807-7b2c-4ffd-80a8-59eaf40a418e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:45.447188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f8354-5337-4249-9b9e-0384b969d507 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:45.477241 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:45.486318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d92ba-fead-41ce-a50b-16a4950b1ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:45.487291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d92ba-fead-41ce-a50b-16a4950b1ae1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.490028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d92ba-fead-41ce-a50b-16a4950b1ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.490028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4d92ba-fead-41ce-a50b-16a4950b1ae1 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.490028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d92ba-fead-41ce-a50b-16a4950b1ae1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:45.490028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d92ba-fead-41ce-a50b-16a4950b1ae1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:45.492380 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e4d92ba-fead-41ce-a50b-16a4950b1ae1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:45.502808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86a807-7b2c-4ffd-80a8-59eaf40a418e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:45.508135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 385/753] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:45.508999 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d92ba-fead-41ce-a50b-16a4950b1ae1 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:45.544580 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:45.551372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d7572-bdd0-4f15-8770-99ed8eda4989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:45.552544 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7572-bdd0-4f15-8770-99ed8eda4989 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.553032 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7572-bdd0-4f15-8770-99ed8eda4989 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.553529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1d7572-bdd0-4f15-8770-99ed8eda4989 None admin] PATH_INFO: `/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/850a32e590154968bfbbfc404450b70a/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.558705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d7572-bdd0-4f15-8770-99ed8eda4989 None admin] RBAC: Authorizing `identity:create_grant(project_id=861de78bbfe84bd991c3ab54e85573a7, user_id=850a32e590154968bfbbfc404450b70a, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:45.558705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b1d7572-bdd0-4f15-8770-99ed8eda4989 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:45.629187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4d92ba-fead-41ce-a50b-16a4950b1ae1 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:45.629903 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 369/754] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:16:45 2022] PUT /identity/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/850a32e590154968bfbbfc404450b70a/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:45.632287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d7572-bdd0-4f15-8770-99ed8eda4989 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:45.703753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11fb3f-ee69-4df8-b4d6-3005730e1046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:45.704410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11fb3f-ee69-4df8-b4d6-3005730e1046 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.704689 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11fb3f-ee69-4df8-b4d6-3005730e1046 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.704962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c11fb3f-ee69-4df8-b4d6-3005730e1046 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.707001 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11fb3f-ee69-4df8-b4d6-3005730e1046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:45.707316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11fb3f-ee69-4df8-b4d6-3005730e1046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:45.710146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c11fb3f-ee69-4df8-b4d6-3005730e1046 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:45.738951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 386/755] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:45.744817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11fb3f-ee69-4df8-b4d6-3005730e1046 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:45.845359 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:45.863175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1d7572-bdd0-4f15-8770-99ed8eda4989 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:45.911564 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c11fb3f-ee69-4df8-b4d6-3005730e1046 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:45.912953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478b0e2-0234-435b-8543-65d48d10118d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:45.914046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478b0e2-0234-435b-8543-65d48d10118d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.914329 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478b0e2-0234-435b-8543-65d48d10118d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.914601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9478b0e2-0234-435b-8543-65d48d10118d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.925351 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478b0e2-0234-435b-8543-65d48d10118d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:45.926893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9478b0e2-0234-435b-8543-65d48d10118d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:45.951600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-9478b0e2-0234-435b-8543-65d48d10118d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:16:45.951600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:45.951600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:45.951600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:45.951600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:45.951600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:45.951600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:45.951600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:45.951600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:45.951600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:45.951600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:45.951600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:45.951600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:45.951600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:45.951600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:45.951600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:45.952705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:45.953655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:45.953655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:45.953655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:45.953655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:45.953655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:45.953655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:45.953655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:45.953655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:45.953655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:16:45.953655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:45.953655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 370/756] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:45 2022] GET /identity/v3/users/swift => generated 83 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:45.960729 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478b0e2-0234-435b-8543-65d48d10118d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:45.965574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669827ff-d612-4f67-bab4-6a9223294981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:45.967461 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669827ff-d612-4f67-bab4-6a9223294981 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:45.968120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669827ff-d612-4f67-bab4-6a9223294981 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:45.968624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-669827ff-d612-4f67-bab4-6a9223294981 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:45.983238 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669827ff-d612-4f67-bab4-6a9223294981 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:45.985068 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-669827ff-d612-4f67-bab4-6a9223294981 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:46.008492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-669827ff-d612-4f67-bab4-6a9223294981 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:46.008492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:46.008492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:46.008492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:46.008492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:46.008492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:46.008492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:46.008492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:46.008492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:46.008492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:46.008492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:46.008492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:46.008492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:46.008492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:46.008492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:46.009428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:46.009428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:46.009428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:46.009428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:46.009428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:46.009428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:46.009428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:46.009428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:46.009428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:46.009428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:46.009428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:46.009428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:46.009428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:46.009428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:46.009428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:46.009428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:46.009428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:46.010317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:46.010317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:46.010317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:46.010317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:46.010317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:46.010317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:46.010317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:46.010317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:46.018338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 387/757] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:46.024901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669827ff-d612-4f67-bab4-6a9223294981 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:46.079747 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:46.172457 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9478b0e2-0234-435b-8543-65d48d10118d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:46.233400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-669827ff-d612-4f67-bab4-6a9223294981 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:46.240855 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339a478f-90e1-4add-a41b-808e0b13cc73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:46.241534 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a478f-90e1-4add-a41b-808e0b13cc73 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.241808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a478f-90e1-4add-a41b-808e0b13cc73 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.242080 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339a478f-90e1-4add-a41b-808e0b13cc73 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.243618 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a478f-90e1-4add-a41b-808e0b13cc73 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:46.243932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a478f-90e1-4add-a41b-808e0b13cc73 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:46.245642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:46.246881 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339a478f-90e1-4add-a41b-808e0b13cc73 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:46.276420 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 371/758] 10.222.0.40 () {56 vars in 1135 bytes} [Fri Jul 15 19:16:45 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:46.277784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138535fb-3c32-4a65-bce1-d86aee63c621 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.278077 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138535fb-3c32-4a65-bce1-d86aee63c621 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.278348 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138535fb-3c32-4a65-bce1-d86aee63c621 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.281464 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 372/759] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:46.282723 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138535fb-3c32-4a65-bce1-d86aee63c621 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:46.289159 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8358b6-a249-4f2e-8066-870a85b89910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:46.289847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8358b6-a249-4f2e-8066-870a85b89910 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.290131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8358b6-a249-4f2e-8066-870a85b89910 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.290411 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8358b6-a249-4f2e-8066-870a85b89910 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.291246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8358b6-a249-4f2e-8066-870a85b89910 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:46.291559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8358b6-a249-4f2e-8066-870a85b89910 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:46.293636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8358b6-a249-4f2e-8066-870a85b89910 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:46.308716 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 388/760] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:46.310946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03370df5-4dd2-40f1-aa19-24fc854f1a37 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.311528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03370df5-4dd2-40f1-aa19-24fc854f1a37 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.312029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03370df5-4dd2-40f1-aa19-24fc854f1a37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.337203 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-03370df5-4dd2-40f1-aa19-24fc854f1a37 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:46.338780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-03370df5-4dd2-40f1-aa19-24fc854f1a37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:46.411775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 389/761] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:16:46.413042 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03370df5-4dd2-40f1-aa19-24fc854f1a37 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:46.422102 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138535fb-3c32-4a65-bce1-d86aee63c621 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:46.434576 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:46.463169 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c253757-cb54-4204-8ff0-27ee95cdbe1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:46.463823 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c253757-cb54-4204-8ff0-27ee95cdbe1a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.464105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c253757-cb54-4204-8ff0-27ee95cdbe1a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.464380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c253757-cb54-4204-8ff0-27ee95cdbe1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.529299 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:46.534978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03370df5-4dd2-40f1-aa19-24fc854f1a37 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:46.545674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c253757-cb54-4204-8ff0-27ee95cdbe1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:46.547369 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c253757-cb54-4204-8ff0-27ee95cdbe1a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:46.575324 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebf25ee-8444-4992-aba2-3f9f803ed7b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:46.576350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf25ee-8444-4992-aba2-3f9f803ed7b3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.576350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf25ee-8444-4992-aba2-3f9f803ed7b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.576350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebf25ee-8444-4992-aba2-3f9f803ed7b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.577578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf25ee-8444-4992-aba2-3f9f803ed7b3 None admin] RBAC: Adding query filter params (role.id=579726a957a7468abecab3fbdb4351a9, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=deed55901c264b8da58e57c21840c491) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:46.577891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf25ee-8444-4992-aba2-3f9f803ed7b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:46.580004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebf25ee-8444-4992-aba2-3f9f803ed7b3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:46.586230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 390/762] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:46 2022] GET /identity/v3/role_assignments?user.id=deed55901c264b8da58e57c21840c491&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=579726a957a7468abecab3fbdb4351a9 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:46.587839 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3be4d-7545-4c81-b8c0-1a850cd89bed None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.588131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3be4d-7545-4c81-b8c0-1a850cd89bed None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.588411 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e3be4d-7545-4c81-b8c0-1a850cd89bed None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.594430 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 391/763] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:46.594430 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3be4d-7545-4c81-b8c0-1a850cd89bed None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:46.691261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 373/764] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:46 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 409 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:16:46.692817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e5dd4-fdf0-4f36-a3af-345c7a5e2f53 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.693029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e5dd4-fdf0-4f36-a3af-345c7a5e2f53 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.693312 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9e5dd4-fdf0-4f36-a3af-345c7a5e2f53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.713022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-cb9e5dd4-fdf0-4f36-a3af-345c7a5e2f53 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:46.714032 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cb9e5dd4-fdf0-4f36-a3af-345c7a5e2f53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:46.722813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:46.749629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09e3be4d-7545-4c81-b8c0-1a850cd89bed None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:46.796271 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf42e0-25a1-4a23-9ada-24bccf6052b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:46.797034 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf42e0-25a1-4a23-9ada-24bccf6052b2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.797319 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf42e0-25a1-4a23-9ada-24bccf6052b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.797593 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbf42e0-25a1-4a23-9ada-24bccf6052b2 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.798255 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf42e0-25a1-4a23-9ada-24bccf6052b2 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:46.799714 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbf42e0-25a1-4a23-9ada-24bccf6052b2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:46.816230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-7dbf42e0-25a1-4a23-9ada-24bccf6052b2 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:16:46.816230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:46.816230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:16:46.816230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:16:46.816230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:16:46.816230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:16:46.816230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:16:46.816230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:46.816230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:16:46.816230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:46.816230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:16:46.816230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:46.816230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:46.816230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:46.816230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:46.816230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:46.817574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:46.817574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:46.817574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:46.817574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:46.817574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:46.817574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:46.817574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:46.817574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:16:46.817574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:16:46.817574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:16:46.817574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:16:46.817574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:46.817574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:46.817574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:46.817574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:46.817574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:46.818444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:46.818444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:46.818444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:46.818444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:46.818444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:46.818444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:46.818444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:46.818444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:46.818444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:46.818444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:46.818444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:46.818444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:16:46.818444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:46.818444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:16:46.818444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:46.819675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 374/766] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:46 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:16:46.826800 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 392/766] 10.222.0.40 () {56 vars in 1129 bytes} [Fri Jul 15 19:16:46 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:46.826975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e5dd4-fdf0-4f36-a3af-345c7a5e2f53 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:46.827075 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf42e0-25a1-4a23-9ada-24bccf6052b2 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:46.864183 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:46.944840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbf42e0-25a1-4a23-9ada-24bccf6052b2 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:46.950169 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9e5dd4-fdf0-4f36-a3af-345c7a5e2f53 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:46.986389 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e0130-e349-4b63-9ab0-51b87fb23aa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:46.987475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e0130-e349-4b63-9ab0-51b87fb23aa8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.987999 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e0130-e349-4b63-9ab0-51b87fb23aa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.988485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3e0130-e349-4b63-9ab0-51b87fb23aa8 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:46.989524 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e0130-e349-4b63-9ab0-51b87fb23aa8 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:46.990078 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e0130-e349-4b63-9ab0-51b87fb23aa8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:46.991763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3e0130-e349-4b63-9ab0-51b87fb23aa8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:46.991908 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b845a1-0d2f-4cda-8e94-a780ba79d5f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:46.992756 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b845a1-0d2f-4cda-8e94-a780ba79d5f5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:46.993118 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b845a1-0d2f-4cda-8e94-a780ba79d5f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:46.993517 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b845a1-0d2f-4cda-8e94-a780ba79d5f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.003294 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 393/767] 10.222.0.40 () {56 vars in 1124 bytes} [Fri Jul 15 19:16:46 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:47.003503 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:47.004951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e0130-e349-4b63-9ab0-51b87fb23aa8 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.006212 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b845a1-0d2f-4cda-8e94-a780ba79d5f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.007812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b845a1-0d2f-4cda-8e94-a780ba79d5f5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.028156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-c4b845a1-0d2f-4cda-8e94-a780ba79d5f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:47.028156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:47.028156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:47.028156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:47.028156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:47.028156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:47.028156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:47.028156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:47.028156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:47.028156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:47.028156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:47.028156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:47.028156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:47.028156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:47.028156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:47.029793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:47.029793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:47.029793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:47.029793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:47.029793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:47.029793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:47.029793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:47.029793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:47.029793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:47.029793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:47.029793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:47.029793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:47.029793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:47.029793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:47.029793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:47.029793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:47.029793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:47.030737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:47.030737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:47.030737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:47.030737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:47.030737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 375/768] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:47.031968 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b845a1-0d2f-4cda-8e94-a780ba79d5f5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.109214 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:47.119871 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3e0130-e349-4b63-9ab0-51b87fb23aa8 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.161100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b845a1-0d2f-4cda-8e94-a780ba79d5f5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.162261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8108307-6bb2-4d16-886e-398d0a53e2d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.163316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8108307-6bb2-4d16-886e-398d0a53e2d0 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.163759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8108307-6bb2-4d16-886e-398d0a53e2d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.164217 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8108307-6bb2-4d16-886e-398d0a53e2d0 None admin] PATH_INFO: `/v3/services/network` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.165054 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8108307-6bb2-4d16-886e-398d0a53e2d0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.166615 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8108307-6bb2-4d16-886e-398d0a53e2d0 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.179842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-b8108307-6bb2-4d16-886e-398d0a53e2d0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:16:47.179842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:47.179842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:16:47.179842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:16:47.179842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:16:47.179842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:16:47.179842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:16:47.179842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:47.179842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:16:47.179842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:47.179842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:16:47.179842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:47.179842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:47.179842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:47.179842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:47.179842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:47.179842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:47.181136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:47.181136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:47.181136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:47.181136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:47.181136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:47.181136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:47.181136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:16:47.181136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:16:47.181136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:16:47.181136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:16:47.181136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:47.181136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:47.181136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:47.181136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:47.181136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:47.181136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:47.182126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:47.182126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:47.182126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:47.182126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:47.182126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:47.182126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:47.182126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:47.182126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:47.182126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:47.182126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:47.182126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:16:47.182126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:47.182126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:16:47.182126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:47.184240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 394/769] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:47 2022] GET /identity/v3/services/network => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:47.185728 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8108307-6bb2-4d16-886e-398d0a53e2d0 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.208182 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6fdb6-a6fd-4345-ae14-b6a4f140fe79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.208891 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6fdb6-a6fd-4345-ae14-b6a4f140fe79 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.209170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6fdb6-a6fd-4345-ae14-b6a4f140fe79 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.209442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6fdb6-a6fd-4345-ae14-b6a4f140fe79 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.210197 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6fdb6-a6fd-4345-ae14-b6a4f140fe79 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:47.210501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6fdb6-a6fd-4345-ae14-b6a4f140fe79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.211935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6fdb6-a6fd-4345-ae14-b6a4f140fe79 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.223060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 376/770] 10.222.0.40 () {56 vars in 1124 bytes} [Fri Jul 15 19:16:47 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:47.223060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6fdb6-a6fd-4345-ae14-b6a4f140fe79 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.279607 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:47.303597 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8108307-6bb2-4d16-886e-398d0a53e2d0 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.328244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6fdb6-a6fd-4345-ae14-b6a4f140fe79 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.342880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564d677-69e4-4f63-93bd-03f06f5cfc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.343778 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564d677-69e4-4f63-93bd-03f06f5cfc10 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.344207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564d677-69e4-4f63-93bd-03f06f5cfc10 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.344646 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1564d677-69e4-4f63-93bd-03f06f5cfc10 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.345521 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564d677-69e4-4f63-93bd-03f06f5cfc10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:47.345990 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564d677-69e4-4f63-93bd-03f06f5cfc10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.347521 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1564d677-69e4-4f63-93bd-03f06f5cfc10 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.361333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 395/771] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:47.362840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564d677-69e4-4f63-93bd-03f06f5cfc10 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.364626 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf0cf1-0a8f-437d-9567-7bffb707c77a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.365463 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf0cf1-0a8f-437d-9567-7bffb707c77a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.365714 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf0cf1-0a8f-437d-9567-7bffb707c77a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.365989 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faf0cf1-0a8f-437d-9567-7bffb707c77a None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.366694 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf0cf1-0a8f-437d-9567-7bffb707c77a None admin] RBAC: Adding query filter params (name=network) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:47.367042 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf0cf1-0a8f-437d-9567-7bffb707c77a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.368558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faf0cf1-0a8f-437d-9567-7bffb707c77a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.378848 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 377/772] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Jul 15 19:16:47 2022] GET /identity/v3/services?name=network => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:47.379830 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf0cf1-0a8f-437d-9567-7bffb707c77a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.381638 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:47.472547 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1564d677-69e4-4f63-93bd-03f06f5cfc10 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.486584 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faf0cf1-0a8f-437d-9567-7bffb707c77a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.507844 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:47.510019 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcae4eb-944c-437d-8b1d-c104de4f03e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.510902 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcae4eb-944c-437d-8b1d-c104de4f03e2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.511334 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcae4eb-944c-437d-8b1d-c104de4f03e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.511758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bcae4eb-944c-437d-8b1d-c104de4f03e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.512724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcae4eb-944c-437d-8b1d-c104de4f03e2 None admin] RBAC: Adding query filter params (interface=public, service_id=549695f7c103465ea9a3e94563316a05, region_id=RegionOne) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:47.513806 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcae4eb-944c-437d-8b1d-c104de4f03e2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.515533 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bcae4eb-944c-437d-8b1d-c104de4f03e2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.524128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f0360-4a70-4f1f-9bed-b036360f69b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.529701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f0360-4a70-4f1f-9bed-b036360f69b9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.529701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f0360-4a70-4f1f-9bed-b036360f69b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.529701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019f0360-4a70-4f1f-9bed-b036360f69b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.529996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 396/773] 10.222.0.40 () {56 vars in 1251 bytes} [Fri Jul 15 19:16:47 2022] GET /identity/v3/endpoints?service_id=549695f7c103465ea9a3e94563316a05&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:47.529996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcae4eb-944c-437d-8b1d-c104de4f03e2 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.540075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f0360-4a70-4f1f-9bed-b036360f69b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.541613 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019f0360-4a70-4f1f-9bed-b036360f69b9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.556982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-019f0360-4a70-4f1f-9bed-b036360f69b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:47.556982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:47.556982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:47.556982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:47.556982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:47.556982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:47.556982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:47.556982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:47.556982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:47.556982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:47.556982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:47.556982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:47.556982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:47.556982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:47.556982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:47.557909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:47.557909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:47.557909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:47.557909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:47.557909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:47.557909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:47.557909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:47.557909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:47.557909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:47.557909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:47.557909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:47.557909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:47.557909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:47.557909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:47.557909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:47.557909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:47.557909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:47.558867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:47.558867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:47.558867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:47.558867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:47.558867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:47.558867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:47.558867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:47.558867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:47.558867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 378/774] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:47.559809 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f0360-4a70-4f1f-9bed-b036360f69b9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.622228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:47.646409 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bcae4eb-944c-437d-8b1d-c104de4f03e2 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.668362 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019f0360-4a70-4f1f-9bed-b036360f69b9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.691603 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f919723-3abe-4b08-9a38-cf5c03af9d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.692645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f919723-3abe-4b08-9a38-cf5c03af9d5a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.693131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f919723-3abe-4b08-9a38-cf5c03af9d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.693642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f919723-3abe-4b08-9a38-cf5c03af9d5a None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.694580 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f919723-3abe-4b08-9a38-cf5c03af9d5a None admin] RBAC: Adding query filter params (type=network) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:47.695132 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f919723-3abe-4b08-9a38-cf5c03af9d5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.696706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f919723-3abe-4b08-9a38-cf5c03af9d5a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.704675 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 397/775] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Jul 15 19:16:47 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:47.705946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f919723-3abe-4b08-9a38-cf5c03af9d5a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.711510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8382b4-2214-4c73-a2ea-4483363bdd8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.712195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8382b4-2214-4c73-a2ea-4483363bdd8a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.712482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8382b4-2214-4c73-a2ea-4483363bdd8a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.712758 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8382b4-2214-4c73-a2ea-4483363bdd8a None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.713452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8382b4-2214-4c73-a2ea-4483363bdd8a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.714848 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8382b4-2214-4c73-a2ea-4483363bdd8a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.722592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 379/776] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Jul 15 19:16:47 2022] GET /identity/v3/services => generated 772 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:47.723481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8382b4-2214-4c73-a2ea-4483363bdd8a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.817916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:47.826911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f919723-3abe-4b08-9a38-cf5c03af9d5a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:47.869480 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc7b25-4355-4357-9051-dfe10b833a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:47.870630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc7b25-4355-4357-9051-dfe10b833a9c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:47.871166 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc7b25-4355-4357-9051-dfe10b833a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:47.871646 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcc7b25-4355-4357-9051-dfe10b833a9c None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:47.873279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc7b25-4355-4357-9051-dfe10b833a9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:47.873843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc7b25-4355-4357-9051-dfe10b833a9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:47.875566 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcc7b25-4355-4357-9051-dfe10b833a9c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:47.890925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 398/777] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:47.896982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc7b25-4355-4357-9051-dfe10b833a9c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:47.902965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:47.954849 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8382b4-2214-4c73-a2ea-4483363bdd8a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:48.003877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d27b638-5837-4194-bfcd-c13bee9ae427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:48.005017 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27b638-5837-4194-bfcd-c13bee9ae427 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.005378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27b638-5837-4194-bfcd-c13bee9ae427 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.005723 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d27b638-5837-4194-bfcd-c13bee9ae427 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.006700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27b638-5837-4194-bfcd-c13bee9ae427 None admin] RBAC: Adding query filter params (interface=public, service_id=cc3034bf95de4be6bb7539535bad32d6, region_id=RegionOne) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:48.007064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27b638-5837-4194-bfcd-c13bee9ae427 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:48.008436 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d27b638-5837-4194-bfcd-c13bee9ae427 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:48.017721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 380/778] 10.222.0.40 () {56 vars in 1251 bytes} [Fri Jul 15 19:16:47 2022] GET /identity/v3/endpoints?service_id=cc3034bf95de4be6bb7539535bad32d6&interface=public®ion_id=RegionOne => generated 194 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:48.019101 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cec21-4bc5-4c8b-b7e1-878f1390a267 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.019389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cec21-4bc5-4c8b-b7e1-878f1390a267 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.019700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25cec21-4bc5-4c8b-b7e1-878f1390a267 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.021363 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 381/779] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:48.026686 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cec21-4bc5-4c8b-b7e1-878f1390a267 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:48.046543 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcc7b25-4355-4357-9051-dfe10b833a9c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:48.090182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dcd259-3c38-4ce6-92f0-76f0980cc890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:48.090862 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd259-3c38-4ce6-92f0-76f0980cc890 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.091167 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd259-3c38-4ce6-92f0-76f0980cc890 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.091499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dcd259-3c38-4ce6-92f0-76f0980cc890 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.092618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcd259-3c38-4ce6-92f0-76f0980cc890 None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=0402e1bd20b042cdbdcb890616b22726) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:48.092744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcd259-3c38-4ce6-92f0-76f0980cc890 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:48.094162 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dcd259-3c38-4ce6-92f0-76f0980cc890 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:48.107379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 399/780] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:47 2022] GET /identity/v3/role_assignments?user.id=0402e1bd20b042cdbdcb890616b22726&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:48.107379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbe2e7-e2be-4bd3-bf2f-6f17fbf2a4e0 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.107379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbe2e7-e2be-4bd3-bf2f-6f17fbf2a4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.107379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11dbe2e7-e2be-4bd3-bf2f-6f17fbf2a4e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.153164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-11dbe2e7-e2be-4bd3-bf2f-6f17fbf2a4e0 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:48.155075 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-11dbe2e7-e2be-4bd3-bf2f-6f17fbf2a4e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:48.185237 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25cec21-4bc5-4c8b-b7e1-878f1390a267 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:48.198585 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:48.230233 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b3fc7-3f41-4208-9259-70912d8fc73c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:48.231331 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b3fc7-3f41-4208-9259-70912d8fc73c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.233195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b3fc7-3f41-4208-9259-70912d8fc73c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.233850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01b3fc7-3f41-4208-9259-70912d8fc73c None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.235104 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b3fc7-3f41-4208-9259-70912d8fc73c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:48.236733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01b3fc7-3f41-4208-9259-70912d8fc73c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:48.243516 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 382/781] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Jul 15 19:16:48 2022] GET /identity/v3/services => generated 772 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:48.297593 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:48.306810 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 400/782] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:16:48.332402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b3fc7-3f41-4208-9259-70912d8fc73c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:48.452040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01b3fc7-3f41-4208-9259-70912d8fc73c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:48.489021 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f0bd9-0136-43c3-aee3-adf63d35f402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:48.490171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f0bd9-0136-43c3-aee3-adf63d35f402 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.490655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f0bd9-0136-43c3-aee3-adf63d35f402 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.491149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9f0bd9-0136-43c3-aee3-adf63d35f402 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.502735 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9f0bd9-0136-43c3-aee3-adf63d35f402 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:48.510682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ff9f0bd9-0136-43c3-aee3-adf63d35f402 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:48.510682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:48.510682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:48.510682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:48.510682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:48.510682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:48.510682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:48.510682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:48.510682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:48.510682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:48.510682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:48.510682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:48.510682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:48.510682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:48.510682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:48.510682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:48.511633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:48.511633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:48.511633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:48.511633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:48.511633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:48.511633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:48.511633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:48.511633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:48.511633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:48.511633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:48.511633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:48.511633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:48.511633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:48.511633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:48.511633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:48.511633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:48.512477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:48.512477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:48.512477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:48.512477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:48.512477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:48.512477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:48.512477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:48.512477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:48.512477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:48.512477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:48.512477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:48.512477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:48.515895 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 383/783] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:48.521850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbe2e7-e2be-4bd3-bf2f-6f17fbf2a4e0 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:48.631352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11dbe2e7-e2be-4bd3-bf2f-6f17fbf2a4e0 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:48.669814 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da0361e-75f9-414b-9d1f-f344785aff73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:48.671021 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0361e-75f9-414b-9d1f-f344785aff73 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.671504 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0361e-75f9-414b-9d1f-f344785aff73 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.672069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da0361e-75f9-414b-9d1f-f344785aff73 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.673019 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0361e-75f9-414b-9d1f-f344785aff73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:48.673550 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0361e-75f9-414b-9d1f-f344785aff73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:48.675140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da0361e-75f9-414b-9d1f-f344785aff73 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:48.685695 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 401/784] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:48.691858 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f0bd9-0136-43c3-aee3-adf63d35f402 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:48.727489 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:48.746535 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757814d-0928-4bb3-ab3e-9f10c98ca37f None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.746886 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757814d-0928-4bb3-ab3e-9f10c98ca37f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.747147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757814d-0928-4bb3-ab3e-9f10c98ca37f None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.749304 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 402/785] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:48.756260 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4064c9f-2d9d-4e2e-8f4a-934b93b984aa None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.756545 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4064c9f-2d9d-4e2e-8f4a-934b93b984aa None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.773946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4064c9f-2d9d-4e2e-8f4a-934b93b984aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.795927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a4064c9f-2d9d-4e2e-8f4a-934b93b984aa None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:48.797292 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a4064c9f-2d9d-4e2e-8f4a-934b93b984aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:48.805058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9f0bd9-0136-43c3-aee3-adf63d35f402 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:48.845500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1fcdf-47d2-4734-ba55-1246ac77a670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:48.846654 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1fcdf-47d2-4734-ba55-1246ac77a670 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:48.847195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1fcdf-47d2-4734-ba55-1246ac77a670 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:48.847642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1fcdf-47d2-4734-ba55-1246ac77a670 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:48.860544 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1fcdf-47d2-4734-ba55-1246ac77a670 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:48.862300 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1fcdf-47d2-4734-ba55-1246ac77a670 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:48.883094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-9fa1fcdf-47d2-4734-ba55-1246ac77a670 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:48.883094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:48.883094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:48.883094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:48.883094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:48.883094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:48.883094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:48.883094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:48.883094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:48.883094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:48.883094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:48.883094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:48.883094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:48.883094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:48.883094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:48.884041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:48.884041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:48.884041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:48.884041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:48.884041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:48.884041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:48.884041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:48.884041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:48.884041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:48.884041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:48.884041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:48.884041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:48.884041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:48.884041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:48.884041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:48.884041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:48.884041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:48.884926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:48.884926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:48.884926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:48.884926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:48.887151 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 384/786] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:48.894071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1fcdf-47d2-4734-ba55-1246ac77a670 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:48.951389 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:48.996398 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 403/787] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:48 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:16:49.010777 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:49.019730 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4064c9f-2d9d-4e2e-8f4a-934b93b984aa None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:49.022824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1fcdf-47d2-4734-ba55-1246ac77a670 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:49.067307 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d56e74-33a3-4b51-84a3-3734f50e79a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:49.068003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d56e74-33a3-4b51-84a3-3734f50e79a9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:49.068292 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d56e74-33a3-4b51-84a3-3734f50e79a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:49.068572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6d56e74-33a3-4b51-84a3-3734f50e79a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:49.071873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d56e74-33a3-4b51-84a3-3734f50e79a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:49.071873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d56e74-33a3-4b51-84a3-3734f50e79a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:49.071873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6d56e74-33a3-4b51-84a3-3734f50e79a9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:49.093050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 385/788] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:49.098824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d56e74-33a3-4b51-84a3-3734f50e79a9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:49.212828 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6d56e74-33a3-4b51-84a3-3734f50e79a9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:49.251200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0574a6-0442-4b23-938b-8e4bcba6c2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:49.252332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0574a6-0442-4b23-938b-8e4bcba6c2f5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:49.252814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0574a6-0442-4b23-938b-8e4bcba6c2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:49.253286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0574a6-0442-4b23-938b-8e4bcba6c2f5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:49.262078 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0574a6-0442-4b23-938b-8e4bcba6c2f5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:49.264435 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0574a6-0442-4b23-938b-8e4bcba6c2f5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:49.281314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-5b0574a6-0442-4b23-938b-8e4bcba6c2f5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:16:49.281314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:49.281314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:49.281314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:49.281314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:49.281314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:49.281314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:49.281314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:49.281314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:49.281314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:49.281314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:49.281314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:49.281314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:49.281314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:49.281314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:49.281314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:49.282309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:49.283268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:49.283268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:49.283268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:49.283268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:49.283268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:49.283268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:49.283268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:49.283268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:49.283268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:16:49.283268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:49.285904 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 386/789] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Jul 15 19:16:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:49.291846 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0574a6-0442-4b23-938b-8e4bcba6c2f5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:49.331493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:49.406299 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0574a6-0442-4b23-938b-8e4bcba6c2f5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:49.445901 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b3167-08af-483a-80df-69f079e57bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:49.446953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b3167-08af-483a-80df-69f079e57bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:49.447536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b3167-08af-483a-80df-69f079e57bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:49.448023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6b3167-08af-483a-80df-69f079e57bf6 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:49.449173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b3167-08af-483a-80df-69f079e57bf6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:49.449679 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b3167-08af-483a-80df-69f079e57bf6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:49.452601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6b3167-08af-483a-80df-69f079e57bf6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:49.474174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 387/790] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Jul 15 19:16:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:49.481091 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b3167-08af-483a-80df-69f079e57bf6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:49.546541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4064c9f-2d9d-4e2e-8f4a-934b93b984aa None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:49.563176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:49.601650 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6b3167-08af-483a-80df-69f079e57bf6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:49.615475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2f718-8b63-458a-b875-1c6470bc3807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:49.616290 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2f718-8b63-458a-b875-1c6470bc3807 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:49.616575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2f718-8b63-458a-b875-1c6470bc3807 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:49.616849 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae2f718-8b63-458a-b875-1c6470bc3807 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:49.632116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae2f718-8b63-458a-b875-1c6470bc3807 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:49.642742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b8634-2e36-4dbc-9992-62c828c1ae7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:49.643700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b8634-2e36-4dbc-9992-62c828c1ae7a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:49.644181 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b8634-2e36-4dbc-9992-62c828c1ae7a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:49.644670 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7b8634-2e36-4dbc-9992-62c828c1ae7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:49.652514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-8ae2f718-8b63-458a-b875-1c6470bc3807 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:49.652514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:49.652514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:49.652514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:49.652514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:49.652514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:49.652514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:49.652514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:49.652514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:49.652514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:49.652514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:49.652514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:49.652514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:49.652514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:49.652514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:49.652514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:49.653456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:49.653456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:49.653456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:49.653456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:49.653456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:49.653456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:49.653456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:49.653456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:49.653456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:49.653456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:49.653456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:49.653456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:49.653456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:49.653456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:49.653456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:49.653456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:49.654986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:49.654986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:49.654986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:49.654986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:49.654986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:49.654986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:49.654986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:49.654986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:49.654986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:49.654986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:49.654986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:49.654986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:49.654986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 404/791] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 635 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:49.659654 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2f718-8b63-458a-b875-1c6470bc3807 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:49.729620 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b8634-2e36-4dbc-9992-62c828c1ae7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:49.734655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7b8634-2e36-4dbc-9992-62c828c1ae7a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:49.767657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:49.863255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:49.876640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae2f718-8b63-458a-b875-1c6470bc3807 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:49.929027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 388/792] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:49 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 449 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 19:16:49.935223 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa025e-5074-49bf-8d14-cc169ba7caf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:49.936773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b8634-2e36-4dbc-9992-62c828c1ae7a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:49.939710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa025e-5074-49bf-8d14-cc169ba7caf4 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:49.941830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa025e-5074-49bf-8d14-cc169ba7caf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:49.942320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-affa025e-5074-49bf-8d14-cc169ba7caf4 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:49.944674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa025e-5074-49bf-8d14-cc169ba7caf4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:49.945235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa025e-5074-49bf-8d14-cc169ba7caf4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:49.950307 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-affa025e-5074-49bf-8d14-cc169ba7caf4 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:49.968365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 405/793] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:49 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:49.975581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa025e-5074-49bf-8d14-cc169ba7caf4 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:50.094824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7b8634-2e36-4dbc-9992-62c828c1ae7a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:50.133792 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab089f63-cdcd-49d7-962a-c7ebda6cc9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:50.134496 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab089f63-cdcd-49d7-962a-c7ebda6cc9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.134810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab089f63-cdcd-49d7-962a-c7ebda6cc9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.135111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab089f63-cdcd-49d7-962a-c7ebda6cc9a7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.144506 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-affa025e-5074-49bf-8d14-cc169ba7caf4 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:50.147254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab089f63-cdcd-49d7-962a-c7ebda6cc9a7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:50.148803 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab089f63-cdcd-49d7-962a-c7ebda6cc9a7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:50.159976 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:50.168718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ab089f63-cdcd-49d7-962a-c7ebda6cc9a7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:50.168718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:50.168718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:50.168718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:50.168718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:50.168718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:50.168718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:50.168718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:50.168718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:50.168718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:50.168718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:50.168718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:50.168718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:50.168718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:50.168718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:50.169872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:50.169872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:50.169872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:50.169872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:50.169872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:50.169872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:50.169872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:50.169872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:50.169872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:50.169872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:50.169872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:50.169872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:50.169872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:50.169872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:50.169872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:50.169872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:50.169872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:50.171122 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:50.171122 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:50.171122 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:50.171122 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:50.175334 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 389/794] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:50.176828 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8a42e-c2f9-4503-931d-e46588ed7fdf None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.177489 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8a42e-c2f9-4503-931d-e46588ed7fdf None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.177489 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d8a42e-c2f9-4503-931d-e46588ed7fdf None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.179343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 390/795] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:50.180232 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8a42e-c2f9-4503-931d-e46588ed7fdf None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:50.193188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-399e5d23-e6c1-45df-8d46-d35ecfe712a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:50.193986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e5d23-e6c1-45df-8d46-d35ecfe712a2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.194275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e5d23-e6c1-45df-8d46-d35ecfe712a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.194971 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-399e5d23-e6c1-45df-8d46-d35ecfe712a2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.199040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:50.210057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e5d23-e6c1-45df-8d46-d35ecfe712a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:50.211813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-399e5d23-e6c1-45df-8d46-d35ecfe712a2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:50.231395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-399e5d23-e6c1-45df-8d46-d35ecfe712a2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:50.231395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:50.231395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:50.231395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:50.231395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:50.231395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:50.231395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:50.231395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:50.231395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:50.231395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:50.231395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:50.231395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:50.231395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:50.231395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:50.231395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:50.232707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:50.232707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:50.232707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:50.232707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:50.232707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:50.232707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:50.232707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:50.232707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:50.232707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:50.232707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:50.232707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:50.232707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:50.232707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:50.232707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:50.232707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:50.232707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:50.232707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:50.233761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:50.233761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:50.233761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:50.233761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:50.236036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 406/796] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:50.237488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7819ce0-fbbc-4fbf-b0bd-d8ff3a40db1c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.237977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7819ce0-fbbc-4fbf-b0bd-d8ff3a40db1c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.238467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7819ce0-fbbc-4fbf-b0bd-d8ff3a40db1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.256281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c7819ce0-fbbc-4fbf-b0bd-d8ff3a40db1c None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:50.257871 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c7819ce0-fbbc-4fbf-b0bd-d8ff3a40db1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:50.307636 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d8a42e-c2f9-4503-931d-e46588ed7fdf None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:50.330035 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 407/797] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:16:50.331289 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7819ce0-fbbc-4fbf-b0bd-d8ff3a40db1c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:50.350430 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372e267-6c54-4b14-a55b-9f675f86fba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:50.351576 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372e267-6c54-4b14-a55b-9f675f86fba7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.352065 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372e267-6c54-4b14-a55b-9f675f86fba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.352608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4372e267-6c54-4b14-a55b-9f675f86fba7 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.353642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372e267-6c54-4b14-a55b-9f675f86fba7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:50.354249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372e267-6c54-4b14-a55b-9f675f86fba7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:50.355902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4372e267-6c54-4b14-a55b-9f675f86fba7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:50.370384 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 391/798] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:50.376214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372e267-6c54-4b14-a55b-9f675f86fba7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:50.444981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:50.456327 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7819ce0-fbbc-4fbf-b0bd-d8ff3a40db1c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:50.462735 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:50.489059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4372e267-6c54-4b14-a55b-9f675f86fba7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:50.496770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633149ae-5c86-45a8-b035-4d64c667ead2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:50.497541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633149ae-5c86-45a8-b035-4d64c667ead2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.497881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633149ae-5c86-45a8-b035-4d64c667ead2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.498550 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633149ae-5c86-45a8-b035-4d64c667ead2 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.499057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633149ae-5c86-45a8-b035-4d64c667ead2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:50.499366 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633149ae-5c86-45a8-b035-4d64c667ead2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:50.500726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633149ae-5c86-45a8-b035-4d64c667ead2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:50.512731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 408/799] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:50.518311 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633149ae-5c86-45a8-b035-4d64c667ead2 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:50.528479 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f1ecf-a5fd-4c3d-8400-c00f1c221748 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:50.529712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f1ecf-a5fd-4c3d-8400-c00f1c221748 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.529999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f1ecf-a5fd-4c3d-8400-c00f1c221748 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.530272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f1ecf-a5fd-4c3d-8400-c00f1c221748 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.530961 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f1ecf-a5fd-4c3d-8400-c00f1c221748 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:50.532323 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f1ecf-a5fd-4c3d-8400-c00f1c221748 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:50.545482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8e2f1ecf-a5fd-4c3d-8400-c00f1c221748 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:16:50.545482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:50.545482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:16:50.545482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:16:50.545482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:16:50.545482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:16:50.545482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:16:50.545482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:50.545482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:16:50.545482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:50.545482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:16:50.545482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:50.545482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:50.545482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:50.545482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:50.545482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:50.546547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:50.546547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:50.546547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:50.546547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:50.546547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:50.546547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:50.546547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:50.546547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:16:50.546547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:16:50.546547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:16:50.546547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:16:50.546547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:50.546547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:50.546547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:50.546547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:50.546547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:50.548028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:50.548028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:50.548028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:50.548028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:50.548028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:50.548028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:50.548028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:50.548028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:50.548028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:50.548028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:50.548028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:50.548028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:16:50.548028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:50.548028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 15 19:16:50.548028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:50.548028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 392/800] 10.222.0.40 () {56 vars in 1129 bytes} [Fri Jul 15 19:16:50 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:50.548886 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baef1f2-d0a3-4336-a688-9affc3880017 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.548886 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baef1f2-d0a3-4336-a688-9affc3880017 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.548886 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2baef1f2-d0a3-4336-a688-9affc3880017 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.554013 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 393/801] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:50.554013 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baef1f2-d0a3-4336-a688-9affc3880017 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:50.636925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633149ae-5c86-45a8-b035-4d64c667ead2 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:50.663530 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2baef1f2-d0a3-4336-a688-9affc3880017 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:50.675331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7df24-4c48-40cf-a8ac-08faea6e2d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:50.676167 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7df24-4c48-40cf-a8ac-08faea6e2d0d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.676465 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7df24-4c48-40cf-a8ac-08faea6e2d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.676751 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d7df24-4c48-40cf-a8ac-08faea6e2d0d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.684269 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7df24-4c48-40cf-a8ac-08faea6e2d0d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:50.685745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1d7df24-4c48-40cf-a8ac-08faea6e2d0d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:50.697181 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63ff16a-df23-4b87-88df-8ef7894e5098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:50.697909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ff16a-df23-4b87-88df-8ef7894e5098 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.698192 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ff16a-df23-4b87-88df-8ef7894e5098 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.698459 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63ff16a-df23-4b87-88df-8ef7894e5098 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.701758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-c1d7df24-4c48-40cf-a8ac-08faea6e2d0d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:50.701758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:50.701758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:50.701758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:50.701758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:50.701758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:50.701758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:50.701758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:50.701758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:50.701758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:50.701758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:50.701758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:50.701758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:50.701758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:50.701758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:50.702852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:50.702852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:50.702852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:50.702852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:50.702852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:50.702852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:50.702852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:50.702852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:50.702852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:50.702852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:50.702852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:50.702852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:50.702852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:50.702852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:50.702852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:50.702852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:50.702852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:50.703775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:50.703775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:50.703775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:50.703775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:50.703775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:50.703775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:50.703775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:50.703775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:50.703775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 409/802] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:50.703775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7df24-4c48-40cf-a8ac-08faea6e2d0d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:50.712457 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ff16a-df23-4b87-88df-8ef7894e5098 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:50.713903 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63ff16a-df23-4b87-88df-8ef7894e5098 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:50.715860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:50.721058 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:50.730368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-d63ff16a-df23-4b87-88df-8ef7894e5098 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:16:50.730368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:50.730368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:50.730368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:50.730368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:50.730368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:50.730368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:50.730368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:50.730368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:50.730368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:50.730368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:50.730368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:50.730368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:50.730368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:50.730368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:50.730368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:50.731417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:50.732485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:50.732485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:50.732485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:50.732485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:50.732485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:50.732485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:50.732485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:50.732485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:50.732485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:16:50.732485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:50.732485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 394/803] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Jul 15 19:16:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:50.733601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3837d9-fc56-4f49-8413-57c26748dac2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.733601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3837d9-fc56-4f49-8413-57c26748dac2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.733601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3837d9-fc56-4f49-8413-57c26748dac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.750183 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-bb3837d9-fc56-4f49-8413-57c26748dac2 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:50.761142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bb3837d9-fc56-4f49-8413-57c26748dac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:50.817558 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d7df24-4c48-40cf-a8ac-08faea6e2d0d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:50.834775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 395/804] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:50 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:16:50.834775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3837d9-fc56-4f49-8413-57c26748dac2 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:50.866513 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d873f-c3b4-455c-8e44-6b51fb907562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:50.867604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d873f-c3b4-455c-8e44-6b51fb907562 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.867891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d873f-c3b4-455c-8e44-6b51fb907562 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.868163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d5d873f-c3b4-455c-8e44-6b51fb907562 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.868906 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d873f-c3b4-455c-8e44-6b51fb907562 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:50.869515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d873f-c3b4-455c-8e44-6b51fb907562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:50.871241 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d5d873f-c3b4-455c-8e44-6b51fb907562 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:50.881194 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 410/805] 10.222.0.40 () {56 vars in 1124 bytes} [Fri Jul 15 19:16:50 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:50.881194 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d873f-c3b4-455c-8e44-6b51fb907562 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:50.945921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3837d9-fc56-4f49-8413-57c26748dac2 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:50.957927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:50.977121 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:50.982249 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d5d873f-c3b4-455c-8e44-6b51fb907562 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:50.985223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5f6ac-b7cd-42ff-a4f1-21d0032f4a5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:50.985880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5f6ac-b7cd-42ff-a4f1-21d0032f4a5c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:50.986163 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5f6ac-b7cd-42ff-a4f1-21d0032f4a5c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:50.986432 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a5f6ac-b7cd-42ff-a4f1-21d0032f4a5c None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:50.987753 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5f6ac-b7cd-42ff-a4f1-21d0032f4a5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:50.988064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5f6ac-b7cd-42ff-a4f1-21d0032f4a5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:50.989538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a5f6ac-b7cd-42ff-a4f1-21d0032f4a5c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:51.007201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 396/806] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:51.007201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5f6ac-b7cd-42ff-a4f1-21d0032f4a5c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:51.023313 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256aa74-79b7-4c4b-ad41-055a549879db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:51.023986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256aa74-79b7-4c4b-ad41-055a549879db None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.024271 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256aa74-79b7-4c4b-ad41-055a549879db None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.024538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1256aa74-79b7-4c4b-ad41-055a549879db None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.025382 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256aa74-79b7-4c4b-ad41-055a549879db None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:51.025694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256aa74-79b7-4c4b-ad41-055a549879db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:51.027150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1256aa74-79b7-4c4b-ad41-055a549879db None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:51.045819 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 411/807] 10.222.0.40 () {56 vars in 1149 bytes} [Fri Jul 15 19:16:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:51.046651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256aa74-79b7-4c4b-ad41-055a549879db None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:51.112148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a5f6ac-b7cd-42ff-a4f1-21d0032f4a5c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:51.146248 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c180de-083d-49e8-94a1-62dcfca1eb73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:51.147066 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c180de-083d-49e8-94a1-62dcfca1eb73 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.147353 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c180de-083d-49e8-94a1-62dcfca1eb73 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.147630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c180de-083d-49e8-94a1-62dcfca1eb73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.147752 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1256aa74-79b7-4c4b-ad41-055a549879db None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:51.158173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c180de-083d-49e8-94a1-62dcfca1eb73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:51.165815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-50c180de-083d-49e8-94a1-62dcfca1eb73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:51.165815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:51.165815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:51.165815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:51.165815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:51.165815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:51.165815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:51.165815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:51.165815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:51.165815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:51.165815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:51.165815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:51.165815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:51.165815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:51.165815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:51.165815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:51.166896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:51.166896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:51.166896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:51.166896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:51.166896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:51.166896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:51.166896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:51.166896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:51.166896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:51.166896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:51.166896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:51.166896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:51.166896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:51.166896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:51.166896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:51.166896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:51.167785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:51.167785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:51.167785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:51.167785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:51.167785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:51.167785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:51.167785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:51.167785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:51.167785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:51.167785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:51.167785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:51.167785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:51.167785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 397/808] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:51.167785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c180de-083d-49e8-94a1-62dcfca1eb73 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:51.185864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60bfac89-3a50-4245-8f4d-1c481b6e87ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:51.186529 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfac89-3a50-4245-8f4d-1c481b6e87ef None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.186858 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfac89-3a50-4245-8f4d-1c481b6e87ef None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.187137 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60bfac89-3a50-4245-8f4d-1c481b6e87ef None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.187847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfac89-3a50-4245-8f4d-1c481b6e87ef None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:51.188153 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfac89-3a50-4245-8f4d-1c481b6e87ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:51.189517 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60bfac89-3a50-4245-8f4d-1c481b6e87ef None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:51.190842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:51.194850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 412/809] 10.222.0.40 () {56 vars in 1124 bytes} [Fri Jul 15 19:16:51 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:51.196071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a81cad-be20-4d4b-b490-5098486b7e24 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.196415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a81cad-be20-4d4b-b490-5098486b7e24 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.196697 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a81cad-be20-4d4b-b490-5098486b7e24 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.198092 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 413/810] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:51.198590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a81cad-be20-4d4b-b490-5098486b7e24 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:51.223233 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:51.274768 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c180de-083d-49e8-94a1-62dcfca1eb73 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:51.302345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a81cad-be20-4d4b-b490-5098486b7e24 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:51.308835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce038cc-056c-458f-9e99-fbd39a5432cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:51.309487 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce038cc-056c-458f-9e99-fbd39a5432cb None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.309775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce038cc-056c-458f-9e99-fbd39a5432cb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.310050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce038cc-056c-458f-9e99-fbd39a5432cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.311027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce038cc-056c-458f-9e99-fbd39a5432cb None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=850a32e590154968bfbbfc404450b70a) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:51.311342 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce038cc-056c-458f-9e99-fbd39a5432cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:51.312781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce038cc-056c-458f-9e99-fbd39a5432cb None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:51.318848 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 398/811] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:51 2022] GET /identity/v3/role_assignments?user.id=850a32e590154968bfbbfc404450b70a&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:51.319442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce038cc-056c-458f-9e99-fbd39a5432cb None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:51.349579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbe303-4d18-448b-a208-ecc6e98bfa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:51.350390 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbe303-4d18-448b-a208-ecc6e98bfa29 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.350662 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbe303-4d18-448b-a208-ecc6e98bfa29 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.350990 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adcbe303-4d18-448b-a208-ecc6e98bfa29 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.364064 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbe303-4d18-448b-a208-ecc6e98bfa29 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:51.366036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adcbe303-4d18-448b-a208-ecc6e98bfa29 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:51.386727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-adcbe303-4d18-448b-a208-ecc6e98bfa29 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:51.386727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:51.386727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:51.386727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:51.386727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:51.386727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:51.386727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:51.386727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:51.386727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:51.386727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:51.386727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:51.386727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:51.386727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:51.386727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:51.386727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:51.387733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:51.387733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:51.387733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:51.387733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:51.387733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:51.387733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:51.387733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:51.387733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:51.387733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:51.387733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:51.387733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:51.387733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:51.387733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:51.387733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:51.387733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:51.387733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:51.387733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:51.388999 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:51.388999 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:51.388999 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:51.388999 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:51.388999 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 414/812] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:51.388999 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbe303-4d18-448b-a208-ecc6e98bfa29 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:51.441485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce038cc-056c-458f-9e99-fbd39a5432cb None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:51.448732 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:51.456756 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:51.482500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724088b0-0243-49c8-9b46-bf5fe16385de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:51.483274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724088b0-0243-49c8-9b46-bf5fe16385de None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.483373 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724088b0-0243-49c8-9b46-bf5fe16385de None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.483624 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724088b0-0243-49c8-9b46-bf5fe16385de None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.484366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724088b0-0243-49c8-9b46-bf5fe16385de None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:51.485197 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724088b0-0243-49c8-9b46-bf5fe16385de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:51.486375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724088b0-0243-49c8-9b46-bf5fe16385de None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:51.495957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 399/813] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:51.497367 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82272bc-5bb6-4115-96a1-ac7e6f589c52 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.497655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82272bc-5bb6-4115-96a1-ac7e6f589c52 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.497926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82272bc-5bb6-4115-96a1-ac7e6f589c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.516616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adcbe303-4d18-448b-a208-ecc6e98bfa29 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:51.518004 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a82272bc-5bb6-4115-96a1-ac7e6f589c52 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:51.519344 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a82272bc-5bb6-4115-96a1-ac7e6f589c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:51.556767 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76babc-7cf1-4fcd-b13f-2360fbda0f0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:51.557449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76babc-7cf1-4fcd-b13f-2360fbda0f0a None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.557740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76babc-7cf1-4fcd-b13f-2360fbda0f0a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.558011 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d76babc-7cf1-4fcd-b13f-2360fbda0f0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.558864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76babc-7cf1-4fcd-b13f-2360fbda0f0a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:51.560229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d76babc-7cf1-4fcd-b13f-2360fbda0f0a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:51.594727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 400/814] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:16:51.596491 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82272bc-5bb6-4115-96a1-ac7e6f589c52 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:51.644153 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 415/815] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Jul 15 19:16:51 2022] POST /identity/v3/endpoints => generated 346 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:51.645630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76babc-7cf1-4fcd-b13f-2360fbda0f0a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:51.722641 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82272bc-5bb6-4115-96a1-ac7e6f589c52 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:51.725402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:51.773161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba128fdd-cbbc-47b8-952b-1ca0b64293f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:51.773374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d76babc-7cf1-4fcd-b13f-2360fbda0f0a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:51.773742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128fdd-cbbc-47b8-952b-1ca0b64293f8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.774021 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128fdd-cbbc-47b8-952b-1ca0b64293f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.774353 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba128fdd-cbbc-47b8-952b-1ca0b64293f8 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.775035 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:51.776323 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba128fdd-cbbc-47b8-952b-1ca0b64293f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:51.776635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba128fdd-cbbc-47b8-952b-1ca0b64293f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:51.778046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba128fdd-cbbc-47b8-952b-1ca0b64293f8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:51.792569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 401/816] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:51.793450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba128fdd-cbbc-47b8-952b-1ca0b64293f8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:51.817055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87478eaf-9f29-4c9e-bd18-7ba145029d65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:51.817864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87478eaf-9f29-4c9e-bd18-7ba145029d65 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.818149 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87478eaf-9f29-4c9e-bd18-7ba145029d65 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.818448 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87478eaf-9f29-4c9e-bd18-7ba145029d65 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.831921 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87478eaf-9f29-4c9e-bd18-7ba145029d65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:51.833816 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87478eaf-9f29-4c9e-bd18-7ba145029d65 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:51.857900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-87478eaf-9f29-4c9e-bd18-7ba145029d65 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:51.857900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:51.857900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:51.857900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:51.857900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:51.857900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:51.857900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:51.857900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:51.857900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:51.857900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:51.857900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:51.857900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:51.857900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:51.857900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:51.857900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:51.859097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:51.859097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:51.859097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:51.859097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:51.859097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:51.859097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:51.859097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:51.859097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:51.859097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:51.859097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:51.859097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:51.859097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:51.859097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:51.859097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:51.859097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:51.859097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:51.859097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:51.860161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:51.860161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:51.860161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:51.860161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:51.861756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 416/817] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:51.862809 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87478eaf-9f29-4c9e-bd18-7ba145029d65 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:51.924514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba128fdd-cbbc-47b8-952b-1ca0b64293f8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:51.973142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38c9bc-d50f-49cd-a0a5-5c1a38780e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:51.973937 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38c9bc-d50f-49cd-a0a5-5c1a38780e8c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:51.974218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38c9bc-d50f-49cd-a0a5-5c1a38780e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:51.974537 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f38c9bc-d50f-49cd-a0a5-5c1a38780e8c None admin] PATH_INFO: `/v3/services/network` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:51.975509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38c9bc-d50f-49cd-a0a5-5c1a38780e8c None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:51.977142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f38c9bc-d50f-49cd-a0a5-5c1a38780e8c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:51.987462 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87478eaf-9f29-4c9e-bd18-7ba145029d65 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:51.993154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-4f38c9bc-d50f-49cd-a0a5-5c1a38780e8c None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:16:51.993154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:51.993154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:16:51.993154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:16:51.993154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:16:51.993154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:16:51.993154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:16:51.993154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:51.993154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:16:51.993154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:51.993154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:16:51.993154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:51.993154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:51.993154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:51.993154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:51.993154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:51.993154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:51.994175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:51.994175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:51.994175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:51.994175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:51.994175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:51.994175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:51.994175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:16:51.994175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:16:51.994175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:16:51.994175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:16:51.994175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:51.994175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:51.994175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:51.994175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:51.994175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:51.994175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:51.995079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:51.995079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:51.995079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:51.995079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:51.995079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:51.995079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:51.995079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:51.995079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:51.995079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:51.995079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:51.995079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:16:51.995079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:51.995079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 15 19:16:51.995079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:51.995079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 402/818] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:51 2022] GET /identity/v3/services/network => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:52.001970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38c9bc-d50f-49cd-a0a5-5c1a38780e8c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:52.031126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:52.046152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a3940-dc81-4943-b5ab-1dc3605165dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:52.047732 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3940-dc81-4943-b5ab-1dc3605165dd None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:52.048017 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3940-dc81-4943-b5ab-1dc3605165dd None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:52.048289 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55a3940-dc81-4943-b5ab-1dc3605165dd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:52.060047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a3940-dc81-4943-b5ab-1dc3605165dd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:52.061820 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f55a3940-dc81-4943-b5ab-1dc3605165dd None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:52.083199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-f55a3940-dc81-4943-b5ab-1dc3605165dd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:52.083199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:52.083199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:52.083199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:52.083199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:52.083199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:52.083199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:52.083199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:52.083199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:52.083199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:52.083199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:52.083199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:52.083199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:52.083199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:52.083199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:52.084097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:52.084097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:52.084097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:52.084097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:52.084097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:52.084097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:52.084097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:52.084097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:52.084097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:52.084097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:52.084097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:52.084097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:52.084097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:52.084097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:52.084097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:52.084097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:52.084097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:52.085086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:52.085086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:52.085086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:52.085086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:52.085086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:52.085086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:52.085086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:52.085086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:52.089119 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 417/819] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:52.090642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a3940-dc81-4943-b5ab-1dc3605165dd None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:52.109369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:52.127968 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f38c9bc-d50f-49cd-a0a5-5c1a38780e8c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:52.176461 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8d8bb-59e5-4021-9812-12296c9ecf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:52.177493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8d8bb-59e5-4021-9812-12296c9ecf1f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:52.177972 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8d8bb-59e5-4021-9812-12296c9ecf1f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:52.178467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c8d8bb-59e5-4021-9812-12296c9ecf1f None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:52.179437 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8d8bb-59e5-4021-9812-12296c9ecf1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:52.179962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8d8bb-59e5-4021-9812-12296c9ecf1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:52.181551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c8d8bb-59e5-4021-9812-12296c9ecf1f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:52.204178 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 403/820] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:52.204178 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8d8bb-59e5-4021-9812-12296c9ecf1f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:52.222887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55a3940-dc81-4943-b5ab-1dc3605165dd None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:52.271533 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5147be0-0b72-453c-9d1e-f3304406336c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:52.272445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5147be0-0b72-453c-9d1e-f3304406336c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:52.272898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5147be0-0b72-453c-9d1e-f3304406336c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:52.273423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5147be0-0b72-453c-9d1e-f3304406336c None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:52.274830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5147be0-0b72-453c-9d1e-f3304406336c None admin] RBAC: Adding query filter params (name=network) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:52.275969 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5147be0-0b72-453c-9d1e-f3304406336c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:52.277767 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5147be0-0b72-453c-9d1e-f3304406336c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:52.289297 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 418/821] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Jul 15 19:16:52 2022] GET /identity/v3/services?name=network => generated 124 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:52.289297 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5147be0-0b72-453c-9d1e-f3304406336c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:52.300224 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:52.318113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c8d8bb-59e5-4021-9812-12296c9ecf1f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:52.355469 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175a487-d09d-4950-8589-c633923c1e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:52.356185 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175a487-d09d-4950-8589-c633923c1e6e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:52.356466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175a487-d09d-4950-8589-c633923c1e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:52.356974 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6175a487-d09d-4950-8589-c633923c1e6e None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:52.357782 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175a487-d09d-4950-8589-c633923c1e6e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:52.358144 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175a487-d09d-4950-8589-c633923c1e6e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:52.359657 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6175a487-d09d-4950-8589-c633923c1e6e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:52.373221 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 404/822] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:52.374074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175a487-d09d-4950-8589-c633923c1e6e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:52.400848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:52.432197 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5147be0-0b72-453c-9d1e-f3304406336c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:52.481115 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6482b-75bc-499e-91b1-12f0f5e00edb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:52.482814 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6482b-75bc-499e-91b1-12f0f5e00edb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:52.483803 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6482b-75bc-499e-91b1-12f0f5e00edb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:52.484426 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91d6482b-75bc-499e-91b1-12f0f5e00edb None admin] PATH_INFO: `/v3/users/swift` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:52.493769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6175a487-d09d-4950-8589-c633923c1e6e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:52.496386 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6482b-75bc-499e-91b1-12f0f5e00edb None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:52.499642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91d6482b-75bc-499e-91b1-12f0f5e00edb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:52.519606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-91d6482b-75bc-499e-91b1-12f0f5e00edb None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:16:52.519606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:52.519606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:52.519606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:52.519606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:52.519606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:52.519606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:52.519606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:52.519606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:52.519606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:52.519606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:52.519606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:52.519606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:52.519606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:52.519606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:52.519606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:52.520854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:52.521823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:52.521823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:52.521823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:52.521823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:52.521823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:52.521823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:52.521823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:52.521823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:52.521823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:16:52.521823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:52.525527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 419/823] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:52 2022] GET /identity/v3/users/swift => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:52.526572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6482b-75bc-499e-91b1-12f0f5e00edb None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:52.542285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702932ce-cbb1-4884-8532-5f1a926450e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:52.543471 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702932ce-cbb1-4884-8532-5f1a926450e6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:52.543972 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702932ce-cbb1-4884-8532-5f1a926450e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:52.544518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702932ce-cbb1-4884-8532-5f1a926450e6 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:52.545469 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702932ce-cbb1-4884-8532-5f1a926450e6 None admin] RBAC: Adding query filter params (type=network) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:52.545979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702932ce-cbb1-4884-8532-5f1a926450e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:52.547817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702932ce-cbb1-4884-8532-5f1a926450e6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:52.559090 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 405/824] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Jul 15 19:16:52 2022] GET /identity/v3/services?type=network => generated 350 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:52.561005 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702932ce-cbb1-4884-8532-5f1a926450e6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:52.576606 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:52.633960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91d6482b-75bc-499e-91b1-12f0f5e00edb None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:52.673523 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d2147-3115-4b5f-ac20-854b83c0d723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:52.674610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d2147-3115-4b5f-ac20-854b83c0d723 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:52.674990 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d2147-3115-4b5f-ac20-854b83c0d723 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:52.675331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338d2147-3115-4b5f-ac20-854b83c0d723 None admin] PATH_INFO: `/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/deed55901c264b8da58e57c21840c491/roles/579726a957a7468abecab3fbdb4351a9` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:52.683907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:52.686107 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702932ce-cbb1-4884-8532-5f1a926450e6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:52.691168 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d2147-3115-4b5f-ac20-854b83c0d723 None admin] RBAC: Authorizing `identity:create_grant(project_id=861de78bbfe84bd991c3ab54e85573a7, user_id=deed55901c264b8da58e57c21840c491, role_id=579726a957a7468abecab3fbdb4351a9)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:52.697397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338d2147-3115-4b5f-ac20-854b83c0d723 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:52.724609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c313fff-d1e4-4bee-b859-4ecd6ec7b6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:52.725429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c313fff-d1e4-4bee-b859-4ecd6ec7b6ec None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:52.725789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c313fff-d1e4-4bee-b859-4ecd6ec7b6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:52.726137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c313fff-d1e4-4bee-b859-4ecd6ec7b6ec None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:52.727184 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c313fff-d1e4-4bee-b859-4ecd6ec7b6ec None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:52.727562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c313fff-d1e4-4bee-b859-4ecd6ec7b6ec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:52.729085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c313fff-d1e4-4bee-b859-4ecd6ec7b6ec None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:52.752492 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 406/825] 10.222.0.40 () {56 vars in 1135 bytes} [Fri Jul 15 19:16:52 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:52.752492 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c313fff-d1e4-4bee-b859-4ecd6ec7b6ec None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:52.777553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 420/826] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:16:52 2022] PUT /identity/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/deed55901c264b8da58e57c21840c491/roles/579726a957a7468abecab3fbdb4351a9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:52.779824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d2147-3115-4b5f-ac20-854b83c0d723 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:52.832620 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:52.877913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c313fff-d1e4-4bee-b859-4ecd6ec7b6ec None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:52.931377 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07976381-df63-4999-bacb-1a3ca95e7512 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:52.932372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07976381-df63-4999-bacb-1a3ca95e7512 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:52.933074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07976381-df63-4999-bacb-1a3ca95e7512 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:52.933526 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07976381-df63-4999-bacb-1a3ca95e7512 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:52.935773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07976381-df63-4999-bacb-1a3ca95e7512 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:52.938146 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07976381-df63-4999-bacb-1a3ca95e7512 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:52.946571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338d2147-3115-4b5f-ac20-854b83c0d723 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:52.999790 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d5802-08c0-40c1-83ad-10a7b960ce3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:53.000708 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5802-08c0-40c1-83ad-10a7b960ce3f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.001001 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5802-08c0-40c1-83ad-10a7b960ce3f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.001279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d5802-08c0-40c1-83ad-10a7b960ce3f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.013389 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d5802-08c0-40c1-83ad-10a7b960ce3f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:53.014998 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d5802-08c0-40c1-83ad-10a7b960ce3f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:53.028023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 407/827] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Jul 15 19:16:52 2022] POST /identity/v3/endpoints => generated 327 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:53.037694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-e68d5802-08c0-40c1-83ad-10a7b960ce3f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:53.037694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:53.037694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:53.037694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:53.037694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:53.037694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:53.037694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:53.037694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:53.037694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:53.037694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:53.037694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:53.037694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:53.037694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:53.037694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:53.037694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:53.038670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:53.038670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:53.038670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:53.038670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:53.038670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:53.038670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:53.038670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:53.038670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:53.038670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:53.038670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:53.038670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:53.038670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:53.038670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:53.038670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:53.038670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:53.038670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:53.038670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:53.039634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:53.039634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:53.039634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:53.039634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:53.039634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 421/828] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:53.046634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07976381-df63-4999-bacb-1a3ca95e7512 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:53.202845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07976381-df63-4999-bacb-1a3ca95e7512 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:53.227831 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:53.247659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763e513-9ddb-4e9a-8768-bf4b86578bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:53.248526 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763e513-9ddb-4e9a-8768-bf4b86578bda None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.248816 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763e513-9ddb-4e9a-8768-bf4b86578bda None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.249092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4763e513-9ddb-4e9a-8768-bf4b86578bda None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.249879 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763e513-9ddb-4e9a-8768-bf4b86578bda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:53.250195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763e513-9ddb-4e9a-8768-bf4b86578bda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:53.251607 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4763e513-9ddb-4e9a-8768-bf4b86578bda None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:53.269072 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 408/829] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:53.274297 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d5802-08c0-40c1-83ad-10a7b960ce3f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:53.324728 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:53.395680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d5802-08c0-40c1-83ad-10a7b960ce3f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:53.442523 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cfdafd-f390-454f-baaa-3c0e8a607c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:53.443348 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfdafd-f390-454f-baaa-3c0e8a607c73 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.443622 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfdafd-f390-454f-baaa-3c0e8a607c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.443891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cfdafd-f390-454f-baaa-3c0e8a607c73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.451923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfdafd-f390-454f-baaa-3c0e8a607c73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:53.453490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cfdafd-f390-454f-baaa-3c0e8a607c73 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:53.468501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-14cfdafd-f390-454f-baaa-3c0e8a607c73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:53.468501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:53.468501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:53.468501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:53.468501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:53.468501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:53.468501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:53.468501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:53.468501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:53.468501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:53.468501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:53.468501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:53.468501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:53.468501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:53.468501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:53.469556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:53.469556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:53.469556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:53.469556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:53.469556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:53.469556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:53.469556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:53.469556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:53.469556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:53.469556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:53.469556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:53.469556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:53.469556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:53.469556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:53.469556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:53.469556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:53.469556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:53.470618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:53.470618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:53.470618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:53.470618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:53.470618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:53.470618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:53.470618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:53.470618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:53.470618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 422/830] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:16:53.477206 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763e513-9ddb-4e9a-8768-bf4b86578bda None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:53.507671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef03c59-7334-49a1-86dd-70192b8feea4 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.507997 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef03c59-7334-49a1-86dd-70192b8feea4 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.508214 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef03c59-7334-49a1-86dd-70192b8feea4 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.509833 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 423/831] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:53.519306 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831abf5-e559-4331-ae09-707dd8957947 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.519718 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831abf5-e559-4331-ae09-707dd8957947 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.519998 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7831abf5-e559-4331-ae09-707dd8957947 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.543012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-7831abf5-e559-4331-ae09-707dd8957947 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:53.544278 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-7831abf5-e559-4331-ae09-707dd8957947 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:53.625314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4763e513-9ddb-4e9a-8768-bf4b86578bda None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:53.635152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 424/832] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:53 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:16:53.658054 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831abf5-e559-4331-ae09-707dd8957947 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:53.669767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71188ca5-2ca2-42e9-8ed7-598de20dd04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:53.671032 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71188ca5-2ca2-42e9-8ed7-598de20dd04f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.671476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71188ca5-2ca2-42e9-8ed7-598de20dd04f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.671884 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71188ca5-2ca2-42e9-8ed7-598de20dd04f None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.672685 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71188ca5-2ca2-42e9-8ed7-598de20dd04f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:53.672998 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71188ca5-2ca2-42e9-8ed7-598de20dd04f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:53.675271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71188ca5-2ca2-42e9-8ed7-598de20dd04f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:53.691221 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:53.694406 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 409/833] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:53.700978 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71188ca5-2ca2-42e9-8ed7-598de20dd04f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:53.757198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:53.776881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7831abf5-e559-4331-ae09-707dd8957947 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:53.816841 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d11e3-ee9a-4348-ae65-0ca518a04392 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:53.818193 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d11e3-ee9a-4348-ae65-0ca518a04392 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.818659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d11e3-ee9a-4348-ae65-0ca518a04392 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.819361 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d11e3-ee9a-4348-ae65-0ca518a04392 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.820569 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d11e3-ee9a-4348-ae65-0ca518a04392 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:53.822101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d11e3-ee9a-4348-ae65-0ca518a04392 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:53.836275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71188ca5-2ca2-42e9-8ed7-598de20dd04f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:53.841941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-8b2d11e3-ee9a-4348-ae65-0ca518a04392 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:16:53.841941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:53.841941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:16:53.841941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:16:53.841941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:16:53.841941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:16:53.841941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:16:53.841941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:53.841941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:16:53.841941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:53.841941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:16:53.841941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:53.841941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:53.841941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:53.841941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:53.841941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:53.843082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:53.843082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:53.843082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:53.843082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:53.843082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:53.843082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:53.843082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:53.843082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:16:53.843082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:16:53.843082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:16:53.843082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:16:53.843082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:53.843082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:53.843082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:53.843082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:53.843082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:53.844144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:53.844144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:53.844144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:53.844144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:53.844144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:53.844144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:53.844144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:53.844144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:53.844144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:53.844144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:53.844144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:53.844144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:16:53.844144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:53.844144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:16:53.844144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:53.846777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 425/834] 10.222.0.40 () {56 vars in 1132 bytes} [Fri Jul 15 19:16:53 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:53.852520 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d11e3-ee9a-4348-ae65-0ca518a04392 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:53.893850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7fb4c7-04cd-477a-93b3-3cf12c23b215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:53.895025 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fb4c7-04cd-477a-93b3-3cf12c23b215 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:53.895454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fb4c7-04cd-477a-93b3-3cf12c23b215 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:53.895872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7fb4c7-04cd-477a-93b3-3cf12c23b215 None admin] PATH_INFO: `/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/0402e1bd20b042cdbdcb890616b22726/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:53.898727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fb4c7-04cd-477a-93b3-3cf12c23b215 None admin] RBAC: Authorizing `identity:create_grant(project_id=861de78bbfe84bd991c3ab54e85573a7, user_id=0402e1bd20b042cdbdcb890616b22726, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:53.901266 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a7fb4c7-04cd-477a-93b3-3cf12c23b215 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:53.963172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:53.970898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d11e3-ee9a-4348-ae65-0ca518a04392 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:54.006462 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ed7c7-27a5-4501-b03f-95d2f97e5d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:54.007260 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ed7c7-27a5-4501-b03f-95d2f97e5d43 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.007491 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ed7c7-27a5-4501-b03f-95d2f97e5d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.007764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49ed7c7-27a5-4501-b03f-95d2f97e5d43 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.008471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ed7c7-27a5-4501-b03f-95d2f97e5d43 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:54.008774 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ed7c7-27a5-4501-b03f-95d2f97e5d43 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:54.010134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49ed7c7-27a5-4501-b03f-95d2f97e5d43 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:54.016760 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 410/835] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:16:53 2022] PUT /identity/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/0402e1bd20b042cdbdcb890616b22726/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:16:54.018932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c872d-1202-4f1d-836f-472a3aeddf03 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.019475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c872d-1202-4f1d-836f-472a3aeddf03 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.019938 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5c872d-1202-4f1d-836f-472a3aeddf03 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.025224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 426/836] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Jul 15 19:16:53 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:54.025224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ed7c7-27a5-4501-b03f-95d2f97e5d43 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:54.025418 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 411/837] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:54.028933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99009-dbe6-4830-9248-eecd5649bc2b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.029675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99009-dbe6-4830-9248-eecd5649bc2b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.030287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a99009-dbe6-4830-9248-eecd5649bc2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.056445 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-21a99009-dbe6-4830-9248-eecd5649bc2b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:54.058924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-21a99009-dbe6-4830-9248-eecd5649bc2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:54.155686 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49ed7c7-27a5-4501-b03f-95d2f97e5d43 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:54.170194 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 412/838] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:54 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:16:54.192613 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99009-dbe6-4830-9248-eecd5649bc2b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:54.202116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcead0fc-a9f1-49de-a78b-0f098147ecd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:54.202816 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead0fc-a9f1-49de-a78b-0f098147ecd6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.203100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead0fc-a9f1-49de-a78b-0f098147ecd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.203383 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcead0fc-a9f1-49de-a78b-0f098147ecd6 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.204124 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcead0fc-a9f1-49de-a78b-0f098147ecd6 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:54.204433 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcead0fc-a9f1-49de-a78b-0f098147ecd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:54.205801 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcead0fc-a9f1-49de-a78b-0f098147ecd6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:54.214291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 427/839] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Jul 15 19:16:54 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:54.230904 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:54.322856 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a99009-dbe6-4830-9248-eecd5649bc2b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:54.368053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10937554-27ea-429d-a238-bdc10e165244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:54.368865 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10937554-27ea-429d-a238-bdc10e165244 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.369143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10937554-27ea-429d-a238-bdc10e165244 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.369413 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10937554-27ea-429d-a238-bdc10e165244 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.370123 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10937554-27ea-429d-a238-bdc10e165244 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:54.371667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10937554-27ea-429d-a238-bdc10e165244 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:54.384529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-10937554-27ea-429d-a238-bdc10e165244 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:16:54.384529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:54.384529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:16:54.384529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:16:54.384529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:16:54.384529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:16:54.384529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:16:54.384529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:54.384529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:16:54.384529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:54.384529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:16:54.384529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:54.384529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:54.384529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:54.384529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:54.384529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:54.384529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:54.385693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:54.385693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:54.385693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:54.385693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:54.385693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:54.385693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:54.385693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:16:54.385693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:16:54.385693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:16:54.385693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:16:54.385693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:54.385693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:54.385693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:54.385693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:54.385693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:54.385693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:54.386612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:54.386612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:54.386612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:54.386612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:54.386612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:54.386612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:54.386612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:54.386612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:54.386612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:54.386612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:54.386612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:16:54.386612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:54.386612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:16:54.386612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:54.386612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 413/840] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:16:54 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:16:54.393318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcead0fc-a9f1-49de-a78b-0f098147ecd6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:54.421782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:54.503773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcead0fc-a9f1-49de-a78b-0f098147ecd6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:54.539944 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2239389c-a961-48b5-b5d5-ab02b84629ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:54.540617 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239389c-a961-48b5-b5d5-ab02b84629ee None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.540900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239389c-a961-48b5-b5d5-ab02b84629ee None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.541175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2239389c-a961-48b5-b5d5-ab02b84629ee None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.541887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239389c-a961-48b5-b5d5-ab02b84629ee None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:54.542192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239389c-a961-48b5-b5d5-ab02b84629ee None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:54.543607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2239389c-a961-48b5-b5d5-ab02b84629ee None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:54.549187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 428/841] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:16:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:54.554867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10937554-27ea-429d-a238-bdc10e165244 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:54.660587 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:54.669677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10937554-27ea-429d-a238-bdc10e165244 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:54.704983 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde9b4ba-e329-41b2-bc1b-0c5f649c250b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:54.705703 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9b4ba-e329-41b2-bc1b-0c5f649c250b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:54.705988 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9b4ba-e329-41b2-bc1b-0c5f649c250b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:54.706260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde9b4ba-e329-41b2-bc1b-0c5f649c250b None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:54.707046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9b4ba-e329-41b2-bc1b-0c5f649c250b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:54.707348 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9b4ba-e329-41b2-bc1b-0c5f649c250b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:54.708816 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde9b4ba-e329-41b2-bc1b-0c5f649c250b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:54.714646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 414/842] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:16:54 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:55.129375 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f4f1d-98f6-4e83-a0ec-e272d7d4f9f6 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:55.129921 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f4f1d-98f6-4e83-a0ec-e272d7d4f9f6 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:55.129921 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2f4f1d-98f6-4e83-a0ec-e272d7d4f9f6 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:55.131586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 429/843] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:55.137096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c669e80-400e-4b36-a265-87d5a725d843 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:55.137393 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c669e80-400e-4b36-a265-87d5a725d843 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:55.137712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c669e80-400e-4b36-a265-87d5a725d843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:55.154801 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9c669e80-400e-4b36-a265-87d5a725d843 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:55.156010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9c669e80-400e-4b36-a265-87d5a725d843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:55.230839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 415/844] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:55 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:16:55.255049 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f4f1d-98f6-4e83-a0ec-e272d7d4f9f6 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:55.347578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:55.363719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2f4f1d-98f6-4e83-a0ec-e272d7d4f9f6 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:55.401100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa82198-10cc-46e8-ad36-aefad500ad15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:55.401892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa82198-10cc-46e8-ad36-aefad500ad15 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:55.402173 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa82198-10cc-46e8-ad36-aefad500ad15 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:55.402448 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa82198-10cc-46e8-ad36-aefad500ad15 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:55.413127 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa82198-10cc-46e8-ad36-aefad500ad15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:55.421083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-0aa82198-10cc-46e8-ad36-aefad500ad15 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:55.421083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:55.421083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:55.421083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:55.421083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:55.421083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:55.421083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:55.421083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:55.421083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:55.421083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:55.421083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:55.421083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:55.421083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:55.421083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:55.421083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:55.421083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:55.422240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:55.422240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:55.422240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:55.422240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:55.422240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:55.422240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:55.422240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:55.422240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:55.422240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:55.422240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:55.422240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:55.422240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:55.422240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:55.422240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:55.422240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:55.422240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:55.423333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:55.423333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:55.423333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:55.423333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:55.423333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:55.423333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:55.423333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:55.423333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:55.423333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:55.423333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:55.423333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:16:55.423333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:55.423333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 430/845] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:16:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:55.428591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c669e80-400e-4b36-a265-87d5a725d843 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:55.519469 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:55.536518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c669e80-400e-4b36-a265-87d5a725d843 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:55.572439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb434c-8aad-453e-8551-8804864e565b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:55.573363 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb434c-8aad-453e-8551-8804864e565b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:55.573798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb434c-8aad-453e-8551-8804864e565b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:55.574237 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abb434c-8aad-453e-8551-8804864e565b None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:55.575310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb434c-8aad-453e-8551-8804864e565b None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:55.575865 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb434c-8aad-453e-8551-8804864e565b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:55.577377 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abb434c-8aad-453e-8551-8804864e565b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:55.586008 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 416/846] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:16:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:55.594858 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa82198-10cc-46e8-ad36-aefad500ad15 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:55.703333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa82198-10cc-46e8-ad36-aefad500ad15 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:55.737792 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ec090-63ae-4f9e-b822-0d198e4c9422 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:55.738684 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ec090-63ae-4f9e-b822-0d198e4c9422 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:55.738992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ec090-63ae-4f9e-b822-0d198e4c9422 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:55.739264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d3ec090-63ae-4f9e-b822-0d198e4c9422 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:55.750647 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ec090-63ae-4f9e-b822-0d198e4c9422 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:55.752192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d3ec090-63ae-4f9e-b822-0d198e4c9422 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:55.759112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:55.771756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-8d3ec090-63ae-4f9e-b822-0d198e4c9422 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:55.771756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:55.771756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:55.771756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:55.771756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:55.771756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:55.771756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:55.771756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:55.771756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:55.771756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:55.771756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:55.771756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:55.771756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:55.771756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:55.771756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:55.773008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:55.773008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:55.773008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:55.773008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:55.773008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:55.773008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:55.773008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:55.773008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:55.773008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:55.773008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:55.773008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:55.773008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:55.773008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:55.773008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:55.773008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:55.773008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:55.773008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:55.774080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:55.774080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:55.774080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:55.774080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:55.776384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 431/847] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:55.782008 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb434c-8aad-453e-8551-8804864e565b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:55.889558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abb434c-8aad-453e-8551-8804864e565b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:55.929394 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e037e21-c59d-4eae-92a4-03df11e8443b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:55.930344 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e037e21-c59d-4eae-92a4-03df11e8443b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:55.930802 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e037e21-c59d-4eae-92a4-03df11e8443b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:55.931228 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e037e21-c59d-4eae-92a4-03df11e8443b None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:55.932108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e037e21-c59d-4eae-92a4-03df11e8443b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:55.932691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e037e21-c59d-4eae-92a4-03df11e8443b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:55.934218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e037e21-c59d-4eae-92a4-03df11e8443b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:55.947892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 417/848] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:55.954944 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ec090-63ae-4f9e-b822-0d198e4c9422 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:56.063256 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d3ec090-63ae-4f9e-b822-0d198e4c9422 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:56.098722 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b9101a1-0c76-48e3-89ef-c8e9ae015fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:56.099562 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9101a1-0c76-48e3-89ef-c8e9ae015fec None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:56.099844 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9101a1-0c76-48e3-89ef-c8e9ae015fec None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:56.100116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b9101a1-0c76-48e3-89ef-c8e9ae015fec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:56.108303 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9101a1-0c76-48e3-89ef-c8e9ae015fec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:56.109742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b9101a1-0c76-48e3-89ef-c8e9ae015fec None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:56.124893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-4b9101a1-0c76-48e3-89ef-c8e9ae015fec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:16:56.124893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:56.124893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:56.124893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:56.124893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:56.124893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:56.124893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:56.124893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:56.124893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:56.124893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:56.124893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:56.124893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:56.124893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:56.124893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:56.124893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:56.124893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:56.125865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:56.126891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:56.126891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:56.126891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:56.126891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:56.126891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:56.126891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:56.126891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:56.126891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:56.126891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:16:56.126891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:56.126891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 432/849] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Jul 15 19:16:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:56.131982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e037e21-c59d-4eae-92a4-03df11e8443b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:56.144032 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:56.238986 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e037e21-c59d-4eae-92a4-03df11e8443b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:56.272837 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597ebfa-862b-4147-b74f-9b5fd0da51ed None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:56.273361 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597ebfa-862b-4147-b74f-9b5fd0da51ed None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:56.273361 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f597ebfa-862b-4147-b74f-9b5fd0da51ed None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:56.275438 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 433/850] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:16:56.279763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5a4af-9916-4b5e-afe8-bcf981ae178c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:56.280749 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5a4af-9916-4b5e-afe8-bcf981ae178c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:56.280869 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe95063-98c6-480c-a707-832a5183d579 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:56.281096 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe95063-98c6-480c-a707-832a5183d579 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:56.281377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe95063-98c6-480c-a707-832a5183d579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:56.281764 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5a4af-9916-4b5e-afe8-bcf981ae178c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:56.282226 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec5a4af-9916-4b5e-afe8-bcf981ae178c None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:56.283396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5a4af-9916-4b5e-afe8-bcf981ae178c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:56.283915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5a4af-9916-4b5e-afe8-bcf981ae178c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:56.285562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec5a4af-9916-4b5e-afe8-bcf981ae178c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:56.301702 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-bfe95063-98c6-480c-a707-832a5183d579 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:56.303241 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-bfe95063-98c6-480c-a707-832a5183d579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:56.305340 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 418/851] 10.222.0.40 () {56 vars in 1149 bytes} [Fri Jul 15 19:16:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:56.311668 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5a4af-9916-4b5e-afe8-bcf981ae178c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:56.371645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:56.398451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:56.398996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 434/852] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:16:56.404221 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c570d93-2391-403a-ba9f-8c4c9027bda7 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:56.404514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c570d93-2391-403a-ba9f-8c4c9027bda7 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:56.404796 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c570d93-2391-403a-ba9f-8c4c9027bda7 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:56.406298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 435/853] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:56.411564 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e00775-7943-40f0-96fa-a9776577c9b1 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:56.411858 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e00775-7943-40f0-96fa-a9776577c9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:56.412141 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e00775-7943-40f0-96fa-a9776577c9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:56.429949 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-b8e00775-7943-40f0-96fa-a9776577c9b1 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:56.431177 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b8e00775-7943-40f0-96fa-a9776577c9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:56.440714 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec5a4af-9916-4b5e-afe8-bcf981ae178c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:56.479208 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a550fb-ecf2-4e93-9fca-3427bc5d4e8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:56.479964 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a550fb-ecf2-4e93-9fca-3427bc5d4e8c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:56.480254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a550fb-ecf2-4e93-9fca-3427bc5d4e8c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:56.480526 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a550fb-ecf2-4e93-9fca-3427bc5d4e8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:56.500220 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 436/854] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:56 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:16:56.500824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e00775-7943-40f0-96fa-a9776577c9b1 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:56.562916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a550fb-ecf2-4e93-9fca-3427bc5d4e8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:56.564811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a550fb-ecf2-4e93-9fca-3427bc5d4e8c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:56.616370 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e00775-7943-40f0-96fa-a9776577c9b1 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:56.635959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:56.637287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:56.657238 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e727b7-ef30-4e8b-be40-8aecd90c3dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:56.658557 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e727b7-ef30-4e8b-be40-8aecd90c3dfd None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:56.659094 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e727b7-ef30-4e8b-be40-8aecd90c3dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:56.659539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e727b7-ef30-4e8b-be40-8aecd90c3dfd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:56.673385 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e727b7-ef30-4e8b-be40-8aecd90c3dfd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:16:56.684215 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 419/855] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:56 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 19:16:56.684215 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a550fb-ecf2-4e93-9fca-3427bc5d4e8c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:56.684853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-62e727b7-ef30-4e8b-be40-8aecd90c3dfd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:56.684853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:56.684853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:56.684853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:56.684853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:56.684853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:56.684853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:56.684853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:56.684853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:56.684853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:56.684853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:56.684853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:56.684853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:16:56.684853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:16:56.684853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:16:56.684853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:16:56.685967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:16:56.685967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:16:56.685967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:16:56.685967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:16:56.685967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:56.685967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:56.685967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:56.685967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:56.685967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:56.685967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:56.685967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:56.685967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:56.685967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:56.685967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:56.685967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:56.685967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:56.686981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:56.686981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:56.686981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:56.686981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:56.686981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:16:56.686981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:16:56.686981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:16:56.686981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:16:56.686981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:16:56.686981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:16:56.686981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:16:56.686981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:56.686981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 437/856] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:56.686981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e727b7-ef30-4e8b-be40-8aecd90c3dfd None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:56.794209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a550fb-ecf2-4e93-9fca-3427bc5d4e8c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:56.805406 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e727b7-ef30-4e8b-be40-8aecd90c3dfd None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:56.835951 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93af99e-9a39-40f3-b0a8-096a9edf429d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:56.836615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93af99e-9a39-40f3-b0a8-096a9edf429d None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:56.836897 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93af99e-9a39-40f3-b0a8-096a9edf429d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:56.837168 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93af99e-9a39-40f3-b0a8-096a9edf429d None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:56.837902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93af99e-9a39-40f3-b0a8-096a9edf429d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:56.839302 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93af99e-9a39-40f3-b0a8-096a9edf429d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:56.843113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72718e-4770-4a34-8f84-f0baf5c75a01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:56.844046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72718e-4770-4a34-8f84-f0baf5c75a01 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:56.844328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72718e-4770-4a34-8f84-f0baf5c75a01 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:56.844625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b72718e-4770-4a34-8f84-f0baf5c75a01 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:56.855772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72718e-4770-4a34-8f84-f0baf5c75a01 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:56.857355 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b72718e-4770-4a34-8f84-f0baf5c75a01 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:56.876350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-6b72718e-4770-4a34-8f84-f0baf5c75a01 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:56.876350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:56.876350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:56.876350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:56.876350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:56.876350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:56.876350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:56.876350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:56.876350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:56.876350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:56.876350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:56.876350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:56.876350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:56.876350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:56.876350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:56.877453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:56.877453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:56.877453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:56.877453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:56.877453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:56.877453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:56.877453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:56.877453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:56.877453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:56.877453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:56.877453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:56.877453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:56.877453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:56.877453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:56.877453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:56.877453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:56.877453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:56.878445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:56.878445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:56.878445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:56.878445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:56.878445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 438/857] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:56.878445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72718e-4770-4a34-8f84-f0baf5c75a01 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:56.909443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:56.911472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 420/858] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Jul 15 19:16:56 2022] POST /identity/v3/services => generated 269 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:56.912782 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716c8fb-36ad-4959-b1d9-6924743e6dd8 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:56.913069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716c8fb-36ad-4959-b1d9-6924743e6dd8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:56.913357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9716c8fb-36ad-4959-b1d9-6924743e6dd8 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:56.914613 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 421/859] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:56.915371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716c8fb-36ad-4959-b1d9-6924743e6dd8 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:56.953019 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:56.993865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b72718e-4770-4a34-8f84-f0baf5c75a01 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:57.045596 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f899e68-4a16-4e45-90cb-6f5d12e4d40a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:57.046190 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f899e68-4a16-4e45-90cb-6f5d12e4d40a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.046910 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f899e68-4a16-4e45-90cb-6f5d12e4d40a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.046910 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f899e68-4a16-4e45-90cb-6f5d12e4d40a None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.047516 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f899e68-4a16-4e45-90cb-6f5d12e4d40a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:57.047823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f899e68-4a16-4e45-90cb-6f5d12e4d40a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:57.049213 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f899e68-4a16-4e45-90cb-6f5d12e4d40a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:57.051030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9716c8fb-36ad-4959-b1d9-6924743e6dd8 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:57.063997 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 439/860] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:16:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:57.068488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9528af8-70eb-4e5f-b6b2-6158f3028011 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.068649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9528af8-70eb-4e5f-b6b2-6158f3028011 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.068868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9528af8-70eb-4e5f-b6b2-6158f3028011 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.088785 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d9528af8-70eb-4e5f-b6b2-6158f3028011 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:57.090065 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d9528af8-70eb-4e5f-b6b2-6158f3028011 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:57.095984 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d73c5-42d3-462f-af16-894b30419d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:57.096650 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d73c5-42d3-462f-af16-894b30419d83 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.096936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d73c5-42d3-462f-af16-894b30419d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.097215 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d73c5-42d3-462f-af16-894b30419d83 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.097953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d73c5-42d3-462f-af16-894b30419d83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:57.098262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d73c5-42d3-462f-af16-894b30419d83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:57.099667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d73c5-42d3-462f-af16-894b30419d83 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:57.113646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 422/861] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:57.114489 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d73c5-42d3-462f-af16-894b30419d83 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:57.164041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 440/862] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:57 2022] POST /identity/v3/auth/tokens => generated 1261 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:16:57.165037 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9528af8-70eb-4e5f-b6b2-6158f3028011 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:57.184088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:57.215024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:57.237949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d73c5-42d3-462f-af16-894b30419d83 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:57.270990 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9528af8-70eb-4e5f-b6b2-6158f3028011 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:57.281066 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a0db1-fb82-4bf8-979e-1b2ed7c5a92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:57.281864 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a0db1-fb82-4bf8-979e-1b2ed7c5a92d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.282476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a0db1-fb82-4bf8-979e-1b2ed7c5a92d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.282777 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2a0db1-fb82-4bf8-979e-1b2ed7c5a92d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.293543 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a0db1-fb82-4bf8-979e-1b2ed7c5a92d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:57.295729 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2a0db1-fb82-4bf8-979e-1b2ed7c5a92d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:57.311076 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e2efe-b2db-4be4-9cd0-d00d07dab974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:57.311873 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2efe-b2db-4be4-9cd0-d00d07dab974 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.312153 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2efe-b2db-4be4-9cd0-d00d07dab974 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.312429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-497e2efe-b2db-4be4-9cd0-d00d07dab974 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.315605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-de2a0db1-fb82-4bf8-979e-1b2ed7c5a92d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:57.315605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:57.315605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:57.315605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:57.315605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:57.315605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:57.315605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:57.315605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:57.315605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:57.315605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:57.315605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:57.315605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:57.315605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:57.315605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:57.315605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:57.316656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:57.316656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:57.316656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:57.316656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:57.316656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:57.316656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:57.316656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:57.316656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:57.316656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:57.316656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:57.316656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:57.316656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:57.316656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:57.316656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:57.316656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:57.316656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:57.316656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:57.317797 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:57.317797 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:57.317797 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:57.317797 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:57.323775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 423/863] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:57.323909 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e2efe-b2db-4be4-9cd0-d00d07dab974 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:57.324005 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a0db1-fb82-4bf8-979e-1b2ed7c5a92d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:57.324105 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-497e2efe-b2db-4be4-9cd0-d00d07dab974 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:57.339754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-497e2efe-b2db-4be4-9cd0-d00d07dab974 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:57.339754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:57.339754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:57.339754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:57.339754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:57.339754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:57.339754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:57.339754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:57.339754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:57.339754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:57.339754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:57.339754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:57.339754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:57.339754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:57.339754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:57.341379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:57.341379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:57.341379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:57.341379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:57.341379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:57.341379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:57.341379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:57.341379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:57.341379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:57.341379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:57.341379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:57.341379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:57.341379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:57.341379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:57.341379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:57.341379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:57.341379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:57.342945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:57.342945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:57.342945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:57.342945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:57.342945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:57.342945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:57.342945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:57.342945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:16:57.342945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 441/864] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:57.343470 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e2efe-b2db-4be4-9cd0-d00d07dab974 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:57.431399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:57.441200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2a0db1-fb82-4bf8-979e-1b2ed7c5a92d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:57.455845 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-497e2efe-b2db-4be4-9cd0-d00d07dab974 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:57.485773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa127c8-cda1-4079-b221-eef2d71f303e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:57.486437 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa127c8-cda1-4079-b221-eef2d71f303e None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.486768 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa127c8-cda1-4079-b221-eef2d71f303e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.487027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa127c8-cda1-4079-b221-eef2d71f303e None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.487760 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa127c8-cda1-4079-b221-eef2d71f303e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:57.489131 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa127c8-cda1-4079-b221-eef2d71f303e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:57.491391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:57.492925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ff4aa-1936-40db-8570-06c256b4d0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:57.493569 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ff4aa-1936-40db-8570-06c256b4d0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.493857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ff4aa-1936-40db-8570-06c256b4d0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.494135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ff4aa-1936-40db-8570-06c256b4d0a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.494893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ff4aa-1936-40db-8570-06c256b4d0a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:57.495215 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ff4aa-1936-40db-8570-06c256b4d0a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:57.496544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ff4aa-1936-40db-8570-06c256b4d0a3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:57.509301 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 442/865] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:57.510108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ff4aa-1936-40db-8570-06c256b4d0a3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:57.595058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 424/866] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Jul 15 19:16:57 2022] POST /identity/v3/services => generated 251 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:16:57.595926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa127c8-cda1-4079-b221-eef2d71f303e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:57.635354 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ff4aa-1936-40db-8570-06c256b4d0a3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:57.702674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fd8be-fe18-42ed-bd7b-ce8cc8416ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:57.703846 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fd8be-fe18-42ed-bd7b-ce8cc8416ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.704363 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fd8be-fe18-42ed-bd7b-ce8cc8416ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.705485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02fd8be-fe18-42ed-bd7b-ce8cc8416ea5 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.707145 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fd8be-fe18-42ed-bd7b-ce8cc8416ea5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:57.707722 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fd8be-fe18-42ed-bd7b-ce8cc8416ea5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:57.710455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b02fd8be-fe18-42ed-bd7b-ce8cc8416ea5 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:57.713780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:57.720616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa127c8-cda1-4079-b221-eef2d71f303e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:57.729790 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 443/867] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:57.743959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fd8be-fe18-42ed-bd7b-ce8cc8416ea5 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:57.766140 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358b376-2a45-4ae9-9ea8-70115805132d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:57.766708 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358b376-2a45-4ae9-9ea8-70115805132d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.767124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358b376-2a45-4ae9-9ea8-70115805132d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.767407 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b358b376-2a45-4ae9-9ea8-70115805132d None admin] PATH_INFO: `/v3/users/swift` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.783607 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358b376-2a45-4ae9-9ea8-70115805132d None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:57.785094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b358b376-2a45-4ae9-9ea8-70115805132d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:57.805748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b358b376-2a45-4ae9-9ea8-70115805132d None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:16:57.805748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:57.805748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:57.805748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:57.805748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:57.805748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:57.805748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:57.805748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:57.805748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:57.805748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:57.805748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:57.805748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:57.805748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:16:57.805748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:16:57.805748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:16:57.805748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:57.807609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:57.808633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:57.808633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:57.808633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:16:57.808633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:16:57.808633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:16:57.808633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:16:57.808633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:16:57.808633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:16:57.808633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 15 19:16:57.808633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:57.808633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 425/868] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:16:57 2022] GET /identity/v3/users/swift => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:57.813709 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358b376-2a45-4ae9-9ea8-70115805132d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:57.877709 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02fd8be-fe18-42ed-bd7b-ce8cc8416ea5 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:57.894665 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:57.914884 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b8e6f-ebf0-441f-a6b0-944e58ec2e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:57.915600 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b8e6f-ebf0-441f-a6b0-944e58ec2e19 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.915879 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b8e6f-ebf0-441f-a6b0-944e58ec2e19 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.916216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018b8e6f-ebf0-441f-a6b0-944e58ec2e19 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.917071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b8e6f-ebf0-441f-a6b0-944e58ec2e19 None admin] RBAC: Adding query filter params (role.id=579726a957a7468abecab3fbdb4351a9, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=deed55901c264b8da58e57c21840c491) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:57.917383 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b8e6f-ebf0-441f-a6b0-944e58ec2e19 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:57.919418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018b8e6f-ebf0-441f-a6b0-944e58ec2e19 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:57.926237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 444/869] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:57 2022] GET /identity/v3/role_assignments?user.id=deed55901c264b8da58e57c21840c491&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=579726a957a7468abecab3fbdb4351a9 => generated 608 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:57.947904 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b358b376-2a45-4ae9-9ea8-70115805132d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:57.989231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1602dd8-9f6a-4799-98df-c1a3b167f652 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:57.990121 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1602dd8-9f6a-4799-98df-c1a3b167f652 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:57.990306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1602dd8-9f6a-4799-98df-c1a3b167f652 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:57.990552 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1602dd8-9f6a-4799-98df-c1a3b167f652 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:57.991486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1602dd8-9f6a-4799-98df-c1a3b167f652 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:57.991807 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1602dd8-9f6a-4799-98df-c1a3b167f652 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:57.993577 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1602dd8-9f6a-4799-98df-c1a3b167f652 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:58.020517 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 426/870] 10.222.0.40 () {56 vars in 1135 bytes} [Fri Jul 15 19:16:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:58.021995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b8e6f-ebf0-441f-a6b0-944e58ec2e19 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:58.094485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:58.138155 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018b8e6f-ebf0-441f-a6b0-944e58ec2e19 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:58.176000 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e660ff-4f97-4fad-8552-58a6a3e22e36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:58.176654 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e660ff-4f97-4fad-8552-58a6a3e22e36 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:58.176935 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e660ff-4f97-4fad-8552-58a6a3e22e36 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:58.177211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e660ff-4f97-4fad-8552-58a6a3e22e36 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:58.260009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e660ff-4f97-4fad-8552-58a6a3e22e36 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:58.261456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e660ff-4f97-4fad-8552-58a6a3e22e36 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:58.321449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:58.366251 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 445/871] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:16:58 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:16:58.372674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1602dd8-9f6a-4799-98df-c1a3b167f652 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:58.491922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1602dd8-9f6a-4799-98df-c1a3b167f652 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:58.506949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:58.532842 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5adcc0-cdba-4f6f-851b-fa5f3477e98d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:58.533951 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5adcc0-cdba-4f6f-851b-fa5f3477e98d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:58.534400 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5adcc0-cdba-4f6f-851b-fa5f3477e98d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:58.534911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5adcc0-cdba-4f6f-851b-fa5f3477e98d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:58.548362 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5adcc0-cdba-4f6f-851b-fa5f3477e98d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:58.550140 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5adcc0-cdba-4f6f-851b-fa5f3477e98d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:58.570442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-7c5adcc0-cdba-4f6f-851b-fa5f3477e98d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:58.570442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:58.570442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:58.570442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:58.570442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:58.570442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:58.570442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:58.570442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:58.570442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:58.570442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:58.570442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:58.570442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:58.570442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:16:58.570442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:16:58.570442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:16:58.571647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:16:58.571647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:58.571647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:58.571647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:58.571647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:58.571647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:58.571647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:58.571647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:58.571647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:58.571647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:58.571647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:58.571647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:58.571647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:58.571647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:58.571647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:58.571647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:58.571647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:58.572766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:16:58.572766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:16:58.572766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:16:58.572766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:58.574669 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 427/872] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:16:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:58.582800 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e660ff-4f97-4fad-8552-58a6a3e22e36 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:58.693778 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e660ff-4f97-4fad-8552-58a6a3e22e36 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:58.733949 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f9fde-82d2-47e7-a9f5-c2d61f6f8797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:58.735039 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f9fde-82d2-47e7-a9f5-c2d61f6f8797 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:58.735548 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f9fde-82d2-47e7-a9f5-c2d61f6f8797 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:58.736028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000f9fde-82d2-47e7-a9f5-c2d61f6f8797 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:58.736965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f9fde-82d2-47e7-a9f5-c2d61f6f8797 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:58.737496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f9fde-82d2-47e7-a9f5-c2d61f6f8797 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:58.739202 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000f9fde-82d2-47e7-a9f5-c2d61f6f8797 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:58.757901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 446/873] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:16:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:58.759681 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5adcc0-cdba-4f6f-851b-fa5f3477e98d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:58.873916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5adcc0-cdba-4f6f-851b-fa5f3477e98d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:58.911596 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91dc27a-3d0a-4491-ae11-62e5b01a68c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:58.912391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dc27a-3d0a-4491-ae11-62e5b01a68c7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:58.912677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dc27a-3d0a-4491-ae11-62e5b01a68c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:58.912958 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91dc27a-3d0a-4491-ae11-62e5b01a68c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:58.920844 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91dc27a-3d0a-4491-ae11-62e5b01a68c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:58.922313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91dc27a-3d0a-4491-ae11-62e5b01a68c7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:58.940128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f91dc27a-3d0a-4491-ae11-62e5b01a68c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:58.940128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:58.940128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:58.940128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:58.940128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:58.940128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:58.940128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:58.940128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:58.940128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:58.940128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:58.940128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:58.940128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:58.940128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:16:58.940128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:16:58.940128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:16:58.941130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:16:58.941130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:58.941130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:58.941130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:58.941130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:58.941130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:58.941130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:58.941130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:58.941130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:58.941130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:58.941130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:58.941130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:58.941130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:58.941130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:58.941130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:58.941130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:58.941130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:58.942358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:16:58.942358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:16:58.942358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:16:58.942358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:16:58.942358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:16:58.942358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:16:58.942358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:16:58.942358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:58.942358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 428/874] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:16:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:58.949159 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f9fde-82d2-47e7-a9f5-c2d61f6f8797 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:58.970834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:58.983697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e06168-31f2-4f44-a7d8-b94d42d28c37 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:58.983990 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e06168-31f2-4f44-a7d8-b94d42d28c37 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:58.986702 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e06168-31f2-4f44-a7d8-b94d42d28c37 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:58.986702 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 429/875] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:58.991980 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c823b-0983-4f3c-beb0-f912426c3234 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:58.992477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c823b-0983-4f3c-beb0-f912426c3234 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:58.992894 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c823b-0983-4f3c-beb0-f912426c3234 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:59.017225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a78c823b-0983-4f3c-beb0-f912426c3234 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:59.019608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a78c823b-0983-4f3c-beb0-f912426c3234 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:59.042632 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:59.064954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000f9fde-82d2-47e7-a9f5-c2d61f6f8797 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:59.107571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f039079-8d5a-4b68-bf57-12d976fece02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:59.108482 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f039079-8d5a-4b68-bf57-12d976fece02 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:59.108932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 430/876] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:58 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:16:59.109168 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f039079-8d5a-4b68-bf57-12d976fece02 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:59.109455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f039079-8d5a-4b68-bf57-12d976fece02 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:59.110390 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f039079-8d5a-4b68-bf57-12d976fece02 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:59.110706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f039079-8d5a-4b68-bf57-12d976fece02 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:59.112166 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f039079-8d5a-4b68-bf57-12d976fece02 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:59.129764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 447/877] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:16:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:59.131326 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c823b-0983-4f3c-beb0-f912426c3234 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:59.131519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f039079-8d5a-4b68-bf57-12d976fece02 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:59.213294 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:59.236878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f039079-8d5a-4b68-bf57-12d976fece02 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:59.248905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c823b-0983-4f3c-beb0-f912426c3234 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:59.274611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bf586-f676-49f5-a57d-03a36931d458 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:59.275244 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf586-f676-49f5-a57d-03a36931d458 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:59.275530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf586-f676-49f5-a57d-03a36931d458 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:59.275808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc4bf586-f676-49f5-a57d-03a36931d458 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:59.276668 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bf586-f676-49f5-a57d-03a36931d458 None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=0402e1bd20b042cdbdcb890616b22726) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:59.276983 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bf586-f676-49f5-a57d-03a36931d458 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:59.279028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc4bf586-f676-49f5-a57d-03a36931d458 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:59.287414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 448/878] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:16:59 2022] GET /identity/v3/role_assignments?user.id=0402e1bd20b042cdbdcb890616b22726&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:16:59.299042 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8f5da-70d8-4e20-a374-61b42717bfe8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:59.300304 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f5da-70d8-4e20-a374-61b42717bfe8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:59.300798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f5da-70d8-4e20-a374-61b42717bfe8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:59.301281 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef8f5da-70d8-4e20-a374-61b42717bfe8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:59.302290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8f5da-70d8-4e20-a374-61b42717bfe8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:59.304091 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef8f5da-70d8-4e20-a374-61b42717bfe8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:59.318716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-0ef8f5da-70d8-4e20-a374-61b42717bfe8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:16:59.318716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:59.318716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:16:59.318716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:16:59.318716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:16:59.318716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:16:59.318716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:16:59.318716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:59.318716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:16:59.318716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:59.318716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:16:59.318716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:59.318716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:16:59.318716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:16:59.318716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:16:59.318716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:16:59.319812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:16:59.319812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:16:59.319812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:16:59.319812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:16:59.319812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:16:59.319812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:16:59.319812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:16:59.319812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:16:59.319812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:16:59.319812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:16:59.319812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:16:59.319812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:16:59.319812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:16:59.319812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:16:59.319812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:16:59.319812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:16:59.320701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:16:59.320701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:16:59.320701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:16:59.320701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:16:59.320701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:16:59.320701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:16:59.320701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:16:59.320701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:16:59.320701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:16:59.320701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:16:59.320701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:16:59.320701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:16:59.320701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:16:59.320701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:16:59.320701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:16:59.323885 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 431/879] 10.222.0.40 () {56 vars in 1132 bytes} [Fri Jul 15 19:16:59 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:16:59.331959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bf586-f676-49f5-a57d-03a36931d458 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:59.442333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc4bf586-f676-49f5-a57d-03a36931d458 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:59.481275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c41c6-5d75-48cc-b912-e3962688e0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:59.482095 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c41c6-5d75-48cc-b912-e3962688e0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:59.482375 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c41c6-5d75-48cc-b912-e3962688e0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:59.482646 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1c41c6-5d75-48cc-b912-e3962688e0d7 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:59.483389 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c41c6-5d75-48cc-b912-e3962688e0d7 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:59.483691 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c41c6-5d75-48cc-b912-e3962688e0d7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:59.485038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1c41c6-5d75-48cc-b912-e3962688e0d7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:59.490600 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 449/880] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Jul 15 19:16:59 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:59.496130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8f5da-70d8-4e20-a374-61b42717bfe8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:59.518269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:59.607294 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef8f5da-70d8-4e20-a374-61b42717bfe8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:59.643841 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24db3b97-6736-426d-bf11-c7b5cca8dd69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:59.644510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db3b97-6736-426d-bf11-c7b5cca8dd69 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:59.644794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db3b97-6736-426d-bf11-c7b5cca8dd69 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:59.645069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24db3b97-6736-426d-bf11-c7b5cca8dd69 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:59.645788 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db3b97-6736-426d-bf11-c7b5cca8dd69 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:59.646096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db3b97-6736-426d-bf11-c7b5cca8dd69 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:59.647496 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24db3b97-6736-426d-bf11-c7b5cca8dd69 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:59.653248 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 432/881] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Jul 15 19:16:59 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:59.658871 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c41c6-5d75-48cc-b912-e3962688e0d7 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:59.668388 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:59.746086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5e8c1-e3c2-4b0e-a099-3146dc3bc42e None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:59.746424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5e8c1-e3c2-4b0e-a099-3146dc3bc42e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:59.746816 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee5e8c1-e3c2-4b0e-a099-3146dc3bc42e None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:59.748984 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 433/882] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:16:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:16:59.755004 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68c9bf-61a1-4409-876d-3053e7e66116 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:59.755616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68c9bf-61a1-4409-876d-3053e7e66116 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:59.756195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a68c9bf-61a1-4409-876d-3053e7e66116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:59.781694 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2a68c9bf-61a1-4409-876d-3053e7e66116 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:16:59.781933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1c41c6-5d75-48cc-b912-e3962688e0d7 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:16:59.782023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2a68c9bf-61a1-4409-876d-3053e7e66116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:16:59.815907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7fa93-f177-47ce-af4d-7781b70dbedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:16:59.816565 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7fa93-f177-47ce-af4d-7781b70dbedc None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:16:59.816844 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7fa93-f177-47ce-af4d-7781b70dbedc None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:16:59.817115 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e7fa93-f177-47ce-af4d-7781b70dbedc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:16:59.817908 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7fa93-f177-47ce-af4d-7781b70dbedc None admin] RBAC: Adding query filter params (interface=public, service_id=7bb6791a2c6f4f01abc74355cad720e6, region_id=RegionOne) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:16:59.818220 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7fa93-f177-47ce-af4d-7781b70dbedc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:16:59.819703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e7fa93-f177-47ce-af4d-7781b70dbedc None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:16:59.826007 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 450/883] 10.222.0.40 () {56 vars in 1251 bytes} [Fri Jul 15 19:16:59 2022] GET /identity/v3/endpoints?service_id=7bb6791a2c6f4f01abc74355cad720e6&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:16:59.831569 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7fa93-f177-47ce-af4d-7781b70dbedc None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:59.877428 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 434/884] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:16:59 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:16:59.900472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68c9bf-61a1-4409-876d-3053e7e66116 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:16:59.917205 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:59.925453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:16:59.959869 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e7fa93-f177-47ce-af4d-7781b70dbedc None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:00.001886 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb570984-309c-42d9-9551-a222f6403864 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:00.003116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb570984-309c-42d9-9551-a222f6403864 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.003701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb570984-309c-42d9-9551-a222f6403864 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.004174 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb570984-309c-42d9-9551-a222f6403864 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.005088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb570984-309c-42d9-9551-a222f6403864 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:00.006938 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb570984-309c-42d9-9551-a222f6403864 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:00.009233 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a68c9bf-61a1-4409-876d-3053e7e66116 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:00.014642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 451/885] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Jul 15 19:16:59 2022] GET /identity/v3/services => generated 1268 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:17:00.050273 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc8ae1-3005-4050-a7ac-8ac7ebdb2649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:00.051125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc8ae1-3005-4050-a7ac-8ac7ebdb2649 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.051411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc8ae1-3005-4050-a7ac-8ac7ebdb2649 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.051692 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc8ae1-3005-4050-a7ac-8ac7ebdb2649 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.052375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc8ae1-3005-4050-a7ac-8ac7ebdb2649 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:00.053794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc8ae1-3005-4050-a7ac-8ac7ebdb2649 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:00.067225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-21cc8ae1-3005-4050-a7ac-8ac7ebdb2649 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:17:00.067225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:00.067225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:17:00.067225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:17:00.067225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:17:00.067225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:17:00.067225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:17:00.067225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:00.067225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:17:00.067225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:00.067225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:00.067225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:00.067225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:00.067225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:00.067225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:00.067225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:00.067225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:00.068288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:00.068288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:00.068288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:00.068288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:00.068288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:00.068288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:00.068288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:17:00.068288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:17:00.068288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:17:00.068288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:17:00.068288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:00.068288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:00.068288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:00.068288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:00.068288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:00.068288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:00.069179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:00.069179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:00.069179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:00.069179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:00.069179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:00.069179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:00.069179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:00.069179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:00.069179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:00.069179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:00.069179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:17:00.069179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:00.069179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:17:00.069179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:00.069179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 435/886] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:16:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:00.076441 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb570984-309c-42d9-9551-a222f6403864 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:00.192306 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb570984-309c-42d9-9551-a222f6403864 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:00.228990 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ec95e5-2771-4f2b-a8d8-e9a745dac59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:00.229664 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec95e5-2771-4f2b-a8d8-e9a745dac59a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.229949 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec95e5-2771-4f2b-a8d8-e9a745dac59a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.230277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ec95e5-2771-4f2b-a8d8-e9a745dac59a None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.231018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec95e5-2771-4f2b-a8d8-e9a745dac59a None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:00.232007 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec95e5-2771-4f2b-a8d8-e9a745dac59a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:00.233703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ec95e5-2771-4f2b-a8d8-e9a745dac59a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:00.234863 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:00.239652 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 452/887] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:17:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:00.245825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc8ae1-3005-4050-a7ac-8ac7ebdb2649 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:00.252875 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e997fc7-8a00-48e9-985e-e5d8fb7b222f None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.253166 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e997fc7-8a00-48e9-985e-e5d8fb7b222f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.253449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e997fc7-8a00-48e9-985e-e5d8fb7b222f None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.255111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 453/888] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:17:00.261580 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284df0b-d916-4501-a4ec-8880d5b56d7b None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.261997 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284df0b-d916-4501-a4ec-8880d5b56d7b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.263158 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8284df0b-d916-4501-a4ec-8880d5b56d7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.283150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-8284df0b-d916-4501-a4ec-8880d5b56d7b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:00.285059 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8284df0b-d916-4501-a4ec-8880d5b56d7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:00.346034 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:00.373795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc8ae1-3005-4050-a7ac-8ac7ebdb2649 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:00.379178 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 454/889] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:00 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:17:00.398997 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284df0b-d916-4501-a4ec-8880d5b56d7b None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:00.422716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcd65c-7cf2-43ab-bfcd-c8833d91cc0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:00.423514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcd65c-7cf2-43ab-bfcd-c8833d91cc0a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.423870 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcd65c-7cf2-43ab-bfcd-c8833d91cc0a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.424253 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcd65c-7cf2-43ab-bfcd-c8833d91cc0a None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.425238 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcd65c-7cf2-43ab-bfcd-c8833d91cc0a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:00.425619 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcd65c-7cf2-43ab-bfcd-c8833d91cc0a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:00.427563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07bcd65c-7cf2-43ab-bfcd-c8833d91cc0a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:00.434535 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 436/890] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:17:00 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:00.440650 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcd65c-7cf2-43ab-bfcd-c8833d91cc0a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:00.516444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8284df0b-d916-4501-a4ec-8880d5b56d7b None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:00.552698 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bcd65c-7cf2-43ab-bfcd-c8833d91cc0a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:00.555133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:00.565525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c87255-8176-4958-89fd-d08411d24b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:00.566505 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c87255-8176-4958-89fd-d08411d24b96 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.567011 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c87255-8176-4958-89fd-d08411d24b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.567382 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c87255-8176-4958-89fd-d08411d24b96 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.579385 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c87255-8176-4958-89fd-d08411d24b96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:00.588475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-87c87255-8176-4958-89fd-d08411d24b96 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:17:00.588475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:00.588475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:00.588475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:00.588475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:00.588475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:00.588475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:00.588475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:00.588475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:00.588475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:00.588475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:00.588475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:00.588475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:00.588475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:00.588475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:00.588475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:00.589632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:00.589632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:00.589632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:00.589632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:00.589632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:00.589632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:00.589632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:00.589632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:00.589632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:00.589632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:00.589632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:00.589632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:00.589632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:00.589632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:00.589632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:00.589632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:00.591239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:00.591239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:00.591239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:00.591239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:00.591239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:00.591239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:00.591239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:00.591239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:00.591239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:00.591239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:00.591239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:17:00.591239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:00.599536 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 455/891] 10.222.0.40 () {56 vars in 1120 bytes} [Fri Jul 15 19:17:00 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:00.600878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c87255-8176-4958-89fd-d08411d24b96 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:00.604158 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c6a86-0b67-4a69-8e74-f80b285cbfb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:00.605019 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c6a86-0b67-4a69-8e74-f80b285cbfb9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.605132 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c6a86-0b67-4a69-8e74-f80b285cbfb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.605373 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3c6a86-0b67-4a69-8e74-f80b285cbfb9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.606317 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c6a86-0b67-4a69-8e74-f80b285cbfb9 None admin] RBAC: Adding query filter params (interface=public, service_id=3c745c9c68064ccbafdcd8759712b6b7, region_id=RegionOne) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:00.606784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c6a86-0b67-4a69-8e74-f80b285cbfb9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:00.608531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3c6a86-0b67-4a69-8e74-f80b285cbfb9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:00.618809 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 437/892] 10.222.0.40 () {56 vars in 1251 bytes} [Fri Jul 15 19:17:00 2022] GET /identity/v3/endpoints?service_id=3c745c9c68064ccbafdcd8759712b6b7&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:00.619810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c6a86-0b67-4a69-8e74-f80b285cbfb9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:00.624493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:00.720282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c87255-8176-4958-89fd-d08411d24b96 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:00.738164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3c6a86-0b67-4a69-8e74-f80b285cbfb9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:00.758577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23016388-96f4-4867-bb45-73ef57728910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:00.759654 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23016388-96f4-4867-bb45-73ef57728910 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.760167 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23016388-96f4-4867-bb45-73ef57728910 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.760649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23016388-96f4-4867-bb45-73ef57728910 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.761632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23016388-96f4-4867-bb45-73ef57728910 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:00.762162 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23016388-96f4-4867-bb45-73ef57728910 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:00.763805 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23016388-96f4-4867-bb45-73ef57728910 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:00.778880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 456/893] 10.222.0.40 () {56 vars in 1115 bytes} [Fri Jul 15 19:17:00 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:00.780388 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23016388-96f4-4867-bb45-73ef57728910 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:00.784985 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdaaf9-918c-4370-9c14-c9c99ac5ced7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:00.785648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdaaf9-918c-4370-9c14-c9c99ac5ced7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.785932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdaaf9-918c-4370-9c14-c9c99ac5ced7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.786220 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fdaaf9-918c-4370-9c14-c9c99ac5ced7 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.787306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdaaf9-918c-4370-9c14-c9c99ac5ced7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:00.788411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fdaaf9-918c-4370-9c14-c9c99ac5ced7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:00.802892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 438/894] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Jul 15 19:17:00 2022] GET /identity/v3/services => generated 1268 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:17:00.843026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:00.901565 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23016388-96f4-4867-bb45-73ef57728910 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:00.940336 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed6b00-cd23-4795-aa5f-1650a2f0f710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:00.941546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed6b00-cd23-4795-aa5f-1650a2f0f710 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:00.942041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed6b00-cd23-4795-aa5f-1650a2f0f710 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:00.942532 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eed6b00-cd23-4795-aa5f-1650a2f0f710 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:00.955370 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed6b00-cd23-4795-aa5f-1650a2f0f710 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:00.957176 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eed6b00-cd23-4795-aa5f-1650a2f0f710 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:00.976208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-3eed6b00-cd23-4795-aa5f-1650a2f0f710 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:00.976208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:00.976208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:00.976208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:00.976208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:00.976208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:00.976208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:00.976208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:00.976208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:00.976208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:00.976208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:00.976208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:00.976208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:00.976208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:00.976208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:00.977189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:00.977189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:00.977189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:00.977189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:00.977189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:00.977189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:00.977189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:00.977189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:00.977189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:00.977189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:00.977189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:00.977189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:00.977189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:00.977189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:00.977189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:00.977189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:00.977189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:00.978122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:00.978122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:00.978122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:00.978122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:00.982844 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 457/895] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:00.984576 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdaaf9-918c-4370-9c14-c9c99ac5ced7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:01.061604 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:01.121305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fdaaf9-918c-4370-9c14-c9c99ac5ced7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:01.148772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ff97e-812e-455a-a68b-7592e2854049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:01.149477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ff97e-812e-455a-a68b-7592e2854049 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:01.149888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ff97e-812e-455a-a68b-7592e2854049 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:01.150166 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ff97e-812e-455a-a68b-7592e2854049 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:01.150927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ff97e-812e-455a-a68b-7592e2854049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:01.151234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ff97e-812e-455a-a68b-7592e2854049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:01.152653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ff97e-812e-455a-a68b-7592e2854049 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:01.166000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 439/896] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:01.172506 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed6b00-cd23-4795-aa5f-1650a2f0f710 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:01.283460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eed6b00-cd23-4795-aa5f-1650a2f0f710 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:01.285297 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:01.320951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2e666-1cea-4430-8716-f76c9f4dd830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:01.322187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2e666-1cea-4430-8716-f76c9f4dd830 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:01.322525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2e666-1cea-4430-8716-f76c9f4dd830 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:01.322928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b2e666-1cea-4430-8716-f76c9f4dd830 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:01.332826 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2e666-1cea-4430-8716-f76c9f4dd830 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:01.334356 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b2e666-1cea-4430-8716-f76c9f4dd830 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:01.349706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-88b2e666-1cea-4430-8716-f76c9f4dd830 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:17:01.349706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:01.349706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:01.349706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:01.349706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:01.349706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:01.349706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:01.349706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:01.349706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:01.349706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:01.349706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:01.349706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:01.349706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:01.349706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:01.349706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:01.349706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:01.350685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:01.351659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:01.351659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:01.351659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:01.351659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:01.351659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:01.351659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:01.351659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:01.351659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:01.351659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:17:01.351659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:01.351659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 458/897] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Jul 15 19:17:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:01.357375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ff97e-812e-455a-a68b-7592e2854049 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:01.463401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ff97e-812e-455a-a68b-7592e2854049 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:01.491130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:01.500294 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d5660f7-3be1-4a28-900f-e5478290a8aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:01.508911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5660f7-3be1-4a28-900f-e5478290a8aa None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:01.508911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5660f7-3be1-4a28-900f-e5478290a8aa None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:01.508911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d5660f7-3be1-4a28-900f-e5478290a8aa None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:01.508911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5660f7-3be1-4a28-900f-e5478290a8aa None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:01.508911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5660f7-3be1-4a28-900f-e5478290a8aa None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:01.508911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d5660f7-3be1-4a28-900f-e5478290a8aa None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:01.525087 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 440/898] 10.222.0.40 () {56 vars in 1149 bytes} [Fri Jul 15 19:17:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:01.530991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2e666-1cea-4430-8716-f76c9f4dd830 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:01.573411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3c16e-c652-4be8-b4e0-ba0e969718b6 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:01.573591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3c16e-c652-4be8-b4e0-ba0e969718b6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:01.573867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c3c16e-c652-4be8-b4e0-ba0e969718b6 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:01.576644 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 441/899] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:01.584886 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6092a-8764-4773-aefc-ece2e2fd56fe None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:01.585210 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6092a-8764-4773-aefc-ece2e2fd56fe None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:01.585433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be6092a-8764-4773-aefc-ece2e2fd56fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:01.604564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7be6092a-8764-4773-aefc-ece2e2fd56fe None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:01.606891 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7be6092a-8764-4773-aefc-ece2e2fd56fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:01.658130 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b2e666-1cea-4430-8716-f76c9f4dd830 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:01.692233 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 442/900] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:01 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:17:01.711197 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692a08d-9544-49c8-8571-e35315ce1e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:01.711874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692a08d-9544-49c8-8571-e35315ce1e1f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:01.712134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692a08d-9544-49c8-8571-e35315ce1e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:01.712410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2692a08d-9544-49c8-8571-e35315ce1e1f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:01.721375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6092a-8764-4773-aefc-ece2e2fd56fe None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:01.752429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:01.811933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692a08d-9544-49c8-8571-e35315ce1e1f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:01.813676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2692a08d-9544-49c8-8571-e35315ce1e1f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:01.858845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be6092a-8764-4773-aefc-ece2e2fd56fe None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:01.878822 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:01.903250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd2487-cc1a-4cd4-b3a0-faabe2dec1b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:01.905184 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd2487-cc1a-4cd4-b3a0-faabe2dec1b1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:01.905682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd2487-cc1a-4cd4-b3a0-faabe2dec1b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:01.906156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43bd2487-cc1a-4cd4-b3a0-faabe2dec1b1 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:01.907340 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd2487-cc1a-4cd4-b3a0-faabe2dec1b1 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:01.909222 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43bd2487-cc1a-4cd4-b3a0-faabe2dec1b1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:01.926424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-43bd2487-cc1a-4cd4-b3a0-faabe2dec1b1 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:17:01.926424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:01.926424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:17:01.926424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:17:01.926424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:17:01.926424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:17:01.926424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:17:01.926424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:01.926424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:17:01.926424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:01.926424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:01.926424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:01.926424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:01.926424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:01.926424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:01.926424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:01.926424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:01.927911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:01.927911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:01.927911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:01.927911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:01.927911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:01.927911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:01.927911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:17:01.927911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:17:01.927911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:17:01.927911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:17:01.927911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:01.927911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:01.927911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:01.927911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:01.927911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:01.927911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:01.928953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:01.928953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:01.928953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:01.928953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:01.928953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:01.928953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:01.928953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:01.928953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:01.928953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:01.928953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:01.928953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:17:01.928953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:01.928953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:17:01.928953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:01.932478 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 443/901] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Jul 15 19:17:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:01.938970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd2487-cc1a-4cd4-b3a0-faabe2dec1b1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:01.965359 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 459/902] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:01 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:17:01.966857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692a08d-9544-49c8-8571-e35315ce1e1f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:02.041553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:02.092812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43bd2487-cc1a-4cd4-b3a0-faabe2dec1b1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:02.105115 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2692a08d-9544-49c8-8571-e35315ce1e1f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:02.140820 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea60a7b-895b-4cb6-ba8f-1436a1f779e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:02.141397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea60a7b-895b-4cb6-ba8f-1436a1f779e6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.141678 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea60a7b-895b-4cb6-ba8f-1436a1f779e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.141947 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea60a7b-895b-4cb6-ba8f-1436a1f779e6 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.142653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea60a7b-895b-4cb6-ba8f-1436a1f779e6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:02.142991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea60a7b-895b-4cb6-ba8f-1436a1f779e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:02.144360 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea60a7b-895b-4cb6-ba8f-1436a1f779e6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:02.145592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede6bd05-0acc-4500-966b-77a22ffb7075 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:02.146579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6bd05-0acc-4500-966b-77a22ffb7075 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.147076 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6bd05-0acc-4500-966b-77a22ffb7075 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.147523 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede6bd05-0acc-4500-966b-77a22ffb7075 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.149554 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 444/903] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Jul 15 19:17:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:02.151178 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefca4d-9f0e-4c1d-aa95-670e21c3ec59 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.151178 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefca4d-9f0e-4c1d-aa95-670e21c3ec59 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.151645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aefca4d-9f0e-4c1d-aa95-670e21c3ec59 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.154244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 445/904] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:02.159893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefca4d-9f0e-4c1d-aa95-670e21c3ec59 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:02.162115 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6bd05-0acc-4500-966b-77a22ffb7075 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:02.163775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede6bd05-0acc-4500-966b-77a22ffb7075 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:02.182923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-ede6bd05-0acc-4500-966b-77a22ffb7075 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:02.182923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:02.182923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:02.182923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:02.182923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:02.182923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:02.182923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:02.182923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:02.182923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:02.182923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:02.182923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:02.182923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:02.182923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:02.182923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:02.182923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:02.183960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:02.183960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:02.183960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:02.183960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:02.183960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:02.183960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:02.183960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:02.183960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:02.183960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:02.183960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:02.183960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:02.183960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:02.183960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:02.183960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:02.183960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:02.183960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:02.183960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:02.187052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:02.187052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:02.187052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:02.187052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:02.187052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 460/905] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:02.187052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921f19b-2ff0-4a38-9a41-3cb699d012cb None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.187052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921f19b-2ff0-4a38-9a41-3cb699d012cb None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.187052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b921f19b-2ff0-4a38-9a41-3cb699d012cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.205216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-b921f19b-2ff0-4a38-9a41-3cb699d012cb None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:02.206475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b921f19b-2ff0-4a38-9a41-3cb699d012cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:02.219520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:02.279866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 461/906] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:02 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:02.280832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aefca4d-9f0e-4c1d-aa95-670e21c3ec59 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:02.283611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921f19b-2ff0-4a38-9a41-3cb699d012cb None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:02.331512 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:02.331957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069d74b-b444-4d58-be64-a3990d12747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:02.332770 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069d74b-b444-4d58-be64-a3990d12747e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.333114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069d74b-b444-4d58-be64-a3990d12747e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.333455 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e069d74b-b444-4d58-be64-a3990d12747e None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.334227 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069d74b-b444-4d58-be64-a3990d12747e None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:02.334592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069d74b-b444-4d58-be64-a3990d12747e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:02.336044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e069d74b-b444-4d58-be64-a3990d12747e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:02.341152 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 446/907] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Jul 15 19:17:02 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:02.343858 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069d74b-b444-4d58-be64-a3990d12747e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:02.408987 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b921f19b-2ff0-4a38-9a41-3cb699d012cb None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:02.449123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1b299-adcf-493e-af01-1a36b47e48a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:02.450407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b299-adcf-493e-af01-1a36b47e48a0 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.450982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b299-adcf-493e-af01-1a36b47e48a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.451472 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e1b299-adcf-493e-af01-1a36b47e48a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.452316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1b299-adcf-493e-af01-1a36b47e48a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:02.452624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1b299-adcf-493e-af01-1a36b47e48a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:02.454023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e1b299-adcf-493e-af01-1a36b47e48a0 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:02.474953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 462/908] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:02.476002 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1b299-adcf-493e-af01-1a36b47e48a0 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:02.491031 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e069d74b-b444-4d58-be64-a3990d12747e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:02.505028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:02.547927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b9258-acfa-4c9c-8ef9-e73b04865931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:02.548752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b9258-acfa-4c9c-8ef9-e73b04865931 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.549036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b9258-acfa-4c9c-8ef9-e73b04865931 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.549312 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19b9258-acfa-4c9c-8ef9-e73b04865931 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.550155 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b9258-acfa-4c9c-8ef9-e73b04865931 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:02.552311 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19b9258-acfa-4c9c-8ef9-e73b04865931 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:02.569249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f19b9258-acfa-4c9c-8ef9-e73b04865931 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:17:02.569249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:02.569249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:17:02.569249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:17:02.569249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:17:02.569249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:17:02.569249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:17:02.569249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:02.569249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:17:02.569249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:02.569249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:02.569249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:02.569249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:02.569249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:02.569249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:02.569249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:02.570261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:02.570261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:02.570261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:02.570261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:02.570261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:02.570261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:02.570261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:02.570261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:17:02.570261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:17:02.570261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:17:02.570261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:17:02.570261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:02.570261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:02.570261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:02.570261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:02.570261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:02.571147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:02.571147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:02.571147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:02.571147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:02.571147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:02.571147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:02.571147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:02.571147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:02.571147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:02.571147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:02.571147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:02.571147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:17:02.571147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:02.571147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 15 19:17:02.571147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:02.575221 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 447/909] 10.222.0.40 () {56 vars in 1132 bytes} [Fri Jul 15 19:17:02 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:02.577343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b9258-acfa-4c9c-8ef9-e73b04865931 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:02.604913 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e1b299-adcf-493e-af01-1a36b47e48a0 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:02.613636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:02.648030 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea19369-fc7d-4e78-962a-0ac078e184e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:02.648908 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea19369-fc7d-4e78-962a-0ac078e184e1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.649108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea19369-fc7d-4e78-962a-0ac078e184e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.649380 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea19369-fc7d-4e78-962a-0ac078e184e1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.656922 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea19369-fc7d-4e78-962a-0ac078e184e1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:02.658371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea19369-fc7d-4e78-962a-0ac078e184e1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:02.676056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-2ea19369-fc7d-4e78-962a-0ac078e184e1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:02.676056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:02.676056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:02.676056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:02.676056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:02.676056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:02.676056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:02.676056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:02.676056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:02.676056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:02.676056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:02.676056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:02.676056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:02.676056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:02.676056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:02.677185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:02.677185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:02.677185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:02.677185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:02.677185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:02.677185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:02.677185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:02.677185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:02.677185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:02.677185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:02.677185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:02.677185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:02.677185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:02.677185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:02.677185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:02.677185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:02.677185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:02.678276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:02.678276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:02.678276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:02.678276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:02.678276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:02.678276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:02.678276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:02.678276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:02.684600 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 463/910] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:02.685737 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea19369-fc7d-4e78-962a-0ac078e184e1 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:02.719568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19b9258-acfa-4c9c-8ef9-e73b04865931 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:02.756371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d716ee-af20-4150-9dec-215b3e2b0468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:02.757172 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d716ee-af20-4150-9dec-215b3e2b0468 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.757573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d716ee-af20-4150-9dec-215b3e2b0468 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.757981 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d716ee-af20-4150-9dec-215b3e2b0468 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.759010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d716ee-af20-4150-9dec-215b3e2b0468 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:02.759415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d716ee-af20-4150-9dec-215b3e2b0468 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:02.761371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d716ee-af20-4150-9dec-215b3e2b0468 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:02.769585 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 448/911] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Jul 15 19:17:02 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:02.775572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d716ee-af20-4150-9dec-215b3e2b0468 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:02.799737 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea19369-fc7d-4e78-962a-0ac078e184e1 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:02.823146 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:02.839186 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e9f2b-6943-40be-a00f-71bada3e5b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:02.840217 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e9f2b-6943-40be-a00f-71bada3e5b84 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.841352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e9f2b-6943-40be-a00f-71bada3e5b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.843700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5e9f2b-6943-40be-a00f-71bada3e5b84 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.844769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e9f2b-6943-40be-a00f-71bada3e5b84 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:02.845296 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e9f2b-6943-40be-a00f-71bada3e5b84 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:02.846964 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5e9f2b-6943-40be-a00f-71bada3e5b84 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:02.866415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 464/912] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:02.867647 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e9f2b-6943-40be-a00f-71bada3e5b84 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:02.895691 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:02.906633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d716ee-af20-4150-9dec-215b3e2b0468 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:02.958113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd5ec3-08fb-4254-bf67-219a1560aa90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:02.959139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd5ec3-08fb-4254-bf67-219a1560aa90 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:02.959624 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd5ec3-08fb-4254-bf67-219a1560aa90 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:02.960095 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cd5ec3-08fb-4254-bf67-219a1560aa90 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:02.961019 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd5ec3-08fb-4254-bf67-219a1560aa90 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:02.961520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd5ec3-08fb-4254-bf67-219a1560aa90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:02.963115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cd5ec3-08fb-4254-bf67-219a1560aa90 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:02.970424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 449/913] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Jul 15 19:17:02 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:02.982792 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd5ec3-08fb-4254-bf67-219a1560aa90 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:02.994019 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5e9f2b-6943-40be-a00f-71bada3e5b84 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:03.035751 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401cfe4d-9929-4f8f-836e-6cb9ca8305aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:03.036422 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfe4d-9929-4f8f-836e-6cb9ca8305aa None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:03.036689 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfe4d-9929-4f8f-836e-6cb9ca8305aa None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:03.036961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401cfe4d-9929-4f8f-836e-6cb9ca8305aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:03.037797 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cfe4d-9929-4f8f-836e-6cb9ca8305aa None admin] RBAC: Adding query filter params (role.id=9895fbb6b76e4545802b1565612c8bf7, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=deed55901c264b8da58e57c21840c491) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:03.038111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cfe4d-9929-4f8f-836e-6cb9ca8305aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:03.039575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401cfe4d-9929-4f8f-836e-6cb9ca8305aa None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:03.054783 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 465/914] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:02 2022] GET /identity/v3/role_assignments?user.id=deed55901c264b8da58e57c21840c491&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=9895fbb6b76e4545802b1565612c8bf7 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:03.054783 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3e209-7c8a-41bc-a27d-bbff5beaacb2 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:03.054783 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3e209-7c8a-41bc-a27d-bbff5beaacb2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:03.054783 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec3e209-7c8a-41bc-a27d-bbff5beaacb2 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:03.054783 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 466/915] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:03.061433 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db70442-a1e0-4e1b-aafb-a0ac774858d1 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:03.061689 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db70442-a1e0-4e1b-aafb-a0ac774858d1 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:03.061964 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db70442-a1e0-4e1b-aafb-a0ac774858d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:03.087681 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-4db70442-a1e0-4e1b-aafb-a0ac774858d1 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:03.088911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4db70442-a1e0-4e1b-aafb-a0ac774858d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:03.113467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cd5ec3-08fb-4254-bf67-219a1560aa90 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:03.148922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:03.159452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddc50b-15f1-40c1-8949-2a0f6471f7e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:03.160729 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc50b-15f1-40c1-8949-2a0f6471f7e5 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:03.161211 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc50b-15f1-40c1-8949-2a0f6471f7e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:03.161672 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dddc50b-15f1-40c1-8949-2a0f6471f7e5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:03.162907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddc50b-15f1-40c1-8949-2a0f6471f7e5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:03.164585 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dddc50b-15f1-40c1-8949-2a0f6471f7e5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:03.174761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 467/916] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:03 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:17:03.192741 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db70442-a1e0-4e1b-aafb-a0ac774858d1 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:03.216187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:03.267071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 450/917] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Jul 15 19:17:02 2022] POST /identity/v3/endpoints => generated 347 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:17:03.318234 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db70442-a1e0-4e1b-aafb-a0ac774858d1 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:03.367531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d7e26-7429-4ec0-8757-7785716ffda9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:03.368414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d7e26-7429-4ec0-8757-7785716ffda9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:03.368700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d7e26-7429-4ec0-8757-7785716ffda9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:03.368975 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d7e26-7429-4ec0-8757-7785716ffda9 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:03.369655 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d7e26-7429-4ec0-8757-7785716ffda9 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:03.371119 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d7e26-7429-4ec0-8757-7785716ffda9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:03.384956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-d11d7e26-7429-4ec0-8757-7785716ffda9 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:17:03.384956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:03.384956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:17:03.384956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:17:03.384956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:17:03.384956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:17:03.384956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:17:03.384956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:03.384956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:17:03.384956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:03.384956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:03.384956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:03.384956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:03.384956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:03.384956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:03.384956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:03.384956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:03.386057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:03.386057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:03.386057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:03.386057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:03.386057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:03.386057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:03.386057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:17:03.386057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:17:03.386057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:17:03.386057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:17:03.386057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:03.386057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:03.386057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:03.386057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:03.386057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:03.386057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:03.386951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:03.386951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:03.386951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:03.386951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:03.386951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:03.386951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:03.386951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:03.386951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:03.386951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:03.386951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:03.386951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:17:03.386951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:03.386951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 15 19:17:03.386951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:03.386951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 468/918] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:17:03 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:03.392708 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddc50b-15f1-40c1-8949-2a0f6471f7e5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:03.511410 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dddc50b-15f1-40c1-8949-2a0f6471f7e5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:03.551824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d752b-7ba4-4fc6-b1bc-f48447534abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:03.552502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d752b-7ba4-4fc6-b1bc-f48447534abe None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:03.552783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d752b-7ba4-4fc6-b1bc-f48447534abe None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:03.553057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865d752b-7ba4-4fc6-b1bc-f48447534abe None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:03.553773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d752b-7ba4-4fc6-b1bc-f48447534abe None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:03.554080 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d752b-7ba4-4fc6-b1bc-f48447534abe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:03.555477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865d752b-7ba4-4fc6-b1bc-f48447534abe None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:03.560938 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 451/919] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:17:03 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:03.566650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d7e26-7429-4ec0-8757-7785716ffda9 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:03.650137 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:03.674150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d7e26-7429-4ec0-8757-7785716ffda9 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:03.709633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ded5b08-734d-42ec-a855-e4fbc07ddd8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:03.710300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5b08-734d-42ec-a855-e4fbc07ddd8e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:03.710581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5b08-734d-42ec-a855-e4fbc07ddd8e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:03.710879 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ded5b08-734d-42ec-a855-e4fbc07ddd8e None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:03.711600 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded5b08-734d-42ec-a855-e4fbc07ddd8e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:03.711907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded5b08-734d-42ec-a855-e4fbc07ddd8e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:03.713387 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ded5b08-734d-42ec-a855-e4fbc07ddd8e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:03.719670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 469/920] 10.222.0.40 () {56 vars in 1114 bytes} [Fri Jul 15 19:17:03 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:03.725336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d752b-7ba4-4fc6-b1bc-f48447534abe None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:03.750497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:03.840071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865d752b-7ba4-4fc6-b1bc-f48447534abe None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:03.881102 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32385865-c954-4da8-835e-4622a7b130c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:03.881777 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32385865-c954-4da8-835e-4622a7b130c8 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:03.882057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32385865-c954-4da8-835e-4622a7b130c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:03.882332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32385865-c954-4da8-835e-4622a7b130c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:03.883120 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32385865-c954-4da8-835e-4622a7b130c8 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:03.884565 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32385865-c954-4da8-835e-4622a7b130c8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:04.009503 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 452/921] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Jul 15 19:17:03 2022] POST /identity/v3/endpoints => generated 346 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:17:04.473952 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc696d2a-5ca5-4394-9c82-66aae90e5567 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:04.474349 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc696d2a-5ca5-4394-9c82-66aae90e5567 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:04.474552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc696d2a-5ca5-4394-9c82-66aae90e5567 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:04.476148 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 470/922] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:04.481843 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e12f0a-1f51-4f9f-8590-3c516d97c062 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:04.482404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e12f0a-1f51-4f9f-8590-3c516d97c062 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:04.482561 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e12f0a-1f51-4f9f-8590-3c516d97c062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:04.499819 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-08e12f0a-1f51-4f9f-8590-3c516d97c062 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:04.501001 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-08e12f0a-1f51-4f9f-8590-3c516d97c062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:04.579103 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 453/923] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:04 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:17:04.600862 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc696d2a-5ca5-4394-9c82-66aae90e5567 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:04.715785 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc696d2a-5ca5-4394-9c82-66aae90e5567 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:04.752270 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adc7d02-520a-4555-b153-d881de8bf5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:04.752860 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc7d02-520a-4555-b153-d881de8bf5e2 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:04.753142 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc7d02-520a-4555-b153-d881de8bf5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:04.753418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adc7d02-520a-4555-b153-d881de8bf5e2 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:04.754143 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc7d02-520a-4555-b153-d881de8bf5e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:04.755547 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adc7d02-520a-4555-b153-d881de8bf5e2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:04.826589 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 471/924] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Jul 15 19:17:04 2022] POST /identity/v3/services => generated 241 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:17:05.206171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a7880-dbe2-4650-8026-900ae83ec91a None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.206545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a7880-dbe2-4650-8026-900ae83ec91a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.206808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5a7880-dbe2-4650-8026-900ae83ec91a None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.208510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 454/925] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:05.214154 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86e3ed-99b8-4d49-9960-8b0fbbfbb20e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.214443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86e3ed-99b8-4d49-9960-8b0fbbfbb20e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.214719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc86e3ed-99b8-4d49-9960-8b0fbbfbb20e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.220517 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:05.233693 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-fc86e3ed-99b8-4d49-9960-8b0fbbfbb20e None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:05.234922 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-fc86e3ed-99b8-4d49-9960-8b0fbbfbb20e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:05.313312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 472/926] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:05.335520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a7880-dbe2-4650-8026-900ae83ec91a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:05.338285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:05.444385 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5a7880-dbe2-4650-8026-900ae83ec91a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:05.482449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2af08a-da42-4181-a9fb-5f3d2f26bd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:05.483297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af08a-da42-4181-a9fb-5f3d2f26bd50 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.483586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af08a-da42-4181-a9fb-5f3d2f26bd50 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.483863 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af08a-da42-4181-a9fb-5f3d2f26bd50 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.495191 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b2af08a-da42-4181-a9fb-5f3d2f26bd50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:05.504113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-6b2af08a-da42-4181-a9fb-5f3d2f26bd50 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:17:05.504113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:05.504113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:05.504113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:05.504113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:05.504113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:05.504113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:05.504113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:05.504113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:05.504113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:05.504113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:05.504113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:05.504113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:05.504113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:05.504113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:05.504113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:05.505058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:05.505058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:05.505058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:05.505058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:05.505058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:05.505058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:05.505058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:05.505058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:05.505058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:05.505058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:05.505058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:05.505058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:05.505058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:05.505058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:05.505058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:05.505058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:05.505917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:05.505917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:05.505917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:05.505917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:05.505917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:05.505917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:05.505917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:05.505917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:05.505917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:05.505917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:05.505917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:17:05.505917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:05.505917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 455/927] 10.222.0.40 () {56 vars in 1120 bytes} [Fri Jul 15 19:17:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:05.511509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86e3ed-99b8-4d49-9960-8b0fbbfbb20e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:05.549996 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ac368-1526-4a0c-bfb3-5ccf52d1d997 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.550337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ac368-1526-4a0c-bfb3-5ccf52d1d997 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.550562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ac368-1526-4a0c-bfb3-5ccf52d1d997 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.552306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 456/928] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:05.557647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3d252-636a-4c14-97f9-3fba8f734a92 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.557940 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3d252-636a-4c14-97f9-3fba8f734a92 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.558221 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd3d252-636a-4c14-97f9-3fba8f734a92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.576750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-bcd3d252-636a-4c14-97f9-3fba8f734a92 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:05.577957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bcd3d252-636a-4c14-97f9-3fba8f734a92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:05.618840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc86e3ed-99b8-4d49-9960-8b0fbbfbb20e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:05.643554 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:05.660042 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 457/929] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:05 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:05.666477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fae025-ee11-4bca-99d2-b975c1d716e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:05.667513 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fae025-ee11-4bca-99d2-b975c1d716e6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.667946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fae025-ee11-4bca-99d2-b975c1d716e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.668597 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3fae025-ee11-4bca-99d2-b975c1d716e6 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.669977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fae025-ee11-4bca-99d2-b975c1d716e6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:05.670925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:05.672100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fae025-ee11-4bca-99d2-b975c1d716e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:05.673705 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3fae025-ee11-4bca-99d2-b975c1d716e6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:05.681857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3d252-636a-4c14-97f9-3fba8f734a92 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:05.683854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 473/930] 10.222.0.40 () {56 vars in 1115 bytes} [Fri Jul 15 19:17:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:05.689811 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fae025-ee11-4bca-99d2-b975c1d716e6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:05.792132 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd3d252-636a-4c14-97f9-3fba8f734a92 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:05.801558 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3fae025-ee11-4bca-99d2-b975c1d716e6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:05.829159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9058241-c067-44a5-aa5a-3578254dec1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:05.830006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9058241-c067-44a5-aa5a-3578254dec1c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.830298 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9058241-c067-44a5-aa5a-3578254dec1c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.830636 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9058241-c067-44a5-aa5a-3578254dec1c None admin] PATH_INFO: `/v3/services/compute` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.831303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9058241-c067-44a5-aa5a-3578254dec1c None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:05.832712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9058241-c067-44a5-aa5a-3578254dec1c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:05.841445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53702bc7-dba2-44da-b4c5-8d79cfda281f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:05.842644 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53702bc7-dba2-44da-b4c5-8d79cfda281f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:05.843156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53702bc7-dba2-44da-b4c5-8d79cfda281f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:05.843642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53702bc7-dba2-44da-b4c5-8d79cfda281f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:05.846424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-c9058241-c067-44a5-aa5a-3578254dec1c None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:17:05.846424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:05.846424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:17:05.846424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:17:05.846424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:17:05.846424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:17:05.846424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:17:05.846424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:05.846424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:17:05.846424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:05.846424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:05.846424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:05.846424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:05.846424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:05.846424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:05.846424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:05.846424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:05.847468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:05.847468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:05.847468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:05.847468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:05.847468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:05.847468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:05.847468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:17:05.847468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:17:05.847468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:17:05.847468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:17:05.847468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:05.847468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:05.847468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:05.847468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:05.847468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:05.847468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:05.848321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:05.848321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:05.848321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:05.848321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:05.848321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:05.848321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:05.848321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:05.848321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:05.848321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:05.848321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:05.848321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:17:05.848321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:05.848321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:17:05.848321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:05.852769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 458/931] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:05 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:05.854029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9058241-c067-44a5-aa5a-3578254dec1c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:05.861121 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53702bc7-dba2-44da-b4c5-8d79cfda281f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:05.862861 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53702bc7-dba2-44da-b4c5-8d79cfda281f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:05.882103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-53702bc7-dba2-44da-b4c5-8d79cfda281f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:05.882103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:05.882103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:05.882103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:05.882103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:05.882103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:05.882103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:05.882103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:05.882103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:05.882103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:05.882103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:05.882103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:05.882103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:05.882103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:05.882103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:05.883077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:05.883077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:05.883077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:05.883077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:05.883077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:05.883077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:05.883077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:05.883077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:05.883077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:05.883077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:05.883077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:05.883077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:05.883077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:05.883077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:05.883077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:05.883077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:05.883077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:05.883977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:05.883977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:05.883977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:05.883977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:05.891635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 474/932] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:05.892809 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53702bc7-dba2-44da-b4c5-8d79cfda281f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:05.940008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:05.943124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:05.965955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9058241-c067-44a5-aa5a-3578254dec1c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:06.004762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3d81c-70b9-42c7-a775-f759ffc16e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:06.005541 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3d81c-70b9-42c7-a775-f759ffc16e27 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.005971 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3d81c-70b9-42c7-a775-f759ffc16e27 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.006424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d3d81c-70b9-42c7-a775-f759ffc16e27 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.007284 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3d81c-70b9-42c7-a775-f759ffc16e27 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:06.007677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3d81c-70b9-42c7-a775-f759ffc16e27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:06.008312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53702bc7-dba2-44da-b4c5-8d79cfda281f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:06.009205 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9d3d81c-70b9-42c7-a775-f759ffc16e27 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:06.020812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 459/933] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Jul 15 19:17:05 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:06.022182 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3d81c-70b9-42c7-a775-f759ffc16e27 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:06.047805 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc40349-29af-4166-9d0f-6ca17a872463 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:06.048774 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc40349-29af-4166-9d0f-6ca17a872463 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.049255 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc40349-29af-4166-9d0f-6ca17a872463 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.049702 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc40349-29af-4166-9d0f-6ca17a872463 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.050709 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc40349-29af-4166-9d0f-6ca17a872463 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:06.051217 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc40349-29af-4166-9d0f-6ca17a872463 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:06.052771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc40349-29af-4166-9d0f-6ca17a872463 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:06.081848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 475/934] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:06.083315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc40349-29af-4166-9d0f-6ca17a872463 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:06.133366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d3d81c-70b9-42c7-a775-f759ffc16e27 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:06.155564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:06.171527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec31eafa-b376-445f-a43f-17b814114deb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:06.172480 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31eafa-b376-445f-a43f-17b814114deb None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.173246 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31eafa-b376-445f-a43f-17b814114deb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.173631 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec31eafa-b376-445f-a43f-17b814114deb None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.174500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31eafa-b376-445f-a43f-17b814114deb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:06.174841 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31eafa-b376-445f-a43f-17b814114deb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:06.176242 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec31eafa-b376-445f-a43f-17b814114deb None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:06.187183 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 460/935] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Jul 15 19:17:06 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:06.189592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db237a57-c9c7-428b-b672-0d45f4ea8612 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.189948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db237a57-c9c7-428b-b672-0d45f4ea8612 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.190568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db237a57-c9c7-428b-b672-0d45f4ea8612 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.196501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 461/936] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:06 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:06.198857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc40349-29af-4166-9d0f-6ca17a872463 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:06.201179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:06.202537 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812dee1-18ea-46cd-8f36-4ae2f53bcff1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.202851 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812dee1-18ea-46cd-8f36-4ae2f53bcff1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.203128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4812dee1-18ea-46cd-8f36-4ae2f53bcff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.231370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4812dee1-18ea-46cd-8f36-4ae2f53bcff1 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:06.233936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4812dee1-18ea-46cd-8f36-4ae2f53bcff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:06.245569 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2e2b8-97a1-458d-949a-2aab6dba68af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:06.246858 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2e2b8-97a1-458d-949a-2aab6dba68af None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.247312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2e2b8-97a1-458d-949a-2aab6dba68af None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.247664 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb2e2b8-97a1-458d-949a-2aab6dba68af None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.258031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2e2b8-97a1-458d-949a-2aab6dba68af None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:06.260132 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb2e2b8-97a1-458d-949a-2aab6dba68af None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:06.280443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-5eb2e2b8-97a1-458d-949a-2aab6dba68af None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:17:06.280443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:06.280443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:06.280443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:06.280443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:06.280443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:06.280443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:06.280443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:06.280443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:06.280443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:06.280443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:06.280443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:06.280443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:06.280443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:06.280443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:06.280443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:06.281467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:06.282416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:06.282416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:06.282416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:06.282416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:06.282416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:06.282416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:06.282416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:06.282416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:06.282416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:17:06.282416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:06.282416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 476/937] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Jul 15 19:17:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:06.288320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2e2b8-97a1-458d-949a-2aab6dba68af None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:06.334935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 462/938] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:06.356501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812dee1-18ea-46cd-8f36-4ae2f53bcff1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:06.427104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb2e2b8-97a1-458d-949a-2aab6dba68af None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:06.471400 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4812dee1-18ea-46cd-8f36-4ae2f53bcff1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:06.476891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36a69c-78e1-4470-abd8-36a1cc41c991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:06.477704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36a69c-78e1-4470-abd8-36a1cc41c991 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.478062 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36a69c-78e1-4470-abd8-36a1cc41c991 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.478414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c36a69c-78e1-4470-abd8-36a1cc41c991 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.479432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36a69c-78e1-4470-abd8-36a1cc41c991 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:06.479814 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36a69c-78e1-4470-abd8-36a1cc41c991 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:06.482048 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c36a69c-78e1-4470-abd8-36a1cc41c991 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:06.490473 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:06.511384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 477/939] 10.222.0.40 () {56 vars in 1149 bytes} [Fri Jul 15 19:17:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:06.512784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36a69c-78e1-4470-abd8-36a1cc41c991 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:06.519758 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e74fec-1b0a-43a4-b376-892d89bbfea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:06.520429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e74fec-1b0a-43a4-b376-892d89bbfea1 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.521046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e74fec-1b0a-43a4-b376-892d89bbfea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.521962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e74fec-1b0a-43a4-b376-892d89bbfea1 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.523555 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e74fec-1b0a-43a4-b376-892d89bbfea1 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:06.525161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e74fec-1b0a-43a4-b376-892d89bbfea1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:06.526536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: WARNING keystone.server.flask.common [None req-a2e74fec-1b0a-43a4-b376-892d89bbfea1 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 15 19:17:06.540389 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:06.568568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.sql.core [None req-a2e74fec-1b0a-43a4-b376-892d89bbfea1 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 19:17:06.568568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 19:17:06.568568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [parameters: {'id': 'a1dc56812708463d9adca4dcf318fca1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 19:17:06.568568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80362) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 19:17:06.593214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-a2e74fec-1b0a-43a4-b376-892d89bbfea1 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a1dc56812708463d9adca4dcf318fca1.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a1dc56812708463d9adca4dcf318fca1. Jul 15 19:17:06.593214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:06.593214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 19:17:06.593214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 19:17:06.593214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 19:17:06.593214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 19:17:06.593214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 19:17:06.593214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 19:17:06.593214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 19:17:06.593214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application conn.query(q) Jul 15 19:17:06.593214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 19:17:06.593214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 19:17:06.593214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result.read() Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 15 19:17:06.594209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 15 19:17:06.601262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 19:17:06.601262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application next(self.gen) Jul 15 19:17:06.601262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 19:17:06.601262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application yield resource Jul 15 19:17:06.601262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 19:17:06.601262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application next(self.gen) Jul 15 19:17:06.601262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 19:17:06.601262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 19:17:06.601262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 19:17:06.601262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 19:17:06.601262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 19:17:06.601262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise self.value Jul 15 19:17:06.601262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 19:17:06.601262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 19:17:06.601262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 19:17:06.601262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application session.commit() Jul 15 19:17:06.601262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 19:17:06.602174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 19:17:06.602174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 19:17:06.602174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 19:17:06.602174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 19:17:06.602174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.session.flush() Jul 15 19:17:06.602174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 19:17:06.602174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 19:17:06.602174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 19:17:06.602174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 19:17:06.602174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 19:17:06.602174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application compat.raise_( Jul 15 19:17:06.602174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 19:17:06.602174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception Jul 15 19:17:06.602174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 19:17:06.602174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 19:17:06.602174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 19:17:06.602174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 19:17:06.603115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 19:17:06.603115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 19:17:06.603115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 19:17:06.603115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 19:17:06.603115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 15 19:17:06.603115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 15 19:17:06.603115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 19:17:06.603115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 19:17:06.603115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 19:17:06.603115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 19:17:06.603115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 19:17:06.603115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 19:17:06.603115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 19:17:06.603115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 19:17:06.603115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 19:17:06.603905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 19:17:06.603905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 19:17:06.603905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception Jul 15 19:17:06.603905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 19:17:06.603905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 19:17:06.603905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 19:17:06.603905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 19:17:06.603905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 19:17:06.603905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 19:17:06.603905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 19:17:06.603905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application conn.query(q) Jul 15 19:17:06.603905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 19:17:06.603905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 19:17:06.603905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 19:17:06.603905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result.read() Jul 15 19:17:06.603905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 19:17:06.603905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 19:17:06.604818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 19:17:06.604818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 19:17:06.604818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 19:17:06.604818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 19:17:06.604818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 19:17:06.604818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 19:17:06.604818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 15 19:17:06.604818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 15 19:17:06.604818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [parameters: {'id': 'a1dc56812708463d9adca4dcf318fca1', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 15 19:17:06.604818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 19:17:06.604818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:06.604818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:06.604818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:06.604818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:06.604818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 15 19:17:06.607306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 15 19:17:06.607306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 19:17:06.607306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 19:17:06.607306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 15 19:17:06.607306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:06.607306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:06.607306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:06.607306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:06.607306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:06.607306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:06.607306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:06.607306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:06.607306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:06.607306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:06.607306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:06.607306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:06.607306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:06.609569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:06.609569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 15 19:17:06.609569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 15 19:17:06.609569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:06.609569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:06.609569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 15 19:17:06.609569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 15 19:17:06.609569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id a1dc56812708463d9adca4dcf318fca1. Jul 15 19:17:06.609569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:06.609569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 463/940] 10.222.0.40 () {60 vars in 1140 bytes} [Fri Jul 15 19:17:06 2022] POST /identity/v3/projects => generated 262 bytes in 240 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:06.612113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e74fec-1b0a-43a4-b376-892d89bbfea1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:06.641407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c36a69c-78e1-4470-abd8-36a1cc41c991 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:06.690612 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e06b6-a62d-4c2e-8c9d-0bd193efa127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:06.691619 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e06b6-a62d-4c2e-8c9d-0bd193efa127 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.691905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e06b6-a62d-4c2e-8c9d-0bd193efa127 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.692185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0e06b6-a62d-4c2e-8c9d-0bd193efa127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.708494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e06b6-a62d-4c2e-8c9d-0bd193efa127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:06.710370 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0e06b6-a62d-4c2e-8c9d-0bd193efa127 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:06.729274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e74fec-1b0a-43a4-b376-892d89bbfea1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:06.735604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-2b0e06b6-a62d-4c2e-8c9d-0bd193efa127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:06.735604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:06.735604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:06.735604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:06.735604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:06.735604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:06.735604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:06.735604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:06.735604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:06.735604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:06.735604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:06.735604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:06.735604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:06.735604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:06.735604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:06.736485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:06.736485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:06.736485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:06.736485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:06.736485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:06.736485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:06.736485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:06.736485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:06.736485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:06.736485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:06.736485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:06.736485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:06.736485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:06.736485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:06.736485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:06.736485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:06.736485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:06.737399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:06.737399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:06.737399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:06.737399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:06.737399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 478/941] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:06.743415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e06b6-a62d-4c2e-8c9d-0bd193efa127 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:06.771598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2db0a-7d56-40e4-bd9a-a0c32d081555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:06.772783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2db0a-7d56-40e4-bd9a-a0c32d081555 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.773269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2db0a-7d56-40e4-bd9a-a0c32d081555 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.773741 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd2db0a-7d56-40e4-bd9a-a0c32d081555 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.782152 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2db0a-7d56-40e4-bd9a-a0c32d081555 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:06.784373 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd2db0a-7d56-40e4-bd9a-a0c32d081555 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:06.799833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-bcd2db0a-7d56-40e4-bd9a-a0c32d081555 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:06.799833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:06.799833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:06.799833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:06.799833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:06.799833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:06.799833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:06.799833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:06.799833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:06.799833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:06.799833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:06.799833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:06.799833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:06.799833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:06.799833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:06.800789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:06.800789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:06.800789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:06.800789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:06.800789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:06.800789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:06.800789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:06.800789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:06.800789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:06.800789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:06.800789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:06.800789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:06.800789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:06.800789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:06.800789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:06.800789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:06.800789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:06.801710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:06.801710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:06.801710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:06.801710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:06.801710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:06.801710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:06.801710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:06.801710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:06.803938 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 464/942] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:06.810782 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2db0a-7d56-40e4-bd9a-a0c32d081555 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:06.837047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:06.878983 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0e06b6-a62d-4c2e-8c9d-0bd193efa127 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:06.883223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:06.925558 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c7b40f-6236-40bd-a49e-3aad5f688bb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:06.926250 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7b40f-6236-40bd-a49e-3aad5f688bb3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.926359 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd2db0a-7d56-40e4-bd9a-a0c32d081555 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:06.926532 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7b40f-6236-40bd-a49e-3aad5f688bb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.926889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c7b40f-6236-40bd-a49e-3aad5f688bb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.927659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7b40f-6236-40bd-a49e-3aad5f688bb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:06.928176 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7b40f-6236-40bd-a49e-3aad5f688bb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:06.929563 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c7b40f-6236-40bd-a49e-3aad5f688bb3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:06.942938 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 479/943] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:06.944181 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ca070-f3f1-4ddf-9b41-052872482665 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.944468 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ca070-f3f1-4ddf-9b41-052872482665 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.944854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47ca070-f3f1-4ddf-9b41-052872482665 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.946244 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 480/944] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:06.951043 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ca070-f3f1-4ddf-9b41-052872482665 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:06.969788 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11827432-0167-40a2-b733-d1b7880c00d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:06.970440 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11827432-0167-40a2-b733-d1b7880c00d8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:06.970724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11827432-0167-40a2-b733-d1b7880c00d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:06.971024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11827432-0167-40a2-b733-d1b7880c00d8 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:06.971938 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11827432-0167-40a2-b733-d1b7880c00d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:06.972060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11827432-0167-40a2-b733-d1b7880c00d8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:06.973489 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11827432-0167-40a2-b733-d1b7880c00d8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:07.002600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 465/945] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Jul 15 19:17:06 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:07.002600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df542d4b-5f1d-4635-afcf-554a5a3cbe96 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:07.002600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df542d4b-5f1d-4635-afcf-554a5a3cbe96 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:07.002600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df542d4b-5f1d-4635-afcf-554a5a3cbe96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:07.019548 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-df542d4b-5f1d-4635-afcf-554a5a3cbe96 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:07.021263 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-df542d4b-5f1d-4635-afcf-554a5a3cbe96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:07.095623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47ca070-f3f1-4ddf-9b41-052872482665 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:07.120792 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 466/946] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:06 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:07.136031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:07.142550 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91175c-caeb-491e-b1cb-9d6933e30997 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:07.143473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91175c-caeb-491e-b1cb-9d6933e30997 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:07.144038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91175c-caeb-491e-b1cb-9d6933e30997 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:07.144038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc91175c-caeb-491e-b1cb-9d6933e30997 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:07.145126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df542d4b-5f1d-4635-afcf-554a5a3cbe96 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:07.153473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91175c-caeb-491e-b1cb-9d6933e30997 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:07.155961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc91175c-caeb-491e-b1cb-9d6933e30997 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:07.169751 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:07.177415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-dc91175c-caeb-491e-b1cb-9d6933e30997 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:07.177415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:07.177415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:07.177415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:07.177415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:07.177415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:07.177415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:07.177415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:07.177415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:07.177415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:07.177415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:07.177415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:07.177415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:07.177415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:07.177415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:07.178414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:07.178414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:07.178414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:07.178414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:07.178414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:07.178414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:07.178414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:07.178414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:07.178414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:07.178414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:07.178414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:07.178414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:07.178414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:07.178414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:07.178414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:07.178414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:07.178414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:07.179349 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:07.179349 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:07.179349 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:07.179349 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:07.179349 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:07.179349 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:07.179349 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:07.179349 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:07.180000 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 481/947] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:07.187773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91175c-caeb-491e-b1cb-9d6933e30997 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:07.279208 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df542d4b-5f1d-4635-afcf-554a5a3cbe96 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:07.319010 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc91175c-caeb-491e-b1cb-9d6933e30997 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:07.326418 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4917b5-c620-4640-a0cb-2aaeded307bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:07.327261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4917b5-c620-4640-a0cb-2aaeded307bc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:07.327554 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4917b5-c620-4640-a0cb-2aaeded307bc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:07.328332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4917b5-c620-4640-a0cb-2aaeded307bc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:07.329004 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4917b5-c620-4640-a0cb-2aaeded307bc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:07.330786 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4917b5-c620-4640-a0cb-2aaeded307bc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:07.346976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-9f4917b5-c620-4640-a0cb-2aaeded307bc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:17:07.346976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:07.346976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:17:07.346976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:17:07.346976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:17:07.346976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:17:07.346976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:17:07.346976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:07.346976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:17:07.346976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:07.346976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:07.346976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:07.346976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:07.346976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:07.346976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:07.346976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:07.346976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:07.348076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:07.348076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:07.348076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:07.348076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:07.348076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:07.348076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:07.348076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:17:07.348076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:17:07.348076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:17:07.348076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:17:07.348076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:07.348076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:07.348076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:07.348076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:07.348076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:07.348076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:07.348949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:07.348949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:07.348949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:07.348949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:07.348949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:07.348949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:07.348949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:07.348949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:07.348949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:07.348949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:07.348949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:17:07.348949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:07.348949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:17:07.348949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:07.350469 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 467/948] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Jul 15 19:17:07 2022] GET /identity/v3/services/object-store => generated 93 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:07.356044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4917b5-c620-4640-a0cb-2aaeded307bc None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:07.361471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e046f5-c58f-4dfa-b2b7-33875d67635d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:07.362372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e046f5-c58f-4dfa-b2b7-33875d67635d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:07.362859 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e046f5-c58f-4dfa-b2b7-33875d67635d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:07.363229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e046f5-c58f-4dfa-b2b7-33875d67635d None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:07.364157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e046f5-c58f-4dfa-b2b7-33875d67635d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:07.364572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e046f5-c58f-4dfa-b2b7-33875d67635d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:07.366877 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e046f5-c58f-4dfa-b2b7-33875d67635d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:07.383149 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 482/949] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:07.390487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e046f5-c58f-4dfa-b2b7-33875d67635d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:07.453284 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:07.483811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:07.503107 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e046f5-c58f-4dfa-b2b7-33875d67635d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:07.503865 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4917b5-c620-4640-a0cb-2aaeded307bc None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:07.539431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90a1d5-2292-4faa-80f0-4ef86dce80e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:07.540341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90a1d5-2292-4faa-80f0-4ef86dce80e4 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:07.540682 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90a1d5-2292-4faa-80f0-4ef86dce80e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:07.541047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e90a1d5-2292-4faa-80f0-4ef86dce80e4 None admin] PATH_INFO: `/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/deed55901c264b8da58e57c21840c491/roles/9895fbb6b76e4545802b1565612c8bf7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:07.543438 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90a1d5-2292-4faa-80f0-4ef86dce80e4 None admin] RBAC: Authorizing `identity:create_grant(project_id=861de78bbfe84bd991c3ab54e85573a7, user_id=deed55901c264b8da58e57c21840c491, role_id=9895fbb6b76e4545802b1565612c8bf7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:07.545053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195cc5e-0f70-4e61-a999-e0df055d6578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:07.545190 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e90a1d5-2292-4faa-80f0-4ef86dce80e4 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:07.545970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195cc5e-0f70-4e61-a999-e0df055d6578 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:07.546419 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195cc5e-0f70-4e61-a999-e0df055d6578 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:07.546866 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195cc5e-0f70-4e61-a999-e0df055d6578 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:07.547826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195cc5e-0f70-4e61-a999-e0df055d6578 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:07.548399 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195cc5e-0f70-4e61-a999-e0df055d6578 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:07.549950 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5195cc5e-0f70-4e61-a999-e0df055d6578 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:07.555413 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 468/950] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Jul 15 19:17:07 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:07.562074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195cc5e-0f70-4e61-a999-e0df055d6578 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:07.654552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 483/951] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:17:07 2022] PUT /identity/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/deed55901c264b8da58e57c21840c491/roles/9895fbb6b76e4545802b1565612c8bf7 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:17:07.679426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195cc5e-0f70-4e61-a999-e0df055d6578 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:07.722426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380d4c4-82ae-4113-a20b-bb61a9642932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:07.723548 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380d4c4-82ae-4113-a20b-bb61a9642932 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:07.724096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380d4c4-82ae-4113-a20b-bb61a9642932 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:07.724582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8380d4c4-82ae-4113-a20b-bb61a9642932 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:07.725536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380d4c4-82ae-4113-a20b-bb61a9642932 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:07.726070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380d4c4-82ae-4113-a20b-bb61a9642932 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:07.727724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8380d4c4-82ae-4113-a20b-bb61a9642932 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:07.734386 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 469/952] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Jul 15 19:17:07 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:07.740774 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90a1d5-2292-4faa-80f0-4ef86dce80e4 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:07.854062 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e90a1d5-2292-4faa-80f0-4ef86dce80e4 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:07.869792 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:07.893249 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddce1f8e-ae0f-45bf-82fd-462d65b18245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:07.893920 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce1f8e-ae0f-45bf-82fd-462d65b18245 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:07.894206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce1f8e-ae0f-45bf-82fd-462d65b18245 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:07.894486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddce1f8e-ae0f-45bf-82fd-462d65b18245 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:07.895336 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce1f8e-ae0f-45bf-82fd-462d65b18245 None admin] RBAC: Adding query filter params (interface=public, service_id=9c8ec2de081c4737b4af3ab494d43cd7, region_id=RegionOne) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:07.895650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce1f8e-ae0f-45bf-82fd-462d65b18245 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:07.897024 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddce1f8e-ae0f-45bf-82fd-462d65b18245 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:07.903334 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 484/953] 10.222.0.40 () {56 vars in 1251 bytes} [Fri Jul 15 19:17:07 2022] GET /identity/v3/endpoints?service_id=9c8ec2de081c4737b4af3ab494d43cd7&interface=public®ion_id=RegionOne => generated 194 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:07.909026 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380d4c4-82ae-4113-a20b-bb61a9642932 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:07.925434 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:08.016135 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8380d4c4-82ae-4113-a20b-bb61a9642932 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:08.052578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b3e97d-9588-4311-a1cb-32757e672912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:08.053244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3e97d-9588-4311-a1cb-32757e672912 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.053531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3e97d-9588-4311-a1cb-32757e672912 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.053813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b3e97d-9588-4311-a1cb-32757e672912 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.054500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3e97d-9588-4311-a1cb-32757e672912 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:08.055898 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b3e97d-9588-4311-a1cb-32757e672912 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:08.062645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 470/954] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Jul 15 19:17:07 2022] GET /identity/v3/services => generated 1497 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:17:08.338473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06ad01-ccc6-404e-a6eb-1716d70b973e None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.338772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06ad01-ccc6-404e-a6eb-1716d70b973e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.339063 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f06ad01-ccc6-404e-a6eb-1716d70b973e None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.341249 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 485/955] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:08.346603 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76b5aa-d834-46a6-8c12-47f90ef86e6f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.346925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76b5aa-d834-46a6-8c12-47f90ef86e6f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.347218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba76b5aa-d834-46a6-8c12-47f90ef86e6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.364998 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ba76b5aa-d834-46a6-8c12-47f90ef86e6f None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:08.366203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ba76b5aa-d834-46a6-8c12-47f90ef86e6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:08.438416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 471/956] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:08 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:08.461353 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06ad01-ccc6-404e-a6eb-1716d70b973e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:08.569359 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f06ad01-ccc6-404e-a6eb-1716d70b973e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:08.605068 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8138ddb-a292-4093-a61f-ffd8e61b94cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:08.605674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8138ddb-a292-4093-a61f-ffd8e61b94cc None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:08.605952 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8138ddb-a292-4093-a61f-ffd8e61b94cc None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:08.606265 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8138ddb-a292-4093-a61f-ffd8e61b94cc None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:08.607092 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8138ddb-a292-4093-a61f-ffd8e61b94cc None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:08.608459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8138ddb-a292-4093-a61f-ffd8e61b94cc None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:08.725505 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 486/957] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Jul 15 19:17:08 2022] POST /identity/v3/services => generated 242 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:17:09.235873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b218b6e-121a-46b5-a25f-aa27eed6b050 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:09.236391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b218b6e-121a-46b5-a25f-aa27eed6b050 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:09.236502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b218b6e-121a-46b5-a25f-aa27eed6b050 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:09.238110 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 472/958] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:09.243595 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dba59-6cdd-4f93-831b-7d624a821787 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:09.244038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dba59-6cdd-4f93-831b-7d624a821787 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:09.244136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46dba59-6cdd-4f93-831b-7d624a821787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:09.266109 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-b46dba59-6cdd-4f93-831b-7d624a821787 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:09.267346 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b46dba59-6cdd-4f93-831b-7d624a821787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:09.299562 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:09.346300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 487/959] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:09.372748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b218b6e-121a-46b5-a25f-aa27eed6b050 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:09.382072 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:09.481646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b218b6e-121a-46b5-a25f-aa27eed6b050 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:09.517672 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce6751-e779-4d64-a6c8-6ce269dd473e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:09.518345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce6751-e779-4d64-a6c8-6ce269dd473e None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:09.518631 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce6751-e779-4d64-a6c8-6ce269dd473e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:09.518938 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ce6751-e779-4d64-a6c8-6ce269dd473e None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:09.519648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce6751-e779-4d64-a6c8-6ce269dd473e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:09.521129 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ce6751-e779-4d64-a6c8-6ce269dd473e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:09.579694 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.sql.core [None req-93ce6751-e779-4d64-a6c8-6ce269dd473e None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 19:17:09.579694 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 19:17:09.579694 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [parameters: {'user_id': 'cfcf18d292df4b4f86bc9b8aa18c775a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 19:17:09.579694 dv-cinder-799871-34-smb devstack@keystone.service[80362]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80362) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 15 19:17:09.587646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-93ce6751-e779-4d64-a6c8-6ce269dd473e None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 19:17:09.587646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:09.587646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 19:17:09.587646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 19:17:09.587646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 19:17:09.587646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 19:17:09.587646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 19:17:09.587646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 19:17:09.587646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 19:17:09.587646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application conn.query(q) Jul 15 19:17:09.587646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 19:17:09.587646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 19:17:09.587646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 19:17:09.587646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result.read() Jul 15 19:17:09.587646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 19:17:09.588573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application next(self.gen) Jul 15 19:17:09.589556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 15 19:17:09.589556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application yield resource Jul 15 19:17:09.589556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 15 19:17:09.589556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application next(self.gen) Jul 15 19:17:09.589556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 15 19:17:09.589556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.session.rollback() Jul 15 19:17:09.589556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 15 19:17:09.589556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.force_reraise() Jul 15 19:17:09.589556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 15 19:17:09.589556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise self.value Jul 15 19:17:09.589556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 15 19:17:09.589556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 15 19:17:09.589556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 15 19:17:09.589556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application session.commit() Jul 15 19:17:09.589556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 15 19:17:09.589556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 15 19:17:09.589556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 15 19:17:09.590658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._prepare_impl() Jul 15 19:17:09.590658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 15 19:17:09.590658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.session.flush() Jul 15 19:17:09.590658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 15 19:17:09.590658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._flush(objects) Jul 15 19:17:09.590658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 15 19:17:09.590658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 15 19:17:09.590658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 15 19:17:09.590658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application compat.raise_( Jul 15 19:17:09.590658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 19:17:09.590658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception Jul 15 19:17:09.590658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 15 19:17:09.590658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application flush_context.execute() Jul 15 19:17:09.590658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 15 19:17:09.590658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rec.execute(self) Jul 15 19:17:09.590658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 15 19:17:09.590658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 15 19:17:09.593283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 15 19:17:09.593283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 15 19:17:09.593283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 15 19:17:09.593283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 15 19:17:09.593283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 15 19:17:09.593283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 15 19:17:09.593283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 15 19:17:09.593283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 15 19:17:09.593283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 15 19:17:09.593283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 15 19:17:09.593283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 15 19:17:09.593283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 15 19:17:09.593283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 15 19:17:09.593283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 15 19:17:09.593283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 15 19:17:09.593283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception Jul 15 19:17:09.595392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 15 19:17:09.595392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 15 19:17:09.595392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 15 19:17:09.595392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 15 19:17:09.595392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 15 19:17:09.595392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result = self._query(query) Jul 15 19:17:09.595392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 15 19:17:09.595392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application conn.query(q) Jul 15 19:17:09.595392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 15 19:17:09.595392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 15 19:17:09.595392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 15 19:17:09.595392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application result.read() Jul 15 19:17:09.595392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 15 19:17:09.595392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 15 19:17:09.595392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 15 19:17:09.595392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 15 19:17:09.597424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 15 19:17:09.597424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 15 19:17:09.597424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 15 19:17:09.597424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 15 19:17:09.597424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 15 19:17:09.597424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 15 19:17:09.597424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cfcf18d292df4b4f86bc9b8aa18c775a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 15 19:17:09.597424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 15 19:17:09.597424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:09.597424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:09.597424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:09.597424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:09.597424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:09.597424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:09.597424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:09.599335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:09.599335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:09.599335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:09.599335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:09.599335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:09.599335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:09.599335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:09.599335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 15 19:17:09.599335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 15 19:17:09.599335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:09.599335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:09.599335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:09.599335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:09.599335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:09.599335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:09.599335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 15 19:17:09.599335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 15 19:17:09.601560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 15 19:17:09.601560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 15 19:17:09.601560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 15 19:17:09.601560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 15 19:17:09.601560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 15 19:17:09.601560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:09.601560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 473/960] 10.222.0.40 () {60 vars in 1131 bytes} [Fri Jul 15 19:17:09 2022] POST /identity/v3/users => generated 160 bytes in 218 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:09.602490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dba59-6cdd-4f93-831b-7d624a821787 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:09.703987 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46dba59-6cdd-4f93-831b-7d624a821787 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:09.742931 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bf8323-95b8-4006-b230-592cd90cf389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:09.744179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf8323-95b8-4006-b230-592cd90cf389 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:09.744660 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf8323-95b8-4006-b230-592cd90cf389 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:09.745210 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bf8323-95b8-4006-b230-592cd90cf389 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:09.754560 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf8323-95b8-4006-b230-592cd90cf389 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:09.756366 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bf8323-95b8-4006-b230-592cd90cf389 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:09.773405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-09bf8323-95b8-4006-b230-592cd90cf389 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 19:17:09.773405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:09.773405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:09.773405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:09.773405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:09.773405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:09.773405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:09.773405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:09.773405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:09.773405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:09.773405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:09.773405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:09.773405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:09.773405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:09.773405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:09.773405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:09.774423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:09.775486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:09.775486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:09.775486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:09.775486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:09.775486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:09.775486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:09.775486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:09.775486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:09.775486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 15 19:17:09.775486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:09.778731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 488/961] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:09 2022] GET /identity/v3/users/cinder => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:09.787486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce6751-e779-4d64-a6c8-6ce269dd473e None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:09.833803 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b3186-7c92-43d4-99af-1dd438c57c83 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:09.834150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b3186-7c92-43d4-99af-1dd438c57c83 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:09.834359 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-806b3186-7c92-43d4-99af-1dd438c57c83 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:09.836111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 489/962] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:17:09.842081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c681f-7e0a-4f88-9594-b8b8f6467c3e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:09.842355 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c681f-7e0a-4f88-9594-b8b8f6467c3e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:09.842633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-111c681f-7e0a-4f88-9594-b8b8f6467c3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:09.860304 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-111c681f-7e0a-4f88-9594-b8b8f6467c3e None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:09.861422 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-111c681f-7e0a-4f88-9594-b8b8f6467c3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:09.863878 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:09.880091 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:09.899811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ce6751-e779-4d64-a6c8-6ce269dd473e None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:09.940475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af93d2-99c1-47dd-9f36-e6c9151a60b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:09.941146 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af93d2-99c1-47dd-9f36-e6c9151a60b3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:09.941507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af93d2-99c1-47dd-9f36-e6c9151a60b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:09.941780 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4af93d2-99c1-47dd-9f36-e6c9151a60b3 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:09.942599 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af93d2-99c1-47dd-9f36-e6c9151a60b3 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:09.942947 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af93d2-99c1-47dd-9f36-e6c9151a60b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:09.944586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4af93d2-99c1-47dd-9f36-e6c9151a60b3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:09.947004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 490/963] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:09 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:17:09.964617 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c681f-7e0a-4f88-9594-b8b8f6467c3e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:09.998940 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 474/964] 10.222.0.40 () {56 vars in 1101 bytes} [Fri Jul 15 19:17:09 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:10.078186 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-111c681f-7e0a-4f88-9594-b8b8f6467c3e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:10.117785 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a727c99-be77-4a47-9431-c9057516032e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:10.118526 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a727c99-be77-4a47-9431-c9057516032e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:10.118836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a727c99-be77-4a47-9431-c9057516032e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:10.119114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a727c99-be77-4a47-9431-c9057516032e None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:10.132242 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a727c99-be77-4a47-9431-c9057516032e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:10.141182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-9a727c99-be77-4a47-9431-c9057516032e None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:17:10.141182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:10.141182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:10.141182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:10.141182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:10.141182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:10.141182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:10.141182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:10.141182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:10.141182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:10.141182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:10.141182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:10.141182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:10.141182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:10.141182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:10.141182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:10.142209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:10.142209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:10.142209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:10.142209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:10.142209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:10.142209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:10.142209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:10.142209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:10.142209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:10.142209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:10.142209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:10.142209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:10.142209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:10.142209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:10.142209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:10.142209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:10.143169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:10.143169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:10.143169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:10.143169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:10.143169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:10.143169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:10.143169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:10.143169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:10.143169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:10.143169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:10.143169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:17:10.143169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:10.146832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 491/965] 10.222.0.40 () {56 vars in 1120 bytes} [Fri Jul 15 19:17:09 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:10.148929 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af93d2-99c1-47dd-9f36-e6c9151a60b3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:10.192499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73394222-5327-41e1-809b-c8784e67ecdf None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:10.193135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73394222-5327-41e1-809b-c8784e67ecdf None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:10.193640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73394222-5327-41e1-809b-c8784e67ecdf None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:10.195232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 492/966] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:17:10.202211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cf300-3134-4ebb-bc9f-0036398573fe None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:10.202838 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cf300-3134-4ebb-bc9f-0036398573fe None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:10.203120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1cf300-3134-4ebb-bc9f-0036398573fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:10.222313 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-1a1cf300-3134-4ebb-bc9f-0036398573fe None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:10.223567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1a1cf300-3134-4ebb-bc9f-0036398573fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:10.234554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:10.269040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4af93d2-99c1-47dd-9f36-e6c9151a60b3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:10.302609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:10.311989 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861988e0-624f-4209-a622-d28db9351ee9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:10.312667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861988e0-624f-4209-a622-d28db9351ee9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:10.312952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861988e0-624f-4209-a622-d28db9351ee9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:10.313241 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-861988e0-624f-4209-a622-d28db9351ee9 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:10.313976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861988e0-624f-4209-a622-d28db9351ee9 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:10.314283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861988e0-624f-4209-a622-d28db9351ee9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:10.315732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-861988e0-624f-4209-a622-d28db9351ee9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:10.317082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 493/967] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:10.330704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 475/968] 10.222.0.40 () {56 vars in 1115 bytes} [Fri Jul 15 19:17:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:10.336528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cf300-3134-4ebb-bc9f-0036398573fe None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:10.340115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861988e0-624f-4209-a622-d28db9351ee9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:10.447430 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1cf300-3134-4ebb-bc9f-0036398573fe None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:10.462374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-861988e0-624f-4209-a622-d28db9351ee9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:10.486216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93978f5-9524-48a3-8af9-399b30915303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:10.487051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93978f5-9524-48a3-8af9-399b30915303 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:10.487338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93978f5-9524-48a3-8af9-399b30915303 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:10.487764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93978f5-9524-48a3-8af9-399b30915303 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:10.499392 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93978f5-9524-48a3-8af9-399b30915303 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:10.500841 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b93978f5-9524-48a3-8af9-399b30915303 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:10.501676 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a5b85-a161-4d03-841f-fdf588c74ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:10.502612 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:10.503260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a5b85-a161-4d03-841f-fdf588c74ff2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:10.503588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a5b85-a161-4d03-841f-fdf588c74ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:10.503976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858a5b85-a161-4d03-841f-fdf588c74ff2 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:10.504606 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a5b85-a161-4d03-841f-fdf588c74ff2 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:10.505974 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-858a5b85-a161-4d03-841f-fdf588c74ff2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:10.519452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-858a5b85-a161-4d03-841f-fdf588c74ff2 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:17:10.519452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:10.519452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:17:10.519452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:17:10.519452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:17:10.519452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:17:10.519452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:17:10.519452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:10.519452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:17:10.519452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:10.519452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:10.519452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:10.519452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:10.519452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:10.519452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:10.519452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:10.519452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:10.520738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:10.520738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:10.520738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:10.520738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:10.520738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:10.520738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:10.520738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:17:10.520738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:17:10.520738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:17:10.520738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:17:10.520738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:10.520738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:10.520738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:10.520738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:10.520738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:10.520738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:10.521643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:10.521643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:10.521643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:10.521643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:10.521643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:10.521643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:10.521643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:10.521643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:10.521643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:10.521643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:10.521643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:17:10.521643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:10.521643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:17:10.521643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:10.522431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-b93978f5-9524-48a3-8af9-399b30915303 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:10.522431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:10.522431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:10.522431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:10.522431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:10.522431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:10.522431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:10.522431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:10.522431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:10.522431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:10.522431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:10.522431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:10.522431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:10.522431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:10.522431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:10.523279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:10.523279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:10.523279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:10.523279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:10.523279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:10.523279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:10.523279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:10.523279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:10.523279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:10.523279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:10.523279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:10.523279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:10.523279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:10.523279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:10.523279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:10.523279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:10.523279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:10.524161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:10.524161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:10.524161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:10.524161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:10.524400 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 476/969] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Jul 15 19:17:10 2022] GET /identity/v3/services/object-store => generated 93 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:10.525567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 494/970] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:10.526703 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a5b85-a161-4d03-841f-fdf588c74ff2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:10.529266 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93978f5-9524-48a3-8af9-399b30915303 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:10.608171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:10.662283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-858a5b85-a161-4d03-841f-fdf588c74ff2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:10.665439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93978f5-9524-48a3-8af9-399b30915303 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:10.696082 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0a3ee-e510-4148-b1fe-11877b571ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:10.696742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0a3ee-e510-4148-b1fe-11877b571ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:10.697028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0a3ee-e510-4148-b1fe-11877b571ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:10.697310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea0a3ee-e510-4148-b1fe-11877b571ee5 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:10.698095 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0a3ee-e510-4148-b1fe-11877b571ee5 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:10.698362 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0a3ee-e510-4148-b1fe-11877b571ee5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:10.700438 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea0a3ee-e510-4148-b1fe-11877b571ee5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:10.705502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 477/971] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Jul 15 19:17:10 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:10.707456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b220f6-753b-4a20-9433-a9063c70c6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:10.708135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b220f6-753b-4a20-9433-a9063c70c6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:10.708404 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b220f6-753b-4a20-9433-a9063c70c6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:10.708682 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b220f6-753b-4a20-9433-a9063c70c6a9 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:10.709415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b220f6-753b-4a20-9433-a9063c70c6a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:10.709725 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b220f6-753b-4a20-9433-a9063c70c6a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:10.711123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b220f6-753b-4a20-9433-a9063c70c6a9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:10.711523 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0a3ee-e510-4148-b1fe-11877b571ee5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:10.727049 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 495/972] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:10.734300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b220f6-753b-4a20-9433-a9063c70c6a9 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:10.793027 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:10.831173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea0a3ee-e510-4148-b1fe-11877b571ee5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:10.844011 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b220f6-753b-4a20-9433-a9063c70c6a9 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:10.849636 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:10.868686 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf5554f-373d-400f-8a87-f741e8e6779f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:10.869393 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5554f-373d-400f-8a87-f741e8e6779f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:10.869672 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5554f-373d-400f-8a87-f741e8e6779f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:10.869955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf5554f-373d-400f-8a87-f741e8e6779f None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:10.870783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5554f-373d-400f-8a87-f741e8e6779f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:10.871118 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5554f-373d-400f-8a87-f741e8e6779f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:10.872640 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf5554f-373d-400f-8a87-f741e8e6779f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:10.878141 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 478/973] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Jul 15 19:17:10 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:10.879543 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562879d-95fa-444f-a2bb-3469a66c0991 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:10.879808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562879d-95fa-444f-a2bb-3469a66c0991 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:10.880087 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7562879d-95fa-444f-a2bb-3469a66c0991 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:10.881080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b65bc1-7ea5-493c-b48a-c0b82c0ed64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:10.881726 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 479/974] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:10.881894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b65bc1-7ea5-493c-b48a-c0b82c0ed64f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:10.882175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b65bc1-7ea5-493c-b48a-c0b82c0ed64f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:10.882455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b65bc1-7ea5-493c-b48a-c0b82c0ed64f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:10.883579 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562879d-95fa-444f-a2bb-3469a66c0991 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:10.894579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b65bc1-7ea5-493c-b48a-c0b82c0ed64f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:10.896066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b65bc1-7ea5-493c-b48a-c0b82c0ed64f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:10.911362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-b2b65bc1-7ea5-493c-b48a-c0b82c0ed64f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:17:10.911362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:10.911362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:10.911362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:10.911362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:10.911362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:10.911362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:10.911362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:10.911362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:10.911362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:10.911362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:10.911362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:10.911362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:10.911362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:10.911362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:10.911362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:10.912518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:10.913488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:10.913488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:10.913488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:10.913488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:10.913488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:10.913488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:10.913488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:10.913488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:10.913488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 15 19:17:10.913488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:10.914910 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 496/975] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Jul 15 19:17:10 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:10.916361 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1f66c-6a47-4d72-9886-6db48e362d62 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:10.916646 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1f66c-6a47-4d72-9886-6db48e362d62 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:10.916924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e1f66c-6a47-4d72-9886-6db48e362d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:10.933525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-16e1f66c-6a47-4d72-9886-6db48e362d62 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:10.934863 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-16e1f66c-6a47-4d72-9886-6db48e362d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:10.994075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7562879d-95fa-444f-a2bb-3469a66c0991 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:11.002929 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 497/976] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:10 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:11.003853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1f66c-6a47-4d72-9886-6db48e362d62 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:11.033195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693876b-c4cc-4d42-ad40-7e295ef496bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:11.033851 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693876b-c4cc-4d42-ad40-7e295ef496bd None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.034136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693876b-c4cc-4d42-ad40-7e295ef496bd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.034416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1693876b-c4cc-4d42-ad40-7e295ef496bd None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.035199 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693876b-c4cc-4d42-ad40-7e295ef496bd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:11.036571 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1693876b-c4cc-4d42-ad40-7e295ef496bd None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:11.049888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:11.104035 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e1f66c-6a47-4d72-9886-6db48e362d62 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:11.138045 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437549b-b5fb-42c4-bff9-a07672f27149 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:11.138727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437549b-b5fb-42c4-bff9-a07672f27149 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.139023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437549b-b5fb-42c4-bff9-a07672f27149 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.139296 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a437549b-b5fb-42c4-bff9-a07672f27149 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.140381 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437549b-b5fb-42c4-bff9-a07672f27149 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:11.140687 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437549b-b5fb-42c4-bff9-a07672f27149 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:11.142101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a437549b-b5fb-42c4-bff9-a07672f27149 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:11.157189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 480/977] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Jul 15 19:17:10 2022] POST /identity/v3/endpoints => generated 349 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:17:11.165442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693876b-c4cc-4d42-ad40-7e295ef496bd None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:11.165618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 498/978] 10.222.0.40 () {56 vars in 1149 bytes} [Fri Jul 15 19:17:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:11.165857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437549b-b5fb-42c4-bff9-a07672f27149 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:11.205139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:11.283336 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a437549b-b5fb-42c4-bff9-a07672f27149 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:11.284984 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:11.292599 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1693876b-c4cc-4d42-ad40-7e295ef496bd None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:11.326546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717c462-7c95-44f1-bade-0b66034d69aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:11.327910 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717c462-7c95-44f1-bade-0b66034d69aa None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.328190 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717c462-7c95-44f1-bade-0b66034d69aa None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.328465 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717c462-7c95-44f1-bade-0b66034d69aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.334314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c04210-77df-4d26-a79d-98b65ada2c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:11.335135 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c04210-77df-4d26-a79d-98b65ada2c8d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.335420 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c04210-77df-4d26-a79d-98b65ada2c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.335690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04c04210-77df-4d26-a79d-98b65ada2c8d None admin] PATH_INFO: `/v3/services/compute` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.336351 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c04210-77df-4d26-a79d-98b65ada2c8d None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:11.337719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04c04210-77df-4d26-a79d-98b65ada2c8d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:11.352064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-04c04210-77df-4d26-a79d-98b65ada2c8d None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:17:11.352064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:11.352064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:17:11.352064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:17:11.352064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:17:11.352064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:17:11.352064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:17:11.352064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:11.352064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:17:11.352064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:11.352064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:11.352064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:11.352064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:11.352064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:11.352064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:11.352064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:11.352064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:11.353198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:11.353198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:11.353198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:11.353198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:11.353198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:11.353198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:11.353198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:17:11.353198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:17:11.353198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:17:11.353198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:17:11.353198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:11.353198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:11.353198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:11.353198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:11.353198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:11.353198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:11.354045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:11.354045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:11.354045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:11.354045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:11.354045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:11.354045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:11.354045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:11.354045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:11.354045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:11.354045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:11.354045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:17:11.354045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:11.354045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:17:11.354045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:11.363144 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 481/979] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:11.363144 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c04210-77df-4d26-a79d-98b65ada2c8d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:11.418918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717c462-7c95-44f1-bade-0b66034d69aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:11.420427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717c462-7c95-44f1-bade-0b66034d69aa None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:11.471195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:11.479070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04c04210-77df-4d26-a79d-98b65ada2c8d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:11.517543 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e35b55-f2b4-446b-9dd3-25970f93e6a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:11.518215 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e35b55-f2b4-446b-9dd3-25970f93e6a6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.518497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e35b55-f2b4-446b-9dd3-25970f93e6a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.519002 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e35b55-f2b4-446b-9dd3-25970f93e6a6 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.519516 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e35b55-f2b4-446b-9dd3-25970f93e6a6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:11.519821 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e35b55-f2b4-446b-9dd3-25970f93e6a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:11.521183 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e35b55-f2b4-446b-9dd3-25970f93e6a6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:11.531223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 482/980] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Jul 15 19:17:11 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:11.532347 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e35b55-f2b4-446b-9dd3-25970f93e6a6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:11.535799 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 499/981] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:11 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 19:17:11.541501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717c462-7c95-44f1-bade-0b66034d69aa None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:11.544188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:11.649073 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e35b55-f2b4-446b-9dd3-25970f93e6a6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:11.655845 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717c462-7c95-44f1-bade-0b66034d69aa None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:11.689157 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e587242-9389-4406-bfe2-607cbee1bdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:11.689818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e587242-9389-4406-bfe2-607cbee1bdb8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.690103 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e587242-9389-4406-bfe2-607cbee1bdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.690401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e587242-9389-4406-bfe2-607cbee1bdb8 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.691113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e587242-9389-4406-bfe2-607cbee1bdb8 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:11.691424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e587242-9389-4406-bfe2-607cbee1bdb8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:11.691598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be725f3e-8b8e-4f64-8a22-57a43cd71d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:11.692386 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be725f3e-8b8e-4f64-8a22-57a43cd71d58 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.692667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be725f3e-8b8e-4f64-8a22-57a43cd71d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.692820 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e587242-9389-4406-bfe2-607cbee1bdb8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:11.692979 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be725f3e-8b8e-4f64-8a22-57a43cd71d58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.703309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 483/982] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Jul 15 19:17:11 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:11.704541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be725f3e-8b8e-4f64-8a22-57a43cd71d58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:11.705627 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e587242-9389-4406-bfe2-607cbee1bdb8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:11.706012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be725f3e-8b8e-4f64-8a22-57a43cd71d58 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:11.724834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-be725f3e-8b8e-4f64-8a22-57a43cd71d58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:11.724834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:11.724834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:11.724834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:11.724834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:11.724834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:11.724834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:11.724834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:11.724834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:11.724834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:11.724834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:11.724834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:11.724834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:11.724834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:11.724834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:11.730530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:11.730530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:11.730530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:11.730530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:11.730530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:11.730530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:11.730530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:11.730530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:11.730530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:11.730530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:11.730530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:11.730530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:11.730530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:11.730530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:11.730530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:11.730530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:11.730530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:11.731610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:11.731610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:11.731610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:11.731610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:11.731610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 500/983] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:11.732073 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be725f3e-8b8e-4f64-8a22-57a43cd71d58 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:11.738520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:11.793862 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:11.825492 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e587242-9389-4406-bfe2-607cbee1bdb8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:11.843438 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be725f3e-8b8e-4f64-8a22-57a43cd71d58 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:11.863902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6c35c-71bd-4d0d-a065-6f7d003c2421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:11.864568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6c35c-71bd-4d0d-a065-6f7d003c2421 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.864852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6c35c-71bd-4d0d-a065-6f7d003c2421 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.865128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf6c35c-71bd-4d0d-a065-6f7d003c2421 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.865919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6c35c-71bd-4d0d-a065-6f7d003c2421 None admin] RBAC: Adding query filter params (interface=public, service_id=03056b7ffca04d8f84a4f3279c458d7c, region_id=RegionOne) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:11.866633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6c35c-71bd-4d0d-a065-6f7d003c2421 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:11.867650 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf6c35c-71bd-4d0d-a065-6f7d003c2421 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:11.873932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 484/984] 10.222.0.40 () {56 vars in 1251 bytes} [Fri Jul 15 19:17:11 2022] GET /identity/v3/endpoints?service_id=03056b7ffca04d8f84a4f3279c458d7c&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:11.879392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6c35c-71bd-4d0d-a065-6f7d003c2421 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:11.888255 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d5622-e992-4d82-9919-ab5480807533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:11.888929 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d5622-e992-4d82-9919-ab5480807533 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:11.889199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d5622-e992-4d82-9919-ab5480807533 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:11.889718 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867d5622-e992-4d82-9919-ab5480807533 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:11.890445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d5622-e992-4d82-9919-ab5480807533 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:11.890774 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d5622-e992-4d82-9919-ab5480807533 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:11.892147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867d5622-e992-4d82-9919-ab5480807533 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:11.904354 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 501/985] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:11.910086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d5622-e992-4d82-9919-ab5480807533 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:11.974780 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:11.988068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf6c35c-71bd-4d0d-a065-6f7d003c2421 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:12.022667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867d5622-e992-4d82-9919-ab5480807533 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:12.026348 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dd963-841f-4048-863e-80c545249f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:12.027043 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dd963-841f-4048-863e-80c545249f95 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:12.027378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dd963-841f-4048-863e-80c545249f95 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:12.027658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565dd963-841f-4048-863e-80c545249f95 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:12.028352 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565dd963-841f-4048-863e-80c545249f95 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:12.029795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565dd963-841f-4048-863e-80c545249f95 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:12.046867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 485/986] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Jul 15 19:17:11 2022] GET /identity/v3/services => generated 1727 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:17:12.048288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:12.073758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11e999-50b4-49d7-aa23-1dcc2dc365a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:12.075614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11e999-50b4-49d7-aa23-1dcc2dc365a0 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:12.076120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11e999-50b4-49d7-aa23-1dcc2dc365a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:12.076460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c11e999-50b4-49d7-aa23-1dcc2dc365a0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:12.084297 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11e999-50b4-49d7-aa23-1dcc2dc365a0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:12.085864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c11e999-50b4-49d7-aa23-1dcc2dc365a0 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:12.102477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-5c11e999-50b4-49d7-aa23-1dcc2dc365a0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:12.102477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:12.102477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:12.102477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:12.102477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:12.102477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:12.102477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:12.102477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:12.102477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:12.102477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:12.102477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:12.102477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:12.102477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:12.102477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:12.102477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:12.103770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:12.103770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:12.103770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:12.103770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:12.103770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:12.103770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:12.103770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:12.103770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:12.103770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:12.103770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:12.103770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:12.103770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:12.103770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:12.103770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:12.103770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:12.103770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:12.103770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:12.104784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:12.104784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:12.104784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:12.104784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:12.104784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:12.104784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:12.104784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:12.104784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:12.106369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 502/987] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:12.110531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dd963-841f-4048-863e-80c545249f95 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:12.227963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565dd963-841f-4048-863e-80c545249f95 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:12.265502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0488e0f0-7146-4a69-a806-2c7dc3b6b7fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:12.266157 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488e0f0-7146-4a69-a806-2c7dc3b6b7fb None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:12.266439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488e0f0-7146-4a69-a806-2c7dc3b6b7fb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:12.266714 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0488e0f0-7146-4a69-a806-2c7dc3b6b7fb None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:12.267532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488e0f0-7146-4a69-a806-2c7dc3b6b7fb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:12.267841 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488e0f0-7146-4a69-a806-2c7dc3b6b7fb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:12.269269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0488e0f0-7146-4a69-a806-2c7dc3b6b7fb None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:12.283090 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 486/988] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:12.289115 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11e999-50b4-49d7-aa23-1dcc2dc365a0 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:12.397451 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c11e999-50b4-49d7-aa23-1dcc2dc365a0 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:12.432828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28d6c7f-a268-4c4f-82bc-b784a9e15385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:12.434037 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6c7f-a268-4c4f-82bc-b784a9e15385 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:12.434329 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6c7f-a268-4c4f-82bc-b784a9e15385 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:12.434607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28d6c7f-a268-4c4f-82bc-b784a9e15385 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:12.435465 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d6c7f-a268-4c4f-82bc-b784a9e15385 None admin] RBAC: Adding query filter params (role.id=9895fbb6b76e4545802b1565612c8bf7, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=deed55901c264b8da58e57c21840c491) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:12.435782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d6c7f-a268-4c4f-82bc-b784a9e15385 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:12.437237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28d6c7f-a268-4c4f-82bc-b784a9e15385 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:12.443824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 503/989] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:12 2022] GET /identity/v3/role_assignments?user.id=deed55901c264b8da58e57c21840c491&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=9895fbb6b76e4545802b1565612c8bf7 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:13.228559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd843f8-b904-4f00-a697-fe1331bc17ee None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:13.229151 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd843f8-b904-4f00-a697-fe1331bc17ee None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:13.229151 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd843f8-b904-4f00-a697-fe1331bc17ee None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:13.230557 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 487/990] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:13.236020 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfebb25-2507-4847-b0ad-19dc7a4464c6 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:13.236380 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfebb25-2507-4847-b0ad-19dc7a4464c6 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:13.236735 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfebb25-2507-4847-b0ad-19dc7a4464c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:13.254914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-8bfebb25-2507-4847-b0ad-19dc7a4464c6 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:13.256120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8bfebb25-2507-4847-b0ad-19dc7a4464c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:13.288868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:13.331020 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 504/991] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:13 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:13.350169 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd843f8-b904-4f00-a697-fe1331bc17ee None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:13.366016 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:13.456054 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd843f8-b904-4f00-a697-fe1331bc17ee None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:13.491232 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e63b5-33e3-41a4-b9e0-11e722677562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:13.492066 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e63b5-33e3-41a4-b9e0-11e722677562 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:13.492352 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e63b5-33e3-41a4-b9e0-11e722677562 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:13.492629 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922e63b5-33e3-41a4-b9e0-11e722677562 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:13.493287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e63b5-33e3-41a4-b9e0-11e722677562 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:13.494644 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922e63b5-33e3-41a4-b9e0-11e722677562 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:13.507462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-922e63b5-33e3-41a4-b9e0-11e722677562 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:17:13.507462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:13.507462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:17:13.507462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:17:13.507462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:17:13.507462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:17:13.507462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:17:13.507462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:13.507462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:17:13.507462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:13.507462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:13.507462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:13.507462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:13.507462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:13.507462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:13.507462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:13.507462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:13.508611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:13.508611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:13.508611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:13.508611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:13.508611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:13.508611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:13.508611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:17:13.508611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:17:13.508611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:17:13.508611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:17:13.508611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:13.508611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:13.508611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:13.508611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:13.508611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:13.508611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:13.509466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:13.509466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:13.509466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:13.509466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:13.509466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:13.509466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:13.509466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:13.509466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:13.509466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:13.509466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:13.509466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:17:13.509466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:13.509466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:17:13.509466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:13.511130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 488/992] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Jul 15 19:17:13 2022] GET /identity/v3/services/object-store => generated 93 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:13.515095 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfebb25-2507-4847-b0ad-19dc7a4464c6 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:13.618440 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfebb25-2507-4847-b0ad-19dc7a4464c6 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:13.654067 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d826bdb-e75d-4545-9181-97047110e9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:13.654724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d826bdb-e75d-4545-9181-97047110e9bc None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:13.655029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d826bdb-e75d-4545-9181-97047110e9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:13.655304 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d826bdb-e75d-4545-9181-97047110e9bc None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:13.656376 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d826bdb-e75d-4545-9181-97047110e9bc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:13.656376 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d826bdb-e75d-4545-9181-97047110e9bc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:13.657662 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d826bdb-e75d-4545-9181-97047110e9bc None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:13.675724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 505/993] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Jul 15 19:17:13 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:13.677177 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e63b5-33e3-41a4-b9e0-11e722677562 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:13.763904 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:13.787585 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922e63b5-33e3-41a4-b9e0-11e722677562 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:13.822000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e95ac-01d0-4744-bd47-eead4cc5ea4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:13.822664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e95ac-01d0-4744-bd47-eead4cc5ea4b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:13.822981 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e95ac-01d0-4744-bd47-eead4cc5ea4b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:13.823359 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e95ac-01d0-4744-bd47-eead4cc5ea4b None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:13.824711 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e95ac-01d0-4744-bd47-eead4cc5ea4b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:13.825167 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e95ac-01d0-4744-bd47-eead4cc5ea4b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:13.826549 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e95ac-01d0-4744-bd47-eead4cc5ea4b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:13.837116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 489/994] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Jul 15 19:17:13 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:13.838739 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d826bdb-e75d-4545-9181-97047110e9bc None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:13.873739 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:13.953813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d826bdb-e75d-4545-9181-97047110e9bc None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:13.989228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede1416f-02de-4ddb-899d-825078fa439d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:13.989888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1416f-02de-4ddb-899d-825078fa439d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:13.990169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1416f-02de-4ddb-899d-825078fa439d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:13.990443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede1416f-02de-4ddb-899d-825078fa439d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:13.991270 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1416f-02de-4ddb-899d-825078fa439d None admin] RBAC: Adding query filter params (interface=admin, service_id=9c8ec2de081c4737b4af3ab494d43cd7, region_id=RegionOne) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:13.991586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1416f-02de-4ddb-899d-825078fa439d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:13.992951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede1416f-02de-4ddb-899d-825078fa439d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:13.999387 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 506/995] 10.222.0.40 () {56 vars in 1249 bytes} [Fri Jul 15 19:17:13 2022] GET /identity/v3/endpoints?service_id=9c8ec2de081c4737b4af3ab494d43cd7&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:14.004870 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e95ac-01d0-4744-bd47-eead4cc5ea4b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:14.081474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b5f54-21fc-436d-ad50-0c1ad72ccea4 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.081766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b5f54-21fc-436d-ad50-0c1ad72ccea4 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.082052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b5f54-21fc-436d-ad50-0c1ad72ccea4 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.083677 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 507/996] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:14.088494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e25ad0-a7d4-4538-9617-1bd5cc079810 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.088788 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e25ad0-a7d4-4538-9617-1bd5cc079810 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.089062 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e25ad0-a7d4-4538-9617-1bd5cc079810 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.107259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-22e25ad0-a7d4-4538-9617-1bd5cc079810 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:14.108461 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-22e25ad0-a7d4-4538-9617-1bd5cc079810 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:14.127127 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e95ac-01d0-4744-bd47-eead4cc5ea4b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:14.165086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8b54c-e5b3-4255-b87f-981010e092e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:14.165870 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8b54c-e5b3-4255-b87f-981010e092e7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.166152 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8b54c-e5b3-4255-b87f-981010e092e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.166429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e8b54c-e5b3-4255-b87f-981010e092e7 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.167159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8b54c-e5b3-4255-b87f-981010e092e7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:14.169256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e8b54c-e5b3-4255-b87f-981010e092e7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:14.186783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 490/997] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Jul 15 19:17:14 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:17:14.198642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 508/998] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:17:14.222030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8b54c-e5b3-4255-b87f-981010e092e7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:14.227130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:14.334843 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e8b54c-e5b3-4255-b87f-981010e092e7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:14.372013 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee3cd5e7-0a27-456b-b454-68c45f2d03c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:14.373058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cd5e7-0a27-456b-b454-68c45f2d03c8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.373493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cd5e7-0a27-456b-b454-68c45f2d03c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.374021 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee3cd5e7-0a27-456b-b454-68c45f2d03c8 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.374866 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cd5e7-0a27-456b-b454-68c45f2d03c8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:14.376378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee3cd5e7-0a27-456b-b454-68c45f2d03c8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:14.389941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-ee3cd5e7-0a27-456b-b454-68c45f2d03c8 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:17:14.389941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:14.389941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:17:14.389941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:17:14.389941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:17:14.389941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:17:14.389941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:17:14.389941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:14.389941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:17:14.389941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:14.389941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:14.389941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:14.389941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:14.389941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:14.389941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:14.389941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:14.389941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:14.391250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:14.391250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:14.391250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:14.391250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:14.391250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:14.391250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:14.391250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:17:14.391250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:17:14.391250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:17:14.391250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:17:14.391250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:14.391250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:14.391250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:14.391250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:14.391250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:14.391250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:14.392117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:14.392117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:14.392117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:14.392117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:14.392117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:14.392117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:14.392117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:14.392117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:14.392117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:14.392117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:14.392117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:17:14.392117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:14.392117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 15 19:17:14.392117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:14.392117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 491/999] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:14 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:14.397775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e25ad0-a7d4-4538-9617-1bd5cc079810 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:14.426381 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:14.502115 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e25ad0-a7d4-4538-9617-1bd5cc079810 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:14.537622 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a9903-a00b-4987-b6d4-493b9cd11ecd None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.537967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a9903-a00b-4987-b6d4-493b9cd11ecd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.538199 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9a9903-a00b-4987-b6d4-493b9cd11ecd None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.538827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced706b-3db0-486b-b6c6-d1e4f8a4dfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:14.539501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced706b-3db0-486b-b6c6-d1e4f8a4dfe3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.539836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 492/1000] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:14.539939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced706b-3db0-486b-b6c6-d1e4f8a4dfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.540086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ced706b-3db0-486b-b6c6-d1e4f8a4dfe3 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.540818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced706b-3db0-486b-b6c6-d1e4f8a4dfe3 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:14.541128 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced706b-3db0-486b-b6c6-d1e4f8a4dfe3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:14.542538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ced706b-3db0-486b-b6c6-d1e4f8a4dfe3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:14.545389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97992d51-a4f2-4939-871f-c1a80cfaba9b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.545684 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97992d51-a4f2-4939-871f-c1a80cfaba9b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.545963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97992d51-a4f2-4939-871f-c1a80cfaba9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.548287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 509/1001] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Jul 15 19:17:14 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:14.553863 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced706b-3db0-486b-b6c6-d1e4f8a4dfe3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:14.564170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-97992d51-a4f2-4939-871f-c1a80cfaba9b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:14.565711 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-97992d51-a4f2-4939-871f-c1a80cfaba9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:14.634591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:14.641358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 493/1002] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:14 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:14.653716 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:14.663369 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97992d51-a4f2-4939-871f-c1a80cfaba9b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:14.668599 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ced706b-3db0-486b-b6c6-d1e4f8a4dfe3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:14.704927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a11c0-293a-46ec-885c-11cc8439b50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:14.705687 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a11c0-293a-46ec-885c-11cc8439b50d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.705973 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a11c0-293a-46ec-885c-11cc8439b50d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.706251 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4a11c0-293a-46ec-885c-11cc8439b50d None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.706987 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a11c0-293a-46ec-885c-11cc8439b50d None admin] RBAC: Adding query filter params (type=compute) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:14.707295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a11c0-293a-46ec-885c-11cc8439b50d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:14.708785 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4a11c0-293a-46ec-885c-11cc8439b50d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:14.715478 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 510/1003] 10.222.0.40 () {56 vars in 1112 bytes} [Fri Jul 15 19:17:14 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:14.720890 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a11c0-293a-46ec-885c-11cc8439b50d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:14.771875 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97992d51-a4f2-4939-871f-c1a80cfaba9b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:14.809884 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de14ac5-8b69-4b75-95a6-ae18d61117db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:14.810673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de14ac5-8b69-4b75-95a6-ae18d61117db None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.810982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de14ac5-8b69-4b75-95a6-ae18d61117db None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.811262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de14ac5-8b69-4b75-95a6-ae18d61117db None admin] PATH_INFO: `/v3/services/image` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.811916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de14ac5-8b69-4b75-95a6-ae18d61117db None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:14.813281 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de14ac5-8b69-4b75-95a6-ae18d61117db None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:14.825605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-2de14ac5-8b69-4b75-95a6-ae18d61117db None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:17:14.825605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:14.825605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:17:14.825605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:17:14.825605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:17:14.825605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:17:14.825605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:17:14.825605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:14.825605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:17:14.825605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:14.825605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:14.825605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:14.825605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:14.825605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:14.825605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:14.825605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:14.825605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:14.826917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:14.826917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:14.826917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:14.826917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:14.826917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:14.826917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:14.826917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:17:14.826917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:17:14.826917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:17:14.826917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:17:14.826917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:14.826917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:14.826917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:14.826917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:14.826917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:14.826917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:14.827789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:14.827789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:14.827789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:14.827789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:14.827789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:14.827789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:14.827789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:14.827789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:14.827789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:14.827789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:14.827789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:17:14.827789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:14.827789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:17:14.827789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:14.827789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 494/1004] 10.222.0.40 () {56 vars in 1105 bytes} [Fri Jul 15 19:17:14 2022] GET /identity/v3/services/image => generated 86 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:14.832677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de14ac5-8b69-4b75-95a6-ae18d61117db None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:14.835210 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4a11c0-293a-46ec-885c-11cc8439b50d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:14.872370 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c87a001-46cc-4a53-93e7-2ffe4ac6c452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:14.873047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87a001-46cc-4a53-93e7-2ffe4ac6c452 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.873335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87a001-46cc-4a53-93e7-2ffe4ac6c452 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.873614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c87a001-46cc-4a53-93e7-2ffe4ac6c452 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.874359 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87a001-46cc-4a53-93e7-2ffe4ac6c452 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:14.875755 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c87a001-46cc-4a53-93e7-2ffe4ac6c452 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:14.905844 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:14.936757 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de14ac5-8b69-4b75-95a6-ae18d61117db None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:14.970500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd857ec6-63cc-4e36-9ff5-9e3a6bdf20a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:14.971218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857ec6-63cc-4e36-9ff5-9e3a6bdf20a0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:14.971498 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857ec6-63cc-4e36-9ff5-9e3a6bdf20a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:14.971813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd857ec6-63cc-4e36-9ff5-9e3a6bdf20a0 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:14.972483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd857ec6-63cc-4e36-9ff5-9e3a6bdf20a0 None admin] RBAC: Adding query filter params (name=image) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:14.972792 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd857ec6-63cc-4e36-9ff5-9e3a6bdf20a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:14.974146 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd857ec6-63cc-4e36-9ff5-9e3a6bdf20a0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:14.978851 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 495/1005] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:14.984757 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd857ec6-63cc-4e36-9ff5-9e3a6bdf20a0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:15.018777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 511/1006] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Jul 15 19:17:14 2022] POST /identity/v3/endpoints => generated 334 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:17:15.110084 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd857ec6-63cc-4e36-9ff5-9e3a6bdf20a0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:15.140785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:15.157751 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c6efd9-bbec-4ef2-976c-78506151ae74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:15.158343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6efd9-bbec-4ef2-976c-78506151ae74 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:15.158620 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6efd9-bbec-4ef2-976c-78506151ae74 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:15.158920 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c6efd9-bbec-4ef2-976c-78506151ae74 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:15.159627 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6efd9-bbec-4ef2-976c-78506151ae74 None admin] RBAC: Adding query filter params (type=image) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:15.159927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6efd9-bbec-4ef2-976c-78506151ae74 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:15.161295 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c6efd9-bbec-4ef2-976c-78506151ae74 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:15.167098 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 496/1007] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:14 2022] GET /identity/v3/services?type=image => generated 122 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:16.250567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f090fea-6989-4f7d-bc5d-c1dc4c686d74 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:16.251213 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f090fea-6989-4f7d-bc5d-c1dc4c686d74 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:16.251213 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f090fea-6989-4f7d-bc5d-c1dc4c686d74 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:16.252529 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 512/1008] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:16.258033 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5e297-3f8b-4936-91f2-db4b1933a029 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:16.258453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5e297-3f8b-4936-91f2-db4b1933a029 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:16.258641 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e5e297-3f8b-4936-91f2-db4b1933a029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:16.276411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e8e5e297-3f8b-4936-91f2-db4b1933a029 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:16.278478 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e8e5e297-3f8b-4936-91f2-db4b1933a029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:16.353302 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 497/1009] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:16 2022] POST /identity/v3/auth/tokens => generated 1716 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:17:16.375868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f090fea-6989-4f7d-bc5d-c1dc4c686d74 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:16.388992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:16.479585 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f090fea-6989-4f7d-bc5d-c1dc4c686d74 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:16.514742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34102ae-a67f-4f8c-8c9b-c9c225376c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:16.515581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34102ae-a67f-4f8c-8c9b-c9c225376c69 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:16.515864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34102ae-a67f-4f8c-8c9b-c9c225376c69 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:16.516138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34102ae-a67f-4f8c-8c9b-c9c225376c69 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:16.516791 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34102ae-a67f-4f8c-8c9b-c9c225376c69 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:16.518149 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34102ae-a67f-4f8c-8c9b-c9c225376c69 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:16.530928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-d34102ae-a67f-4f8c-8c9b-c9c225376c69 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:17:16.530928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:16.530928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:17:16.530928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:17:16.530928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:17:16.530928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:17:16.530928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:17:16.530928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:16.530928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:17:16.530928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:16.530928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:16.530928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:16.530928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:16.530928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:16.530928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:16.530928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:16.530928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:16.531943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:16.531943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:16.531943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:16.531943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:16.531943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:16.531943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:16.531943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:17:16.531943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:17:16.531943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:17:16.531943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:17:16.531943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:16.531943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:16.531943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:16.531943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:16.531943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:16.531943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:16.532787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:16.532787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:16.532787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:16.532787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:16.532787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:16.532787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:16.532787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:16.532787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:16.532787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:16.532787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:16.532787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:17:16.532787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:16.532787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 15 19:17:16.532787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:16.535073 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 513/1010] 10.222.0.40 () {56 vars in 1126 bytes} [Fri Jul 15 19:17:16 2022] GET /identity/v3/services/object-store => generated 93 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:16.538137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5e297-3f8b-4936-91f2-db4b1933a029 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:16.640041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e5e297-3f8b-4936-91f2-db4b1933a029 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:16.665316 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:16.686331 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370af6ee-d0fc-4a63-946a-af709cf4eda1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:16.687023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370af6ee-d0fc-4a63-946a-af709cf4eda1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:16.687297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370af6ee-d0fc-4a63-946a-af709cf4eda1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:16.687564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370af6ee-d0fc-4a63-946a-af709cf4eda1 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:16.688306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370af6ee-d0fc-4a63-946a-af709cf4eda1 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:16.688575 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370af6ee-d0fc-4a63-946a-af709cf4eda1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:16.689945 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370af6ee-d0fc-4a63-946a-af709cf4eda1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:16.695049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 498/1011] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Jul 15 19:17:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:16.702808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34102ae-a67f-4f8c-8c9b-c9c225376c69 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:16.784348 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:16.810973 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34102ae-a67f-4f8c-8c9b-c9c225376c69 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:16.846108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-319e81a6-a0e3-4137-954d-aaa3d81cea36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:16.846796 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e81a6-a0e3-4137-954d-aaa3d81cea36 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:16.847067 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e81a6-a0e3-4137-954d-aaa3d81cea36 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:16.847338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-319e81a6-a0e3-4137-954d-aaa3d81cea36 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:16.848083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e81a6-a0e3-4137-954d-aaa3d81cea36 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:16.848345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e81a6-a0e3-4137-954d-aaa3d81cea36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:16.849702 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-319e81a6-a0e3-4137-954d-aaa3d81cea36 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:16.854942 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 514/1012] 10.222.0.40 () {56 vars in 1122 bytes} [Fri Jul 15 19:17:16 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:16.861581 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370af6ee-d0fc-4a63-946a-af709cf4eda1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:16.966738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370af6ee-d0fc-4a63-946a-af709cf4eda1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:17.002392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504c6148-2001-4d75-996f-b6e661d30e05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:17.003088 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c6148-2001-4d75-996f-b6e661d30e05 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.003394 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c6148-2001-4d75-996f-b6e661d30e05 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.003636 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504c6148-2001-4d75-996f-b6e661d30e05 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.004384 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c6148-2001-4d75-996f-b6e661d30e05 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:17.005722 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504c6148-2001-4d75-996f-b6e661d30e05 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:17.114839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 499/1013] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Jul 15 19:17:16 2022] POST /identity/v3/endpoints => generated 325 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:17:17.164805 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc6b0-cc34-480e-81d6-59ec55dcc990 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.165089 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc6b0-cc34-480e-81d6-59ec55dcc990 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.165369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ecc6b0-cc34-480e-81d6-59ec55dcc990 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.167076 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 515/1014] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:17.173411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39f533-9e22-4634-aa23-2036d1126232 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.173706 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39f533-9e22-4634-aa23-2036d1126232 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.173980 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39f533-9e22-4634-aa23-2036d1126232 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.193342 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0f39f533-9e22-4634-aa23-2036d1126232 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:17.194901 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0f39f533-9e22-4634-aa23-2036d1126232 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:17.234573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:17.235994 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d71a28-9395-47a3-9197-b7638d385c1b None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.236289 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d71a28-9395-47a3-9197-b7638d385c1b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.236590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d71a28-9395-47a3-9197-b7638d385c1b None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.238231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 516/1015] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:17.243913 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490b2f6-38f7-4b7e-a8ac-0e3aba5cb24a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.244199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490b2f6-38f7-4b7e-a8ac-0e3aba5cb24a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.246231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490b2f6-38f7-4b7e-a8ac-0e3aba5cb24a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.262477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-7490b2f6-38f7-4b7e-a8ac-0e3aba5cb24a None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:17.263724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-7490b2f6-38f7-4b7e-a8ac-0e3aba5cb24a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:17.286773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 500/1016] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:17 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:17.305388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39f533-9e22-4634-aa23-2036d1126232 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:17.343332 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 517/1017] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:17 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:17:17.366310 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490b2f6-38f7-4b7e-a8ac-0e3aba5cb24a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:17.417221 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39f533-9e22-4634-aa23-2036d1126232 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:17.436983 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:17.455966 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ca499-acfa-485c-9b33-6d1315b15af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:17.456778 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ca499-acfa-485c-9b33-6d1315b15af4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.457061 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ca499-acfa-485c-9b33-6d1315b15af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.457346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5ca499-acfa-485c-9b33-6d1315b15af4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.473063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5ca499-acfa-485c-9b33-6d1315b15af4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:17.473916 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490b2f6-38f7-4b7e-a8ac-0e3aba5cb24a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:17.481979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-3a5ca499-acfa-485c-9b33-6d1315b15af4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:17:17.481979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:17.481979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:17.481979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:17.481979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:17.481979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:17.481979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:17.481979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:17.481979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:17.481979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:17.481979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:17.481979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:17.481979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:17.481979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:17.481979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:17.481979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:17.483029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:17.483029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:17.483029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:17.483029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:17.483029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:17.483029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:17.483029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:17.483029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:17.483029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:17.483029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:17.483029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:17.483029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:17.483029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:17.483029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:17.483029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:17.483029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:17.489162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:17.489162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:17.489162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:17.489162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:17.489162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:17.489162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:17.489162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:17.489162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:17.489162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:17.489162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:17.489162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:17:17.489162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:17.489162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 501/1018] 10.222.0.40 () {56 vars in 1120 bytes} [Fri Jul 15 19:17:17 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:17.489909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ca499-acfa-485c-9b33-6d1315b15af4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:17.514010 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fde555-4b5c-4f6d-a312-57cb7b2d201d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:17.514972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fde555-4b5c-4f6d-a312-57cb7b2d201d None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.515256 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fde555-4b5c-4f6d-a312-57cb7b2d201d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.515530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fde555-4b5c-4f6d-a312-57cb7b2d201d None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.516251 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fde555-4b5c-4f6d-a312-57cb7b2d201d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:17.520009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fde555-4b5c-4f6d-a312-57cb7b2d201d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:17.523404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:17.595801 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5ca499-acfa-485c-9b33-6d1315b15af4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:17.630425 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113175b-d4a5-4fc0-860d-cfb68c702ddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:17.631113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113175b-d4a5-4fc0-860d-cfb68c702ddf None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.631394 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113175b-d4a5-4fc0-860d-cfb68c702ddf None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.631665 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a113175b-d4a5-4fc0-860d-cfb68c702ddf None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.632404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113175b-d4a5-4fc0-860d-cfb68c702ddf None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:17.632709 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113175b-d4a5-4fc0-860d-cfb68c702ddf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:17.634075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a113175b-d4a5-4fc0-860d-cfb68c702ddf None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:17.642393 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 502/1019] 10.222.0.40 () {56 vars in 1115 bytes} [Fri Jul 15 19:17:17 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:17.647984 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113175b-d4a5-4fc0-860d-cfb68c702ddf None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:17.714951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 518/1020] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Jul 15 19:17:17 2022] POST /identity/v3/services => generated 242 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:17:17.741448 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:17.756332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a113175b-d4a5-4fc0-860d-cfb68c702ddf None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:17.804946 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b20e73-f25f-449c-81f2-2268c7d6c38a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:17.805753 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b20e73-f25f-449c-81f2-2268c7d6c38a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.806063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b20e73-f25f-449c-81f2-2268c7d6c38a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.806387 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b20e73-f25f-449c-81f2-2268c7d6c38a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.817895 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b20e73-f25f-449c-81f2-2268c7d6c38a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:17.819498 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b20e73-f25f-449c-81f2-2268c7d6c38a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:17.838481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-28b20e73-f25f-449c-81f2-2268c7d6c38a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:17.838481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:17.838481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:17.838481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:17.838481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:17.838481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:17.838481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:17.838481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:17.838481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:17.838481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:17.838481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:17.838481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:17.838481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:17.838481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:17.838481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:17.840272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:17.840272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:17.840272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:17.840272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:17.840272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:17.840272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:17.840272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:17.840272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:17.840272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:17.840272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:17.840272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:17.840272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:17.840272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:17.840272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:17.840272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:17.840272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:17.840272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:17.841213 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:17.841213 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:17.841213 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:17.841213 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:17.843116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 503/1021] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:17.846355 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fde555-4b5c-4f6d-a312-57cb7b2d201d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:17.956312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fde555-4b5c-4f6d-a312-57cb7b2d201d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:17.983165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:17.990822 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8234f-b69c-4f0b-a063-dc74d3057b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:17.991543 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8234f-b69c-4f0b-a063-dc74d3057b8c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:17.991778 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8234f-b69c-4f0b-a063-dc74d3057b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:17.992051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b8234f-b69c-4f0b-a063-dc74d3057b8c None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:17.992779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8234f-b69c-4f0b-a063-dc74d3057b8c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:17.993085 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8234f-b69c-4f0b-a063-dc74d3057b8c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:17.994469 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b8234f-b69c-4f0b-a063-dc74d3057b8c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:18.007475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 519/1022] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:18.019219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b20e73-f25f-449c-81f2-2268c7d6c38a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:18.133733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b20e73-f25f-449c-81f2-2268c7d6c38a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:18.175045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d32719-7eae-4537-8e2f-9bf2e51d2d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:18.175858 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d32719-7eae-4537-8e2f-9bf2e51d2d07 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:18.176269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d32719-7eae-4537-8e2f-9bf2e51d2d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:18.176550 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d32719-7eae-4537-8e2f-9bf2e51d2d07 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:18.179798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:18.187109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d32719-7eae-4537-8e2f-9bf2e51d2d07 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:18.188595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d32719-7eae-4537-8e2f-9bf2e51d2d07 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:18.204374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-68d32719-7eae-4537-8e2f-9bf2e51d2d07 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:17:18.204374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:18.204374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:18.204374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:18.204374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:18.204374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:18.204374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:18.204374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:18.204374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:18.204374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:18.204374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:18.204374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:18.204374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:18.204374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:18.204374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:18.204374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:18.205476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:18.206563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:18.206563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:18.206563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:18.206563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:18.206563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:18.206563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:18.206563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:18.206563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:18.206563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:17:18.206563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:18.206563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 504/1023] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Jul 15 19:17:18 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:18.212971 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8234f-b69c-4f0b-a063-dc74d3057b8c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:18.321023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b8234f-b69c-4f0b-a063-dc74d3057b8c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:18.357797 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dc11f-642a-4830-a9ed-8eba4b34934f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:18.358459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dc11f-642a-4830-a9ed-8eba4b34934f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:18.358740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dc11f-642a-4830-a9ed-8eba4b34934f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:18.359052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45dc11f-642a-4830-a9ed-8eba4b34934f None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:18.359882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dc11f-642a-4830-a9ed-8eba4b34934f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:18.360188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dc11f-642a-4830-a9ed-8eba4b34934f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:18.361604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45dc11f-642a-4830-a9ed-8eba4b34934f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:18.383776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 520/1024] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Jul 15 19:17:18 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:18.385252 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d32719-7eae-4537-8e2f-9bf2e51d2d07 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:18.493224 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d32719-7eae-4537-8e2f-9bf2e51d2d07 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:18.528761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1488684-f086-4422-a338-dea3b36d5538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:18.529404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1488684-f086-4422-a338-dea3b36d5538 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:18.529687 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1488684-f086-4422-a338-dea3b36d5538 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:18.529963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1488684-f086-4422-a338-dea3b36d5538 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:18.592234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:18.599550 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1488684-f086-4422-a338-dea3b36d5538 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:18.619552 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1488684-f086-4422-a338-dea3b36d5538 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:18.709722 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 505/1025] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:18 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:17:18.715765 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dc11f-642a-4830-a9ed-8eba4b34934f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:18.766112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:18.823356 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45dc11f-642a-4830-a9ed-8eba4b34934f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:18.861087 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140fa5e-fb73-4669-b669-17b98ef7b568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:18.861821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140fa5e-fb73-4669-b669-17b98ef7b568 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:18.862106 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140fa5e-fb73-4669-b669-17b98ef7b568 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:18.862381 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4140fa5e-fb73-4669-b669-17b98ef7b568 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:18.874861 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140fa5e-fb73-4669-b669-17b98ef7b568 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:18.876330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4140fa5e-fb73-4669-b669-17b98ef7b568 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:18.895559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-4140fa5e-fb73-4669-b669-17b98ef7b568 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:18.895559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:18.895559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:18.895559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:18.895559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:18.895559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:18.895559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:18.895559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:18.895559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:18.895559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:18.895559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:18.895559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:18.895559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:18.895559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:18.895559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:18.896531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:18.896531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:18.896531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:18.896531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:18.896531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:18.896531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:18.896531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:18.896531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:18.896531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:18.896531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:18.896531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:18.896531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:18.896531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:18.896531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:18.896531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:18.896531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:18.896531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:18.897459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:18.897459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:18.897459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:18.897459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:18.897459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 521/1026] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:18.903734 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1488684-f086-4422-a338-dea3b36d5538 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:19.007310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:19.014009 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1488684-f086-4422-a338-dea3b36d5538 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:19.048717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52a0b5-e676-46d7-b585-165b30fc14b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:19.049380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52a0b5-e676-46d7-b585-165b30fc14b9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.049664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52a0b5-e676-46d7-b585-165b30fc14b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.049943 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52a0b5-e676-46d7-b585-165b30fc14b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.050665 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52a0b5-e676-46d7-b585-165b30fc14b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:19.051003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52a0b5-e676-46d7-b585-165b30fc14b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:19.052438 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a52a0b5-e676-46d7-b585-165b30fc14b9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:19.067750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 506/1027] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:19.074712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140fa5e-fb73-4669-b669-17b98ef7b568 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:19.179587 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:19.184348 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4140fa5e-fb73-4669-b669-17b98ef7b568 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:19.203953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951fba2-c120-440a-a3b4-1a709e470e7c None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.204288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951fba2-c120-440a-a3b4-1a709e470e7c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.204521 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5951fba2-c120-440a-a3b4-1a709e470e7c None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.206258 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 507/1028] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:19.211385 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccade161-0e5a-4cf3-8fb9-aad17f343993 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.211754 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccade161-0e5a-4cf3-8fb9-aad17f343993 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.212084 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccade161-0e5a-4cf3-8fb9-aad17f343993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.220439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd434e96-b6da-47b7-88e0-426cdd22a150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:19.221656 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd434e96-b6da-47b7-88e0-426cdd22a150 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.222148 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd434e96-b6da-47b7-88e0-426cdd22a150 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.222632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd434e96-b6da-47b7-88e0-426cdd22a150 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.229967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd434e96-b6da-47b7-88e0-426cdd22a150 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:19.230726 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ccade161-0e5a-4cf3-8fb9-aad17f343993 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:19.231964 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ccade161-0e5a-4cf3-8fb9-aad17f343993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:19.232471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd434e96-b6da-47b7-88e0-426cdd22a150 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:19.247740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-cd434e96-b6da-47b7-88e0-426cdd22a150 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:19.247740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:19.247740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:19.247740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:19.247740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:19.247740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:19.247740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:19.247740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:19.247740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:19.247740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:19.247740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:19.247740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:19.247740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:19.247740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:19.247740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:19.248745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:19.248745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:19.248745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:19.248745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:19.248745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:19.248745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:19.248745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:19.248745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:19.248745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:19.248745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:19.248745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:19.248745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:19.248745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:19.248745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:19.248745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:19.248745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:19.248745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:19.249827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:19.249827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:19.249827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:19.249827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:19.249827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:19.249827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:19.249827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:19.249827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:19.251961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 522/1029] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:19.257369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd434e96-b6da-47b7-88e0-426cdd22a150 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:19.312188 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 508/1030] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:17:19.335894 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccade161-0e5a-4cf3-8fb9-aad17f343993 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:19.366737 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd434e96-b6da-47b7-88e0-426cdd22a150 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:19.405854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33034e1-a023-40f3-ae9c-0a464f636448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:19.406522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33034e1-a023-40f3-ae9c-0a464f636448 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.407094 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33034e1-a023-40f3-ae9c-0a464f636448 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.407392 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33034e1-a023-40f3-ae9c-0a464f636448 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.408229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33034e1-a023-40f3-ae9c-0a464f636448 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:19.408626 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33034e1-a023-40f3-ae9c-0a464f636448 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:19.410083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33034e1-a023-40f3-ae9c-0a464f636448 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:19.423053 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 523/1031] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:19.430421 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:19.431349 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33034e1-a023-40f3-ae9c-0a464f636448 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:19.448213 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccade161-0e5a-4cf3-8fb9-aad17f343993 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:19.452748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:19.487370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ba448-0676-496f-b075-d52b2553edcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:19.488163 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ba448-0676-496f-b075-d52b2553edcc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.488474 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ba448-0676-496f-b075-d52b2553edcc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.488719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522ba448-0676-496f-b075-d52b2553edcc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.489903 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ba448-0676-496f-b075-d52b2553edcc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:19.491425 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522ba448-0676-496f-b075-d52b2553edcc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:19.498670 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 509/1032] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:19.500159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ba448-0676-496f-b075-d52b2553edcc None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:19.545004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33034e1-a023-40f3-ae9c-0a464f636448 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:19.580324 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0983e8-0148-410b-8c36-2926364d5612 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:19.580977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0983e8-0148-410b-8c36-2926364d5612 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.581255 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0983e8-0148-410b-8c36-2926364d5612 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.581528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0983e8-0148-410b-8c36-2926364d5612 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.582417 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0983e8-0148-410b-8c36-2926364d5612 None admin] RBAC: Adding query filter params (role.id=9895fbb6b76e4545802b1565612c8bf7, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=850a32e590154968bfbbfc404450b70a) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:19.582735 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0983e8-0148-410b-8c36-2926364d5612 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:19.584239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0983e8-0148-410b-8c36-2926364d5612 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:19.590212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 524/1033] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:19 2022] GET /identity/v3/role_assignments?user.id=850a32e590154968bfbbfc404450b70a&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=9895fbb6b76e4545802b1565612c8bf7 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:19.616095 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522ba448-0676-496f-b075-d52b2553edcc None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:19.659986 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2507eac5-7f85-48b0-ab68-111b54ee7afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:19.660664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507eac5-7f85-48b0-ab68-111b54ee7afd None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.660951 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507eac5-7f85-48b0-ab68-111b54ee7afd None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.661229 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2507eac5-7f85-48b0-ab68-111b54ee7afd None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.661955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507eac5-7f85-48b0-ab68-111b54ee7afd None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:19.663459 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2507eac5-7f85-48b0-ab68-111b54ee7afd None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:19.778650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dabceb-3076-4f8f-af48-31ced21f283e None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.778882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dabceb-3076-4f8f-af48-31ced21f283e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.779153 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 510/1034] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Jul 15 19:17:19 2022] POST /identity/v3/projects => generated 311 bytes in 272 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:17:19.779258 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4dabceb-3076-4f8f-af48-31ced21f283e None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.781162 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 525/1035] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:19.786923 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0939e2-9b23-48a1-acab-9e03b302c3d7 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:19.787729 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0939e2-9b23-48a1-acab-9e03b302c3d7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:19.788248 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0939e2-9b23-48a1-acab-9e03b302c3d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:19.806709 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:19.808484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-cb0939e2-9b23-48a1-acab-9e03b302c3d7 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:19.810010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cb0939e2-9b23-48a1-acab-9e03b302c3d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:19.888825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 511/1036] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:19 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:17:19.916094 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dabceb-3076-4f8f-af48-31ced21f283e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:20.027609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:20.048262 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4dabceb-3076-4f8f-af48-31ced21f283e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:20.088181 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26ecc8-9392-4ab1-8000-37c66dba3a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:20.089097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26ecc8-9392-4ab1-8000-37c66dba3a9b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:20.090336 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26ecc8-9392-4ab1-8000-37c66dba3a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:20.090618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26ecc8-9392-4ab1-8000-37c66dba3a9b None admin] PATH_INFO: `/v3/services/image` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:20.091329 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26ecc8-9392-4ab1-8000-37c66dba3a9b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:20.092723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26ecc8-9392-4ab1-8000-37c66dba3a9b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:20.105315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-9d26ecc8-9392-4ab1-8000-37c66dba3a9b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:17:20.105315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:20.105315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:17:20.105315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:17:20.105315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:17:20.105315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:17:20.105315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:17:20.105315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:20.105315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:17:20.105315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:20.105315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:20.105315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:20.105315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:20.105315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:20.105315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:20.105315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:20.105315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:20.106712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:20.106712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:20.106712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:20.106712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:20.106712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:20.106712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:20.106712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:17:20.106712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:17:20.106712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:17:20.106712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:17:20.106712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:20.106712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:20.106712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:20.106712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:20.106712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:20.106712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:20.107609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:20.107609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:20.107609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:20.107609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:20.107609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:20.107609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:20.107609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:20.107609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:20.107609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:20.107609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:20.107609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:17:20.107609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:20.107609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:17:20.107609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:20.107609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 526/1037] 10.222.0.40 () {56 vars in 1105 bytes} [Fri Jul 15 19:17:19 2022] GET /identity/v3/services/image => generated 86 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:20.113247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0939e2-9b23-48a1-acab-9e03b302c3d7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:20.220257 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0939e2-9b23-48a1-acab-9e03b302c3d7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:20.255585 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9ebb5-f0b3-417b-977b-b8e861307640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:20.256247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9ebb5-f0b3-417b-977b-b8e861307640 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:20.256524 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9ebb5-f0b3-417b-977b-b8e861307640 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:20.256795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee9ebb5-f0b3-417b-977b-b8e861307640 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:20.257499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9ebb5-f0b3-417b-977b-b8e861307640 None admin] RBAC: Adding query filter params (name=image) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:20.257802 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9ebb5-f0b3-417b-977b-b8e861307640 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:20.259275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee9ebb5-f0b3-417b-977b-b8e861307640 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:20.261144 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:20.271142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 512/1038] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:20 2022] GET /identity/v3/services?name=image => generated 122 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:20.272559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26ecc8-9392-4ab1-8000-37c66dba3a9b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:20.382863 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26ecc8-9392-4ab1-8000-37c66dba3a9b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:20.417952 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fe9af-f5f1-454f-8fef-0ff22021a57f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:20.418614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fe9af-f5f1-454f-8fef-0ff22021a57f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:20.419005 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fe9af-f5f1-454f-8fef-0ff22021a57f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:20.419216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20fe9af-f5f1-454f-8fef-0ff22021a57f None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:20.419916 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fe9af-f5f1-454f-8fef-0ff22021a57f None admin] RBAC: Adding query filter params (type=image) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:20.420227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fe9af-f5f1-454f-8fef-0ff22021a57f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:20.421582 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20fe9af-f5f1-454f-8fef-0ff22021a57f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:20.431365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 527/1039] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:20 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:20.433682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9ebb5-f0b3-417b-977b-b8e861307640 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:20.538701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee9ebb5-f0b3-417b-977b-b8e861307640 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:20.572937 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c67278-59b2-403a-9eb9-ade582fcb15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:20.574130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c67278-59b2-403a-9eb9-ade582fcb15e None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:20.574415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c67278-59b2-403a-9eb9-ade582fcb15e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:20.574691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c67278-59b2-403a-9eb9-ade582fcb15e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:20.575615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c67278-59b2-403a-9eb9-ade582fcb15e None admin] RBAC: Adding query filter params (interface=public, service_id=5d61b5f7fbfa47adbed6a1c0bbb85785, region_id=RegionOne) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:20.575931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c67278-59b2-403a-9eb9-ade582fcb15e None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:20.577309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c67278-59b2-403a-9eb9-ade582fcb15e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:20.587336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 513/1040] 10.222.0.40 () {56 vars in 1251 bytes} [Fri Jul 15 19:17:20 2022] GET /identity/v3/endpoints?service_id=5d61b5f7fbfa47adbed6a1c0bbb85785&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:20.588458 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fe9af-f5f1-454f-8fef-0ff22021a57f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:20.602539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:20.694284 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20fe9af-f5f1-454f-8fef-0ff22021a57f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:20.730637 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afc81b-e7cb-496a-99b7-ef040fa462ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:20.731339 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afc81b-e7cb-496a-99b7-ef040fa462ad None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:20.731882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afc81b-e7cb-496a-99b7-ef040fa462ad None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:20.731882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afc81b-e7cb-496a-99b7-ef040fa462ad None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:20.732599 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afc81b-e7cb-496a-99b7-ef040fa462ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:20.734003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afc81b-e7cb-496a-99b7-ef040fa462ad None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:20.741709 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 528/1041] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Jul 15 19:17:20 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:17:21.664474 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bef7b2-5afb-4915-9cb4-ab3f339b44dc None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:21.665011 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bef7b2-5afb-4915-9cb4-ab3f339b44dc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:21.665011 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bef7b2-5afb-4915-9cb4-ab3f339b44dc None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:21.666548 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 514/1042] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:21.671977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5779b3-4120-4bad-8aa5-36021c3f983b None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:21.672418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5779b3-4120-4bad-8aa5-36021c3f983b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:21.672607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5779b3-4120-4bad-8aa5-36021c3f983b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:21.690275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-bb5779b3-4120-4bad-8aa5-36021c3f983b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:21.691488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-bb5779b3-4120-4bad-8aa5-36021c3f983b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:21.759606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 529/1043] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:21.782839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bef7b2-5afb-4915-9cb4-ab3f339b44dc None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:21.849157 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:21.891702 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bef7b2-5afb-4915-9cb4-ab3f339b44dc None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:21.895029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e8a3b-44f8-4154-9af6-5a5b927c904b None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:21.895311 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e8a3b-44f8-4154-9af6-5a5b927c904b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:21.895582 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943e8a3b-44f8-4154-9af6-5a5b927c904b None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:21.896931 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 530/1044] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:17:21.902044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c998010-8406-4ba6-ab7a-64d8262b2cfd None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:21.902538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c998010-8406-4ba6-ab7a-64d8262b2cfd None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:21.902924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c998010-8406-4ba6-ab7a-64d8262b2cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:21.909922 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:21.921747 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-0c998010-8406-4ba6-ab7a-64d8262b2cfd None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:21.923094 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0c998010-8406-4ba6-ab7a-64d8262b2cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:21.933677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba70f5-bb8f-4dff-b783-336b6aadf5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:21.934540 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba70f5-bb8f-4dff-b783-336b6aadf5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:21.934854 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba70f5-bb8f-4dff-b783-336b6aadf5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:21.935127 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ba70f5-bb8f-4dff-b783-336b6aadf5e4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:21.946108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ba70f5-bb8f-4dff-b783-336b6aadf5e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:21.954310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-23ba70f5-bb8f-4dff-b783-336b6aadf5e4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:17:21.954310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:21.954310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:21.954310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:21.954310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:21.954310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:21.954310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:21.954310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:21.954310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:21.954310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:21.954310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:21.954310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:21.954310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:21.954310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:21.954310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:21.954310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:21.955301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:21.955301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:21.955301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:21.955301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:21.955301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:21.955301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:21.955301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:21.955301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:21.955301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:21.955301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:21.955301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:21.955301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:21.955301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:21.955301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:21.955301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:21.955301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:21.956150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:21.956150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:21.956150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:21.956150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:21.956150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:21.956150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:21.956150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:21.956150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:21.956150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:21.956150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:21.956150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:17:21.956150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:21.956150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 515/1045] 10.222.0.40 () {56 vars in 1120 bytes} [Fri Jul 15 19:17:21 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:21.961439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba70f5-bb8f-4dff-b783-336b6aadf5e4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:21.998865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 531/1046] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:21 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:17:22.023379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c998010-8406-4ba6-ab7a-64d8262b2cfd None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:22.074798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ba70f5-bb8f-4dff-b783-336b6aadf5e4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:22.102640 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:22.116686 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0f06e-5088-4ea6-beac-b308e6b8fa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:22.117346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0f06e-5088-4ea6-beac-b308e6b8fa5f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.117633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0f06e-5088-4ea6-beac-b308e6b8fa5f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.117886 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d0f06e-5088-4ea6-beac-b308e6b8fa5f None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.118633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0f06e-5088-4ea6-beac-b308e6b8fa5f None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:22.118962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0f06e-5088-4ea6-beac-b308e6b8fa5f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:22.120939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d0f06e-5088-4ea6-beac-b308e6b8fa5f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:22.133662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 516/1047] 10.222.0.40 () {56 vars in 1115 bytes} [Fri Jul 15 19:17:21 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:22.140603 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0f06e-5088-4ea6-beac-b308e6b8fa5f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:22.145733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c998010-8406-4ba6-ab7a-64d8262b2cfd None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:22.192845 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c139db5-118f-43ee-b88f-259435c44b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:22.193556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c139db5-118f-43ee-b88f-259435c44b4d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.194216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c139db5-118f-43ee-b88f-259435c44b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.194500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c139db5-118f-43ee-b88f-259435c44b4d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.196081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c139db5-118f-43ee-b88f-259435c44b4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:22.197500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c139db5-118f-43ee-b88f-259435c44b4d None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:22.199593 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 532/1048] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:22.205086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c139db5-118f-43ee-b88f-259435c44b4d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:22.209259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:22.258702 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d0f06e-5088-4ea6-beac-b308e6b8fa5f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:22.303584 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9fcd4-cd44-4dd9-8473-db6511f52b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:22.304269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9fcd4-cd44-4dd9-8473-db6511f52b73 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.304552 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9fcd4-cd44-4dd9-8473-db6511f52b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.304836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9a9fcd4-cd44-4dd9-8473-db6511f52b73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.317657 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9fcd4-cd44-4dd9-8473-db6511f52b73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:22.319622 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9a9fcd4-cd44-4dd9-8473-db6511f52b73 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:22.335842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c139db5-118f-43ee-b88f-259435c44b4d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:22.340774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-c9a9fcd4-cd44-4dd9-8473-db6511f52b73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:22.340774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:22.340774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:22.340774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:22.340774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:22.340774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:22.340774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:22.340774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:22.340774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:22.340774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:22.340774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:22.340774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:22.340774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:22.340774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:22.340774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:22.341992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:22.341992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:22.341992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:22.341992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:22.341992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:22.341992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:22.341992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:22.341992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:22.341992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:22.341992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:22.341992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:22.341992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:22.341992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:22.341992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:22.341992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:22.341992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:22.341992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:22.343735 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:22.343735 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:22.343735 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:22.343735 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:22.346638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 517/1049] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:22.347529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9fcd4-cd44-4dd9-8473-db6511f52b73 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:22.376005 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb0b8b-1219-4956-8f4e-c01e0778445b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:22.376829 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb0b8b-1219-4956-8f4e-c01e0778445b None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.377111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb0b8b-1219-4956-8f4e-c01e0778445b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.377384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cb0b8b-1219-4956-8f4e-c01e0778445b None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.378090 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb0b8b-1219-4956-8f4e-c01e0778445b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:22.380219 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cb0b8b-1219-4956-8f4e-c01e0778445b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:22.392501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:22.452736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9a9fcd4-cd44-4dd9-8473-db6511f52b73 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:22.488236 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 533/1050] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:17:22 2022] POST /identity/v3/users => generated 285 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:17:22.490155 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f855b0-d088-4371-86fe-aaae7ecb9f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:22.490849 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f855b0-d088-4371-86fe-aaae7ecb9f90 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.491133 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f855b0-d088-4371-86fe-aaae7ecb9f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.491408 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f855b0-d088-4371-86fe-aaae7ecb9f90 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.492145 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f855b0-d088-4371-86fe-aaae7ecb9f90 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:22.492535 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f855b0-d088-4371-86fe-aaae7ecb9f90 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:22.493951 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f855b0-d088-4371-86fe-aaae7ecb9f90 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:22.513085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 518/1051] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:22.517415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb0b8b-1219-4956-8f4e-c01e0778445b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:22.591668 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:22.638553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cb0b8b-1219-4956-8f4e-c01e0778445b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:22.677530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216b4023-cb37-4c73-ae89-0c4b0fad3c32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:22.678161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b4023-cb37-4c73-ae89-0c4b0fad3c32 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.679285 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b4023-cb37-4c73-ae89-0c4b0fad3c32 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.679285 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216b4023-cb37-4c73-ae89-0c4b0fad3c32 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.687399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b4023-cb37-4c73-ae89-0c4b0fad3c32 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:22.688848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216b4023-cb37-4c73-ae89-0c4b0fad3c32 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:22.703676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-216b4023-cb37-4c73-ae89-0c4b0fad3c32 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:17:22.703676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:22.703676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:22.703676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:22.703676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:22.703676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:22.703676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:22.703676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:22.703676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:22.703676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:22.703676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:22.703676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:22.703676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:22.703676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:22.703676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:22.703676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:22.704651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:22.705623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:22.705623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:22.705623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:22.705623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:22.705623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:22.705623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:22.705623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:22.705623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:22.705623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:17:22.705623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:22.705623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 534/1052] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Jul 15 19:17:22 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:22.710594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f855b0-d088-4371-86fe-aaae7ecb9f90 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:22.776176 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75156581-7121-43be-9233-99d59d38a3dd None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.776910 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75156581-7121-43be-9233-99d59d38a3dd None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.777193 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75156581-7121-43be-9233-99d59d38a3dd None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.779136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 535/1053] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:17:22.785755 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514180f-0dfd-4cc4-a6b9-7c6c2fb81cb7 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.786054 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514180f-0dfd-4cc4-a6b9-7c6c2fb81cb7 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.786322 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9514180f-0dfd-4cc4-a6b9-7c6c2fb81cb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.805753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-9514180f-0dfd-4cc4-a6b9-7c6c2fb81cb7 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:22.806982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9514180f-0dfd-4cc4-a6b9-7c6c2fb81cb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:22.817932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:22.824200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f855b0-d088-4371-86fe-aaae7ecb9f90 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:22.859451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd09f90-c918-4b1c-9712-79d57581d62d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:22.860116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd09f90-c918-4b1c-9712-79d57581d62d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:22.860412 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd09f90-c918-4b1c-9712-79d57581d62d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:22.860719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd09f90-c918-4b1c-9712-79d57581d62d None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:22.861565 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd09f90-c918-4b1c-9712-79d57581d62d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:22.861877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd09f90-c918-4b1c-9712-79d57581d62d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:22.863353 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd09f90-c918-4b1c-9712-79d57581d62d None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:22.882541 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 519/1054] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Jul 15 19:17:22 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:22.887083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 536/1055] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:22 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:17:22.888585 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd09f90-c918-4b1c-9712-79d57581d62d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:22.909678 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514180f-0dfd-4cc4-a6b9-7c6c2fb81cb7 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:22.967533 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:23.008082 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd09f90-c918-4b1c-9712-79d57581d62d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:23.028071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9514180f-0dfd-4cc4-a6b9-7c6c2fb81cb7 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:23.046300 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e320a-ef15-4d1e-9fb6-1a35004057e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:23.047227 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e320a-ef15-4d1e-9fb6-1a35004057e0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:23.047563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e320a-ef15-4d1e-9fb6-1a35004057e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:23.047900 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e320a-ef15-4d1e-9fb6-1a35004057e0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:23.059805 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e320a-ef15-4d1e-9fb6-1a35004057e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:23.061257 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e320a-ef15-4d1e-9fb6-1a35004057e0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:23.077847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee6c4e-0bd6-4293-afba-49fed6446e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:23.078650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee6c4e-0bd6-4293-afba-49fed6446e99 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:23.079020 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee6c4e-0bd6-4293-afba-49fed6446e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:23.079287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee6c4e-0bd6-4293-afba-49fed6446e99 None admin] PATH_INFO: `/v3/services/image` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:23.079948 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee6c4e-0bd6-4293-afba-49fed6446e99 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:23.081362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee6c4e-0bd6-4293-afba-49fed6446e99 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:23.082977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-036e320a-ef15-4d1e-9fb6-1a35004057e0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:23.082977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:23.082977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:23.082977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:23.082977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:23.082977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:23.082977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:23.082977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:23.082977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:23.082977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:23.082977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:23.082977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:23.082977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:23.082977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:23.082977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:23.083860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:23.083860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:23.083860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:23.083860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:23.083860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:23.083860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:23.083860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:23.083860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:23.083860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:23.083860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:23.083860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:23.083860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:23.083860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:23.083860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:23.083860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:23.083860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:23.083860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:23.084787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:23.084787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:23.084787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:23.084787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:23.084787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 520/1056] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:23.089830 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e320a-ef15-4d1e-9fb6-1a35004057e0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:23.097763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-58ee6c4e-0bd6-4293-afba-49fed6446e99 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:17:23.097763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:23.097763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:17:23.097763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:17:23.097763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:17:23.097763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:17:23.097763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:17:23.097763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:23.097763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:17:23.097763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:23.097763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:17:23.097763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:23.097763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:23.097763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:23.097763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:23.097763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:23.097763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:23.098899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:23.098899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:23.098899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:23.098899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:23.098899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:23.098899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:23.098899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:17:23.098899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:17:23.098899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:17:23.098899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:17:23.098899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:23.098899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:23.098899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:23.098899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:23.098899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:23.098899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:23.099857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:23.099857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:23.099857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:23.099857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:23.099857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:23.099857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:23.099857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:23.099857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:23.099857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:23.099857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:23.099857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:17:23.099857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:17:23.099857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 15 19:17:23.099857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:23.099857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 537/1057] 10.222.0.40 () {56 vars in 1105 bytes} [Fri Jul 15 19:17:22 2022] GET /identity/v3/services/image => generated 86 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:23.104015 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:23.105569 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee6c4e-0bd6-4293-afba-49fed6446e99 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:23.210829 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e320a-ef15-4d1e-9fb6-1a35004057e0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:23.237341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee6c4e-0bd6-4293-afba-49fed6446e99 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:23.247955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2071ce7-f2f1-401c-b0fc-b7e9fd4d3f96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:23.248630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2071ce7-f2f1-401c-b0fc-b7e9fd4d3f96 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:23.248918 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2071ce7-f2f1-401c-b0fc-b7e9fd4d3f96 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:23.249197 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2071ce7-f2f1-401c-b0fc-b7e9fd4d3f96 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:23.249931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2071ce7-f2f1-401c-b0fc-b7e9fd4d3f96 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:23.250240 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2071ce7-f2f1-401c-b0fc-b7e9fd4d3f96 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:23.251699 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2071ce7-f2f1-401c-b0fc-b7e9fd4d3f96 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:23.253395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:23.264638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 521/1058] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:23.271201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2071ce7-f2f1-401c-b0fc-b7e9fd4d3f96 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:23.287112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f600b4-4d10-42c4-bf66-d0df2c1d73c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:23.288595 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f600b4-4d10-42c4-bf66-d0df2c1d73c6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:23.288889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f600b4-4d10-42c4-bf66-d0df2c1d73c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:23.289612 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f600b4-4d10-42c4-bf66-d0df2c1d73c6 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:23.290332 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f600b4-4d10-42c4-bf66-d0df2c1d73c6 None admin] RBAC: Adding query filter params (name=image) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:23.290642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f600b4-4d10-42c4-bf66-d0df2c1d73c6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:23.293012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f600b4-4d10-42c4-bf66-d0df2c1d73c6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:23.299004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 538/1059] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:23 2022] GET /identity/v3/services?name=image => generated 122 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:23.304658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f600b4-4d10-42c4-bf66-d0df2c1d73c6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:23.356391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:23.392153 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2071ce7-f2f1-401c-b0fc-b7e9fd4d3f96 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:23.422342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f600b4-4d10-42c4-bf66-d0df2c1d73c6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:23.430520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad90c15-7019-4adc-a11f-558c69477702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:23.431340 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad90c15-7019-4adc-a11f-558c69477702 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:23.431625 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad90c15-7019-4adc-a11f-558c69477702 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:23.431905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad90c15-7019-4adc-a11f-558c69477702 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:23.438957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad90c15-7019-4adc-a11f-558c69477702 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:23.440497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad90c15-7019-4adc-a11f-558c69477702 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:23.454656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-5ad90c15-7019-4adc-a11f-558c69477702 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:23.454656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:23.454656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:23.454656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:23.454656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:23.454656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:23.454656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:23.454656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:23.454656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:23.454656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:23.454656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:23.454656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:23.454656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:23.454656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:23.454656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:23.455845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:23.455845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:23.455845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:23.455845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:23.455845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:23.455845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:23.455845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:23.455845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:23.455845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:23.455845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:23.455845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:23.455845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:23.455845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:23.455845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:23.455845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:23.455845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:23.455845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:23.456919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:23.456919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:23.456919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:23.456919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:23.456919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:23.456919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:23.456919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:23.456919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:23.456919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 522/1060] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:23.461597 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad90c15-7019-4adc-a11f-558c69477702 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:23.461981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf90f7-74a1-4936-ae1b-abd11345d9a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:23.462882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf90f7-74a1-4936-ae1b-abd11345d9a6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:23.463350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf90f7-74a1-4936-ae1b-abd11345d9a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:23.463776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8cf90f7-74a1-4936-ae1b-abd11345d9a6 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:23.464918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf90f7-74a1-4936-ae1b-abd11345d9a6 None admin] RBAC: Adding query filter params (type=image) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:23.465404 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf90f7-74a1-4936-ae1b-abd11345d9a6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:23.467146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8cf90f7-74a1-4936-ae1b-abd11345d9a6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:23.473056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 539/1061] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:23 2022] GET /identity/v3/services?type=image => generated 350 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:23.478872 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf90f7-74a1-4936-ae1b-abd11345d9a6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:23.524550 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:23.571034 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad90c15-7019-4adc-a11f-558c69477702 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:23.586270 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8cf90f7-74a1-4936-ae1b-abd11345d9a6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:23.601464 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:23.610538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc45097-0797-45d8-aaae-0b86b40c0128 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:23.611278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc45097-0797-45d8-aaae-0b86b40c0128 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:23.611509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc45097-0797-45d8-aaae-0b86b40c0128 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:23.611782 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc45097-0797-45d8-aaae-0b86b40c0128 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:23.612576 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc45097-0797-45d8-aaae-0b86b40c0128 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:23.612885 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc45097-0797-45d8-aaae-0b86b40c0128 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:23.614310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc45097-0797-45d8-aaae-0b86b40c0128 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:23.624592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ef829c-e748-46ed-bcdb-57ea193e5f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:23.628328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef829c-e748-46ed-bcdb-57ea193e5f34 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:23.628328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef829c-e748-46ed-bcdb-57ea193e5f34 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:23.628328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ef829c-e748-46ed-bcdb-57ea193e5f34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:23.628328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef829c-e748-46ed-bcdb-57ea193e5f34 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:23.628658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 523/1062] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:23.628760 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ef829c-e748-46ed-bcdb-57ea193e5f34 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:23.633130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc45097-0797-45d8-aaae-0b86b40c0128 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:23.743029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc45097-0797-45d8-aaae-0b86b40c0128 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:23.746885 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 540/1063] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Jul 15 19:17:23 2022] POST /identity/v3/endpoints => generated 327 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:17:23.794996 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6883cb-9ac4-4e84-a46a-713f7536b80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:23.795865 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6883cb-9ac4-4e84-a46a-713f7536b80c None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:23.796345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6883cb-9ac4-4e84-a46a-713f7536b80c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:23.796452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6883cb-9ac4-4e84-a46a-713f7536b80c None admin] PATH_INFO: `/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/850a32e590154968bfbbfc404450b70a/roles/9895fbb6b76e4545802b1565612c8bf7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:23.799107 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6883cb-9ac4-4e84-a46a-713f7536b80c None admin] RBAC: Authorizing `identity:create_grant(project_id=861de78bbfe84bd991c3ab54e85573a7, user_id=850a32e590154968bfbbfc404450b70a, role_id=9895fbb6b76e4545802b1565612c8bf7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:23.800637 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6883cb-9ac4-4e84-a46a-713f7536b80c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:23.894801 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 524/1064] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:17:23 2022] PUT /identity/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/850a32e590154968bfbbfc404450b70a/roles/9895fbb6b76e4545802b1565612c8bf7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:17:24.779136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c221a7d-136d-4c42-a4d4-11a60b83b981 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:24.779702 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c221a7d-136d-4c42-a4d4-11a60b83b981 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:24.779702 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c221a7d-136d-4c42-a4d4-11a60b83b981 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:24.781196 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 541/1065] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:17:24.786604 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1284a7-8e64-43e7-a9bb-691a23aca229 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:24.787108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1284a7-8e64-43e7-a9bb-691a23aca229 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:24.787188 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1284a7-8e64-43e7-a9bb-691a23aca229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:24.809821 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5d1284a7-8e64-43e7-a9bb-691a23aca229 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:24.811071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5d1284a7-8e64-43e7-a9bb-691a23aca229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:24.857329 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:24.885686 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 525/1066] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:24.909155 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c221a7d-136d-4c42-a4d4-11a60b83b981 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:25.016337 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:25.024067 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c221a7d-136d-4c42-a4d4-11a60b83b981 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:25.069424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d004b63-fda1-4fc9-8995-ec0a729e4ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:25.069706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d004b63-fda1-4fc9-8995-ec0a729e4ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:25.069802 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d004b63-fda1-4fc9-8995-ec0a729e4ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:25.071499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d004b63-fda1-4fc9-8995-ec0a729e4ff4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:25.083740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d004b63-fda1-4fc9-8995-ec0a729e4ff4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:25.092331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-8d004b63-fda1-4fc9-8995-ec0a729e4ff4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:25.092331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:25.092331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:25.092331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:25.092331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:25.092331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:25.092331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:25.092331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:25.092331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:25.092331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:25.092331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:25.092331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:25.092331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:25.092331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:25.092331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:25.092331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:25.093368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:25.093368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:25.093368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:25.093368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:25.093368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:25.093368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:25.093368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:25.093368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:25.093368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:25.093368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:25.093368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:25.093368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:25.093368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:25.093368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:25.093368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:25.093368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:25.094312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:25.094312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:25.094312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:25.094312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:25.094312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:25.094312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:25.094312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:25.094312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:25.094312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:25.094312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:25.094312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:25.094312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:25.098811 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 542/1067] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:17:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:25.099893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1284a7-8e64-43e7-a9bb-691a23aca229 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:25.209271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1284a7-8e64-43e7-a9bb-691a23aca229 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:25.244926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07caa5-0311-4fe6-baef-b3601937bde1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:25.246151 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07caa5-0311-4fe6-baef-b3601937bde1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:25.246439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07caa5-0311-4fe6-baef-b3601937bde1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:25.246710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae07caa5-0311-4fe6-baef-b3601937bde1 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:25.247491 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07caa5-0311-4fe6-baef-b3601937bde1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:25.247800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07caa5-0311-4fe6-baef-b3601937bde1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:25.249179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae07caa5-0311-4fe6-baef-b3601937bde1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:25.258236 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 526/1068] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:25.264715 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d004b63-fda1-4fc9-8995-ec0a729e4ff4 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:25.370026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d004b63-fda1-4fc9-8995-ec0a729e4ff4 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:25.404899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61036d95-abe4-4ed7-aa77-ba2601867c66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:25.405771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61036d95-abe4-4ed7-aa77-ba2601867c66 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:25.406053 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61036d95-abe4-4ed7-aa77-ba2601867c66 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:25.406326 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61036d95-abe4-4ed7-aa77-ba2601867c66 None admin] PATH_INFO: `/v3/users/ff4e317c26174dbb887860d8827acade` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:25.420172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61036d95-abe4-4ed7-aa77-ba2601867c66 None admin] RBAC: Authorizing `identity:get_user(user_id=ff4e317c26174dbb887860d8827acade)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:25.421607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61036d95-abe4-4ed7-aa77-ba2601867c66 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:25.428143 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 543/1069] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:25 2022] GET /identity/v3/users/ff4e317c26174dbb887860d8827acade => generated 285 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:25.429709 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07caa5-0311-4fe6-baef-b3601937bde1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:25.466669 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:25.534482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae07caa5-0311-4fe6-baef-b3601937bde1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:25.569392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01eef7ac-c4aa-462e-9e5e-f3446610e670 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:25.570041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eef7ac-c4aa-462e-9e5e-f3446610e670 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:25.570325 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eef7ac-c4aa-462e-9e5e-f3446610e670 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:25.570601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01eef7ac-c4aa-462e-9e5e-f3446610e670 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:25.641221 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eef7ac-c4aa-462e-9e5e-f3446610e670 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:25.642685 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01eef7ac-c4aa-462e-9e5e-f3446610e670 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:25.680751 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:25.754813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 527/1070] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 19:17:25.756536 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61036d95-abe4-4ed7-aa77-ba2601867c66 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:25.773891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:25.852602 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c69c2-a93a-4b11-bc5c-fcef4cf2da6e None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:25.853165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c69c2-a93a-4b11-bc5c-fcef4cf2da6e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:25.853165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0c69c2-a93a-4b11-bc5c-fcef4cf2da6e None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:25.855081 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 528/1071] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:25.860460 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105bd2d-c74e-4fba-bdd6-10eaad87bb31 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:25.860819 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105bd2d-c74e-4fba-bdd6-10eaad87bb31 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:25.861108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0105bd2d-c74e-4fba-bdd6-10eaad87bb31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:25.867028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61036d95-abe4-4ed7-aa77-ba2601867c66 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:25.879019 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0105bd2d-c74e-4fba-bdd6-10eaad87bb31 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:25.880471 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0105bd2d-c74e-4fba-bdd6-10eaad87bb31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:25.906391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c158b0-087c-4d07-9134-96d0e09570c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:25.907317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c158b0-087c-4d07-9134-96d0e09570c6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:25.907595 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c158b0-087c-4d07-9134-96d0e09570c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:25.907871 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c158b0-087c-4d07-9134-96d0e09570c6 None admin] PATH_INFO: `/v3/projects/ec4e615ccad4405da1a4dd0eb3e6e0cd` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:25.909090 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c158b0-087c-4d07-9134-96d0e09570c6 None admin] RBAC: Authorizing `identity:get_project(project_id=ec4e615ccad4405da1a4dd0eb3e6e0cd)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:25.910534 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c158b0-087c-4d07-9134-96d0e09570c6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:25.917617 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 544/1072] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:25 2022] GET /identity/v3/projects/ec4e615ccad4405da1a4dd0eb3e6e0cd => generated 311 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:25.918770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c158b0-087c-4d07-9134-96d0e09570c6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:25.955619 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 529/1073] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:25 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:17:25.978509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105bd2d-c74e-4fba-bdd6-10eaad87bb31 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:26.006314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:26.025741 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c158b0-087c-4d07-9134-96d0e09570c6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:26.047680 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:26.067023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb44af-ddf2-48af-a81e-a675da5ca35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:26.067851 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb44af-ddf2-48af-a81e-a675da5ca35a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.070974 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb44af-ddf2-48af-a81e-a675da5ca35a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.070974 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb44af-ddf2-48af-a81e-a675da5ca35a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.070974 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb44af-ddf2-48af-a81e-a675da5ca35a None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=ec4e615ccad4405da1a4dd0eb3e6e0cd, user.id=ff4e317c26174dbb887860d8827acade) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:26.070974 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb44af-ddf2-48af-a81e-a675da5ca35a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:26.072256 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb44af-ddf2-48af-a81e-a675da5ca35a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:26.086638 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 545/1074] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:25 2022] GET /identity/v3/role_assignments?user.id=ff4e317c26174dbb887860d8827acade&scope.project.id=ec4e615ccad4405da1a4dd0eb3e6e0cd&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:26.088983 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0105bd2d-c74e-4fba-bdd6-10eaad87bb31 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:26.121110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162332-1d25-434a-86d7-bcc854b5570f None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.121445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162332-1d25-434a-86d7-bcc854b5570f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.121671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a162332-1d25-434a-86d7-bcc854b5570f None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.123355 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 546/1075] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:17:26.128777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a232e15-e80c-41b0-bbcc-56c57cc80591 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.129069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a232e15-e80c-41b0-bbcc-56c57cc80591 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.129342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a232e15-e80c-41b0-bbcc-56c57cc80591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.131959 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a7ebf-f431-4ca4-a98f-3c8f2a5f1bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:26.132638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a7ebf-f431-4ca4-a98f-3c8f2a5f1bda None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.132924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a7ebf-f431-4ca4-a98f-3c8f2a5f1bda None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.133202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4a7ebf-f431-4ca4-a98f-3c8f2a5f1bda None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.148645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-6a232e15-e80c-41b0-bbcc-56c57cc80591 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:26.149894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6a232e15-e80c-41b0-bbcc-56c57cc80591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:26.215718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a7ebf-f431-4ca4-a98f-3c8f2a5f1bda None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:26.217167 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee4a7ebf-f431-4ca4-a98f-3c8f2a5f1bda None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:26.227890 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 547/1076] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:17:26.252324 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a232e15-e80c-41b0-bbcc-56c57cc80591 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:26.291057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:26.327895 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 530/1077] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:25 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 19:17:26.333896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a7ebf-f431-4ca4-a98f-3c8f2a5f1bda None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:26.343088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:26.368945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a232e15-e80c-41b0-bbcc-56c57cc80591 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:26.408607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f5167-c54c-4ebe-9676-2c2f1ad903d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:26.409428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f5167-c54c-4ebe-9676-2c2f1ad903d4 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.409714 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f5167-c54c-4ebe-9676-2c2f1ad903d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.409993 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3f5167-c54c-4ebe-9676-2c2f1ad903d4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.421803 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3f5167-c54c-4ebe-9676-2c2f1ad903d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:26.430671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-cd3f5167-c54c-4ebe-9676-2c2f1ad903d4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:17:26.430671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:26.430671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:26.430671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:26.430671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:26.430671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:26.430671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:26.430671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:26.430671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:26.430671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:26.430671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:26.430671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:26.430671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:26.430671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:26.430671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:26.430671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:26.431723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:26.431723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:26.431723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:26.431723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:26.431723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:26.431723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:26.431723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:26.431723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:26.431723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:26.431723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:26.431723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:26.431723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:26.431723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:26.431723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:26.431723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:26.431723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:26.432696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:26.432696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:26.432696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:26.432696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:26.432696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:26.432696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:26.432696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:26.432696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:26.432696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:26.432696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:26.432696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 15 19:17:26.432696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:26.432696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 548/1078] 10.222.0.40 () {56 vars in 1120 bytes} [Fri Jul 15 19:17:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:26.439907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f5167-c54c-4ebe-9676-2c2f1ad903d4 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:26.443106 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4a7ebf-f431-4ca4-a98f-3c8f2a5f1bda None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:26.482648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cdc01-3dca-4ae3-b517-ef580f2082dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:26.483392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cdc01-3dca-4ae3-b517-ef580f2082dc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.483681 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cdc01-3dca-4ae3-b517-ef580f2082dc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.483952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583cdc01-3dca-4ae3-b517-ef580f2082dc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.495669 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583cdc01-3dca-4ae3-b517-ef580f2082dc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:26.497115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-583cdc01-3dca-4ae3-b517-ef580f2082dc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:26.516559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-583cdc01-3dca-4ae3-b517-ef580f2082dc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:26.516559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:26.516559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:26.516559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:26.516559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:26.516559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:26.516559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:26.516559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:26.516559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:26.516559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:26.516559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:26.516559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:26.516559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:26.516559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:26.516559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:26.518096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:26.518096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:26.518096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:26.518096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:26.518096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:26.518096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:26.518096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:26.518096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:26.518096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:26.518096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:26.518096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:26.518096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:26.518096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:26.518096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:26.518096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:26.518096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:26.518096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:26.519069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:26.519069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:26.519069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:26.519069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:26.519069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 531/1079] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:26.523626 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cdc01-3dca-4ae3-b517-ef580f2082dc None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:26.543933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:26.552030 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3f5167-c54c-4ebe-9676-2c2f1ad903d4 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:26.591268 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23327813-53c3-4b16-8532-4b6efd5f5cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:26.591932 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23327813-53c3-4b16-8532-4b6efd5f5cda None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.592250 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23327813-53c3-4b16-8532-4b6efd5f5cda None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.592481 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23327813-53c3-4b16-8532-4b6efd5f5cda None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.593498 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23327813-53c3-4b16-8532-4b6efd5f5cda None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:26.593498 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23327813-53c3-4b16-8532-4b6efd5f5cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:26.594907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23327813-53c3-4b16-8532-4b6efd5f5cda None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:26.598703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:26.606569 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 549/1080] 10.222.0.40 () {56 vars in 1115 bytes} [Fri Jul 15 19:17:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:26.612008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23327813-53c3-4b16-8532-4b6efd5f5cda None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:26.630784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-583cdc01-3dca-4ae3-b517-ef580f2082dc None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:26.668989 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209da48d-8cf3-4f52-8e12-880f928fb2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:26.669668 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209da48d-8cf3-4f52-8e12-880f928fb2f9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.669949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209da48d-8cf3-4f52-8e12-880f928fb2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.670225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-209da48d-8cf3-4f52-8e12-880f928fb2f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.670967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209da48d-8cf3-4f52-8e12-880f928fb2f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:26.671277 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209da48d-8cf3-4f52-8e12-880f928fb2f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:26.672654 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-209da48d-8cf3-4f52-8e12-880f928fb2f9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:26.694793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 532/1081] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:26.732367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23327813-53c3-4b16-8532-4b6efd5f5cda None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:26.772567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f2c34-9dfe-4e71-8682-269a9c970af0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:26.773341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f2c34-9dfe-4e71-8682-269a9c970af0 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.773621 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f2c34-9dfe-4e71-8682-269a9c970af0 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.773894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13f2c34-9dfe-4e71-8682-269a9c970af0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.786081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f2c34-9dfe-4e71-8682-269a9c970af0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:26.787569 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13f2c34-9dfe-4e71-8682-269a9c970af0 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:26.806777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-f13f2c34-9dfe-4e71-8682-269a9c970af0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:26.806777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:26.806777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:26.806777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:26.806777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:26.806777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:26.806777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:26.806777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:26.806777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:26.806777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:26.806777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:26.806777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:26.806777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:26.806777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:26.806777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:26.808286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:26.808286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:26.808286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:26.808286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:26.808286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:26.808286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:26.808286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:26.808286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:26.808286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:26.808286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:26.808286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:26.808286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:26.808286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:26.808286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:26.808286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:26.808286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:26.808286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:26.809215 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:26.809215 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:26.809215 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:26.809215 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:26.809215 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 550/1082] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:26.815178 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209da48d-8cf3-4f52-8e12-880f928fb2f9 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:26.902839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:26.932418 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-209da48d-8cf3-4f52-8e12-880f928fb2f9 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:26.970504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d32de3-8ac1-4166-9eff-ac4e49b66be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:26.971188 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32de3-8ac1-4166-9eff-ac4e49b66be6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:26.971469 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32de3-8ac1-4166-9eff-ac4e49b66be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:26.971741 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d32de3-8ac1-4166-9eff-ac4e49b66be6 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:26.972584 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d32de3-8ac1-4166-9eff-ac4e49b66be6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:26.972888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d32de3-8ac1-4166-9eff-ac4e49b66be6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:26.974246 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89d32de3-8ac1-4166-9eff-ac4e49b66be6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:26.988512 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 533/1083] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:26.994228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f2c34-9dfe-4e71-8682-269a9c970af0 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:27.045884 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:27.099915 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13f2c34-9dfe-4e71-8682-269a9c970af0 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:27.134272 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162fa32-ba79-4059-b1ce-8ccf586fe730 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:27.135087 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162fa32-ba79-4059-b1ce-8ccf586fe730 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:27.135368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162fa32-ba79-4059-b1ce-8ccf586fe730 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:27.136167 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0162fa32-ba79-4059-b1ce-8ccf586fe730 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:27.143403 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162fa32-ba79-4059-b1ce-8ccf586fe730 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:27.144837 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0162fa32-ba79-4059-b1ce-8ccf586fe730 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:27.159840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-0162fa32-ba79-4059-b1ce-8ccf586fe730 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:17:27.159840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:27.159840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:27.159840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:27.159840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:27.159840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:27.159840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:27.159840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:27.159840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:27.159840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:27.159840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:27.159840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:27.159840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:17:27.159840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:17:27.159840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:17:27.159840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:27.161243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:27.162225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:27.162225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:27.162225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:17:27.162225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:17:27.162225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:17:27.162225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:17:27.162225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:17:27.162225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:17:27.162225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 15 19:17:27.162225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:27.162225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 551/1084] 10.222.0.40 () {56 vars in 1093 bytes} [Fri Jul 15 19:17:26 2022] GET /identity/v3/users/nova => generated 82 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:27.166739 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d32de3-8ac1-4166-9eff-ac4e49b66be6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:27.269752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d32de3-8ac1-4166-9eff-ac4e49b66be6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:27.303819 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0152a-7a80-4636-a8ca-e957906200d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:27.304398 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0152a-7a80-4636-a8ca-e957906200d4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:27.304787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0152a-7a80-4636-a8ca-e957906200d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:27.304962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd0152a-7a80-4636-a8ca-e957906200d4 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:27.305793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0152a-7a80-4636-a8ca-e957906200d4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:27.306105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0152a-7a80-4636-a8ca-e957906200d4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:27.308320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd0152a-7a80-4636-a8ca-e957906200d4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:27.315947 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:27.326127 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 534/1085] 10.222.0.40 () {56 vars in 1133 bytes} [Fri Jul 15 19:17:27 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:27.332013 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162fa32-ba79-4059-b1ce-8ccf586fe730 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:27.431094 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0162fa32-ba79-4059-b1ce-8ccf586fe730 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:27.442001 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:27.465669 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bc5cc-fc54-4005-818c-2602ce6229b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:27.466351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bc5cc-fc54-4005-818c-2602ce6229b9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:27.466578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bc5cc-fc54-4005-818c-2602ce6229b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:27.466880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-746bc5cc-fc54-4005-818c-2602ce6229b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:27.534362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bc5cc-fc54-4005-818c-2602ce6229b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:27.535851 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-746bc5cc-fc54-4005-818c-2602ce6229b9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:27.634347 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 552/1086] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:17:27.640804 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0152a-7a80-4636-a8ca-e957906200d4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:27.740368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd0152a-7a80-4636-a8ca-e957906200d4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:27.775736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8052d67-e68f-4ddb-83b1-20ec59c546c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:27.776559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8052d67-e68f-4ddb-83b1-20ec59c546c1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:27.776842 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8052d67-e68f-4ddb-83b1-20ec59c546c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:27.777313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8052d67-e68f-4ddb-83b1-20ec59c546c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:27.787733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8052d67-e68f-4ddb-83b1-20ec59c546c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:27.789188 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8052d67-e68f-4ddb-83b1-20ec59c546c1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:27.806633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-b8052d67-e68f-4ddb-83b1-20ec59c546c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:27.806633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:27.806633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:27.806633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:27.806633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:27.806633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:27.806633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:27.806633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:27.806633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:27.806633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:27.806633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:27.806633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:27.806633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:17:27.806633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:17:27.806633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:17:27.808278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:17:27.808278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:27.808278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:27.808278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:27.808278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:27.808278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:27.808278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:27.808278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:27.808278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:27.808278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:27.808278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:27.808278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:27.808278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:27.808278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:27.808278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:27.808278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:27.808278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:27.809202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:17:27.809202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:17:27.809202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:17:27.809202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:27.809202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 535/1087] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:27.813953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bc5cc-fc54-4005-818c-2602ce6229b9 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:27.826192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:27.914570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-746bc5cc-fc54-4005-818c-2602ce6229b9 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:27.949678 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e0a3a-4110-4cbe-a383-287ac14e1207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:27.950335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e0a3a-4110-4cbe-a383-287ac14e1207 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:27.950619 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e0a3a-4110-4cbe-a383-287ac14e1207 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:27.950931 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425e0a3a-4110-4cbe-a383-287ac14e1207 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:27.951655 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e0a3a-4110-4cbe-a383-287ac14e1207 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:27.951962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e0a3a-4110-4cbe-a383-287ac14e1207 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:27.953320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425e0a3a-4110-4cbe-a383-287ac14e1207 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:27.964901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 553/1088] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:17:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:27.970545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8052d67-e68f-4ddb-83b1-20ec59c546c1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:28.021055 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:28.073997 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8052d67-e68f-4ddb-83b1-20ec59c546c1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:28.108704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ca9256-aef3-476a-8783-102f26bdc7b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:28.109491 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca9256-aef3-476a-8783-102f26bdc7b0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:28.109770 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca9256-aef3-476a-8783-102f26bdc7b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:28.110046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ca9256-aef3-476a-8783-102f26bdc7b0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:28.116784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca9256-aef3-476a-8783-102f26bdc7b0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:28.118243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ca9256-aef3-476a-8783-102f26bdc7b0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:28.132504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-40ca9256-aef3-476a-8783-102f26bdc7b0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:28.132504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:28.132504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:28.132504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:28.132504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:28.132504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:28.132504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:28.132504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:28.132504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:28.132504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:28.132504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:28.132504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:28.132504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:17:28.132504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:17:28.132504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:17:28.133453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:17:28.133453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:28.133453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:28.133453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:28.133453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:28.133453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:28.133453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:28.133453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:28.133453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:28.133453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:28.133453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:28.133453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:28.133453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:28.133453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:28.133453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:28.133453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:28.133453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:28.134376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:17:28.134376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:17:28.134376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:17:28.134376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:17:28.134376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:17:28.134376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:17:28.134376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:17:28.134376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:28.134376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 536/1089] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:17:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:28.140086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e0a3a-4110-4cbe-a383-287ac14e1207 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:28.149139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db47b1-ef83-4191-9525-d25720159afb None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:28.149556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db47b1-ef83-4191-9525-d25720159afb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:28.149843 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4db47b1-ef83-4191-9525-d25720159afb None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:28.151250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 537/1090] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:17:28.156283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2d825-fff2-4093-b2cc-9bc4f0e3d31e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:28.156567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2d825-fff2-4093-b2cc-9bc4f0e3d31e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:28.156843 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c2d825-fff2-4093-b2cc-9bc4f0e3d31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:28.174287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d3c2d825-fff2-4093-b2cc-9bc4f0e3d31e None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:28.175436 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d3c2d825-fff2-4093-b2cc-9bc4f0e3d31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:28.212343 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:28.243864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425e0a3a-4110-4cbe-a383-287ac14e1207 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:28.244519 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 538/1091] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:28 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:17:28.267679 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2d825-fff2-4093-b2cc-9bc4f0e3d31e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:28.279876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec8a45-c12b-4370-a7b8-73884c424c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:28.280548 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec8a45-c12b-4370-a7b8-73884c424c7a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:28.280812 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec8a45-c12b-4370-a7b8-73884c424c7a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:28.281081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ec8a45-c12b-4370-a7b8-73884c424c7a None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:28.281859 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec8a45-c12b-4370-a7b8-73884c424c7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:28.282173 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec8a45-c12b-4370-a7b8-73884c424c7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:28.283633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ec8a45-c12b-4370-a7b8-73884c424c7a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:28.296415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 554/1092] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:17:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:28.302437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec8a45-c12b-4370-a7b8-73884c424c7a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:28.308646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:28.369647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c2d825-fff2-4093-b2cc-9bc4f0e3d31e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:28.403649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ec8a45-c12b-4370-a7b8-73884c424c7a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:28.404541 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6044c5-ddd3-420e-9124-bb3a2c5a1142 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:28.405327 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6044c5-ddd3-420e-9124-bb3a2c5a1142 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:28.405608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6044c5-ddd3-420e-9124-bb3a2c5a1142 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:28.405880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6044c5-ddd3-420e-9124-bb3a2c5a1142 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:28.416082 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6044c5-ddd3-420e-9124-bb3a2c5a1142 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:28.423728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-aa6044c5-ddd3-420e-9124-bb3a2c5a1142 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:28.423728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:28.423728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:28.423728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:28.423728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:28.423728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:28.423728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:28.423728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:28.423728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:28.423728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:28.423728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:28.423728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:28.423728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:28.423728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:28.423728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:28.423728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:28.424921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:28.424921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:28.424921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:28.424921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:28.424921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:28.424921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:28.424921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:28.424921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:28.424921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:28.424921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:28.424921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:28.424921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:28.424921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:28.424921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:28.424921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:28.424921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:28.426466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:28.426466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:28.426466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:28.426466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:28.426466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:28.426466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:28.426466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:28.426466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:28.426466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:28.426466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:28.426466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:28.426466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:28.426466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 539/1093] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:17:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:17:28.431130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6044c5-ddd3-420e-9124-bb3a2c5a1142 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:28.435831 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:28.441654 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee9ab8-ae47-4314-8b34-9f3105cbe238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:28.442304 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9ab8-ae47-4314-8b34-9f3105cbe238 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:28.442585 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9ab8-ae47-4314-8b34-9f3105cbe238 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:28.442894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ee9ab8-ae47-4314-8b34-9f3105cbe238 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:28.443810 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee9ab8-ae47-4314-8b34-9f3105cbe238 None admin] RBAC: Adding query filter params (role.id=9895fbb6b76e4545802b1565612c8bf7, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=850a32e590154968bfbbfc404450b70a) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:28.444173 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee9ab8-ae47-4314-8b34-9f3105cbe238 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:28.445633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ee9ab8-ae47-4314-8b34-9f3105cbe238 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:28.452412 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 555/1094] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:28 2022] GET /identity/v3/role_assignments?user.id=850a32e590154968bfbbfc404450b70a&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=9895fbb6b76e4545802b1565612c8bf7 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:28.543616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:28.547944 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6044c5-ddd3-420e-9124-bb3a2c5a1142 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:28.584644 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f482eea-58a8-49a1-8a94-fd1c27043e64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:28.585696 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f482eea-58a8-49a1-8a94-fd1c27043e64 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:28.585981 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f482eea-58a8-49a1-8a94-fd1c27043e64 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:28.586257 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f482eea-58a8-49a1-8a94-fd1c27043e64 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:28.587057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f482eea-58a8-49a1-8a94-fd1c27043e64 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:28.587468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f482eea-58a8-49a1-8a94-fd1c27043e64 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:28.589052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f482eea-58a8-49a1-8a94-fd1c27043e64 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:28.598134 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 540/1095] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:28.605005 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee9ab8-ae47-4314-8b34-9f3105cbe238 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:28.710300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ee9ab8-ae47-4314-8b34-9f3105cbe238 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:28.745630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26a35a-7fe7-43b0-9ee1-95c1f689df14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:28.746712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26a35a-7fe7-43b0-9ee1-95c1f689df14 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:28.747044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26a35a-7fe7-43b0-9ee1-95c1f689df14 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:28.747316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26a35a-7fe7-43b0-9ee1-95c1f689df14 None admin] PATH_INFO: `/v3/users/ff4e317c26174dbb887860d8827acade` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:28.748728 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26a35a-7fe7-43b0-9ee1-95c1f689df14 None admin] RBAC: Authorizing `identity:get_user(user_id=ff4e317c26174dbb887860d8827acade)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:28.750073 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26a35a-7fe7-43b0-9ee1-95c1f689df14 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:28.751740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 556/1096] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:28 2022] GET /identity/v3/users/ff4e317c26174dbb887860d8827acade => generated 285 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:28.758534 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f482eea-58a8-49a1-8a94-fd1c27043e64 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:28.863945 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f482eea-58a8-49a1-8a94-fd1c27043e64 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:28.898068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b03acd72-0211-4b83-a54e-91d0ea431284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:28.898944 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03acd72-0211-4b83-a54e-91d0ea431284 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:28.899224 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03acd72-0211-4b83-a54e-91d0ea431284 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:28.899494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b03acd72-0211-4b83-a54e-91d0ea431284 None admin] PATH_INFO: `/v3/projects/ec4e615ccad4405da1a4dd0eb3e6e0cd` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:28.900795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03acd72-0211-4b83-a54e-91d0ea431284 None admin] RBAC: Authorizing `identity:get_project(project_id=ec4e615ccad4405da1a4dd0eb3e6e0cd)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:28.902978 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b03acd72-0211-4b83-a54e-91d0ea431284 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:28.904737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 541/1097] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:28 2022] GET /identity/v3/projects/ec4e615ccad4405da1a4dd0eb3e6e0cd => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:28.911005 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26a35a-7fe7-43b0-9ee1-95c1f689df14 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:28.975433 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:29.020566 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26a35a-7fe7-43b0-9ee1-95c1f689df14 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:29.056688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe55c3b-15df-4a0a-ad3d-49b8210edb29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:29.058090 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe55c3b-15df-4a0a-ad3d-49b8210edb29 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:29.058368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe55c3b-15df-4a0a-ad3d-49b8210edb29 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:29.058686 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe55c3b-15df-4a0a-ad3d-49b8210edb29 None admin] PATH_INFO: `/v3/projects/ec4e615ccad4405da1a4dd0eb3e6e0cd/users/ff4e317c26174dbb887860d8827acade/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:29.060653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe55c3b-15df-4a0a-ad3d-49b8210edb29 None admin] RBAC: Authorizing `identity:create_grant(project_id=ec4e615ccad4405da1a4dd0eb3e6e0cd, user_id=ff4e317c26174dbb887860d8827acade, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:29.062113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe55c3b-15df-4a0a-ad3d-49b8210edb29 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:29.144397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 557/1098] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:17:28 2022] PUT /identity/v3/projects/ec4e615ccad4405da1a4dd0eb3e6e0cd/users/ff4e317c26174dbb887860d8827acade/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:17:31.135673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52a1a-cf94-4d1d-a307-c8f9b1cec42a None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:31.136216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52a1a-cf94-4d1d-a307-c8f9b1cec42a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:31.136310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb52a1a-cf94-4d1d-a307-c8f9b1cec42a None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:31.137658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 542/1099] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:31.143379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49345e13-6ba6-4d38-bca4-0a85267bf1ab None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:31.143753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49345e13-6ba6-4d38-bca4-0a85267bf1ab None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:31.143939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49345e13-6ba6-4d38-bca4-0a85267bf1ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:31.160753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-49345e13-6ba6-4d38-bca4-0a85267bf1ab None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:31.161941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-49345e13-6ba6-4d38-bca4-0a85267bf1ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:31.229036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 558/1100] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:31 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:31.252641 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb52a1a-cf94-4d1d-a307-c8f9b1cec42a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:31.281623 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:31.355939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb52a1a-cf94-4d1d-a307-c8f9b1cec42a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:31.389735 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068aab8-d96b-4b2a-8220-7d56afb03473 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:31.390512 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068aab8-d96b-4b2a-8220-7d56afb03473 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:31.390827 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068aab8-d96b-4b2a-8220-7d56afb03473 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:31.391105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3068aab8-d96b-4b2a-8220-7d56afb03473 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:31.400904 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3068aab8-d96b-4b2a-8220-7d56afb03473 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:31.408547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-3068aab8-d96b-4b2a-8220-7d56afb03473 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:31.408547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:31.408547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:31.408547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:31.408547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:31.408547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:31.408547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:31.408547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:31.408547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:31.408547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:31.408547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:31.408547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:31.408547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:31.408547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:31.408547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:31.408547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:31.409642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:31.409642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:31.409642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:31.409642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:31.409642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:31.409642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:31.409642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:31.409642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:31.409642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:31.409642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:31.409642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:31.409642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:31.409642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:31.409642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:31.409642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:31.409642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:31.410882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:31.410882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:31.410882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:31.410882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:31.410882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:31.410882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:31.410882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:31.410882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:31.410882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:31.410882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:31.410882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:31.410882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:31.410882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 543/1101] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:17:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:31.415867 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49345e13-6ba6-4d38-bca4-0a85267bf1ab None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:31.468293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:31.516399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49345e13-6ba6-4d38-bca4-0a85267bf1ab None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:31.550699 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363bea9-b1fc-4247-8069-7e847fbed56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:31.551382 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363bea9-b1fc-4247-8069-7e847fbed56b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:31.551666 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363bea9-b1fc-4247-8069-7e847fbed56b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:31.551941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363bea9-b1fc-4247-8069-7e847fbed56b None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:31.552682 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363bea9-b1fc-4247-8069-7e847fbed56b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:31.552990 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363bea9-b1fc-4247-8069-7e847fbed56b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:31.554380 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363bea9-b1fc-4247-8069-7e847fbed56b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:31.563018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 559/1102] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:31.568829 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068aab8-d96b-4b2a-8220-7d56afb03473 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:31.656514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:31.668825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3068aab8-d96b-4b2a-8220-7d56afb03473 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:31.702983 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9592198-f8a6-439e-9b14-3559f1154d94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:31.703841 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9592198-f8a6-439e-9b14-3559f1154d94 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:31.704124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9592198-f8a6-439e-9b14-3559f1154d94 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:31.704401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9592198-f8a6-439e-9b14-3559f1154d94 None admin] PATH_INFO: `/v3/users/ff4e317c26174dbb887860d8827acade` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:31.705579 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9592198-f8a6-439e-9b14-3559f1154d94 None admin] RBAC: Authorizing `identity:get_user(user_id=ff4e317c26174dbb887860d8827acade)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:31.707044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9592198-f8a6-439e-9b14-3559f1154d94 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:31.708673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 544/1103] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:31 2022] GET /identity/v3/users/ff4e317c26174dbb887860d8827acade => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:31.715139 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363bea9-b1fc-4247-8069-7e847fbed56b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:31.818834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363bea9-b1fc-4247-8069-7e847fbed56b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:31.833402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:31.854146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ef2fd-233d-4f6a-b899-682248794be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:31.854821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ef2fd-233d-4f6a-b899-682248794be6 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:31.855103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ef2fd-233d-4f6a-b899-682248794be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:31.855373 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ef2fd-233d-4f6a-b899-682248794be6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:31.938619 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ef2fd-233d-4f6a-b899-682248794be6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:31.939986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6ef2fd-233d-4f6a-b899-682248794be6 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:32.035281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 560/1104] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:31 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 19:17:32.041201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9592198-f8a6-439e-9b14-3559f1154d94 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:32.141940 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9592198-f8a6-439e-9b14-3559f1154d94 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:32.175094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa532ed-c241-4512-a886-566567da7d5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:32.175946 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa532ed-c241-4512-a886-566567da7d5a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:32.176226 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa532ed-c241-4512-a886-566567da7d5a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:32.176498 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa532ed-c241-4512-a886-566567da7d5a None admin] PATH_INFO: `/v3/projects/ec4e615ccad4405da1a4dd0eb3e6e0cd` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:32.177670 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa532ed-c241-4512-a886-566567da7d5a None admin] RBAC: Authorizing `identity:get_project(project_id=ec4e615ccad4405da1a4dd0eb3e6e0cd)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:32.179116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa532ed-c241-4512-a886-566567da7d5a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:32.180801 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 545/1105] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:32 2022] GET /identity/v3/projects/ec4e615ccad4405da1a4dd0eb3e6e0cd => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:32.187693 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ef2fd-233d-4f6a-b899-682248794be6 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:32.203431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:32.285435 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6ef2fd-233d-4f6a-b899-682248794be6 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:32.320292 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acf5c90-9db0-463c-b980-17f76e5a1f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:32.320935 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf5c90-9db0-463c-b980-17f76e5a1f10 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:32.321219 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf5c90-9db0-463c-b980-17f76e5a1f10 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:32.321491 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acf5c90-9db0-463c-b980-17f76e5a1f10 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:32.322317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf5c90-9db0-463c-b980-17f76e5a1f10 None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=ec4e615ccad4405da1a4dd0eb3e6e0cd, user.id=ff4e317c26174dbb887860d8827acade) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:32.322628 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf5c90-9db0-463c-b980-17f76e5a1f10 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:32.324629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5acf5c90-9db0-463c-b980-17f76e5a1f10 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:32.330414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 561/1106] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:32 2022] GET /identity/v3/role_assignments?user.id=ff4e317c26174dbb887860d8827acade&scope.project.id=ec4e615ccad4405da1a4dd0eb3e6e0cd&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:34.393028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ac797-66e2-44fe-9d44-4e5a66ad4d0e None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.393530 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ac797-66e2-44fe-9d44-4e5a66ad4d0e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.393530 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05ac797-66e2-44fe-9d44-4e5a66ad4d0e None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.394900 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 546/1107] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:34.400116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68c1f3-e05d-48c6-8a21-18489d7b192c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.400535 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68c1f3-e05d-48c6-8a21-18489d7b192c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.400662 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a68c1f3-e05d-48c6-8a21-18489d7b192c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.417568 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-7a68c1f3-e05d-48c6-8a21-18489d7b192c None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:34.418729 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-7a68c1f3-e05d-48c6-8a21-18489d7b192c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:34.483635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 562/1108] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:34 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:34.507818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ac797-66e2-44fe-9d44-4e5a66ad4d0e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:34.533105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:34.606982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05ac797-66e2-44fe-9d44-4e5a66ad4d0e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:34.639905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc89c1c-a06a-4ea0-bee7-7683feabcdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:34.640678 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc89c1c-a06a-4ea0-bee7-7683feabcdb7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.640960 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc89c1c-a06a-4ea0-bee7-7683feabcdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.641231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc89c1c-a06a-4ea0-bee7-7683feabcdb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.642390 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc89c1c-a06a-4ea0-bee7-7683feabcdb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:34.643894 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc89c1c-a06a-4ea0-bee7-7683feabcdb7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:34.645447 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 547/1109] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:17:34.651448 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68c1f3-e05d-48c6-8a21-18489d7b192c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:34.661431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:34.750105 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a68c1f3-e05d-48c6-8a21-18489d7b192c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:34.783267 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f354c60-5616-44e1-9d1f-3c37d1c97272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:34.783919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f354c60-5616-44e1-9d1f-3c37d1c97272 None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:34.784203 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f354c60-5616-44e1-9d1f-3c37d1c97272 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:34.784478 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f354c60-5616-44e1-9d1f-3c37d1c97272 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:34.785180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f354c60-5616-44e1-9d1f-3c37d1c97272 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:34.786613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f354c60-5616-44e1-9d1f-3c37d1c97272 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:34.927378 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 563/1110] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:17:34 2022] POST /identity/v3/users => generated 286 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:17:36.992202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3606e1-90fc-405a-a4cf-240c876f2303 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:36.992736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3606e1-90fc-405a-a4cf-240c876f2303 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:36.992736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3606e1-90fc-405a-a4cf-240c876f2303 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:36.994222 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 548/1111] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:37.000194 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5ffdd-b451-4539-80ca-982b718b9192 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:37.000585 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5ffdd-b451-4539-80ca-982b718b9192 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:37.000748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d5ffdd-b451-4539-80ca-982b718b9192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:37.017557 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f4d5ffdd-b451-4539-80ca-982b718b9192 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:37.018765 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f4d5ffdd-b451-4539-80ca-982b718b9192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:37.078657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:37.087123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 564/1112] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:37.110949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3606e1-90fc-405a-a4cf-240c876f2303 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:37.202471 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:37.211987 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3606e1-90fc-405a-a4cf-240c876f2303 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:37.246911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715913b8-2586-44d1-addd-bf332904efc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:37.247682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715913b8-2586-44d1-addd-bf332904efc2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:37.247963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715913b8-2586-44d1-addd-bf332904efc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:37.248235 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715913b8-2586-44d1-addd-bf332904efc2 None admin] PATH_INFO: `/v3/roles/a1dd99d822514511a82daa669061e683` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:37.249705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715913b8-2586-44d1-addd-bf332904efc2 None admin] RBAC: Authorizing `identity:get_role(role_id=a1dd99d822514511a82daa669061e683)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:37.251164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715913b8-2586-44d1-addd-bf332904efc2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:37.252523 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 549/1113] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:37 2022] GET /identity/v3/roles/a1dd99d822514511a82daa669061e683 => generated 223 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:37.258530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5ffdd-b451-4539-80ca-982b718b9192 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:37.355080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4d5ffdd-b451-4539-80ca-982b718b9192 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:37.387926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602acc5-79bf-4cd4-9b47-678e3cbd2072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:37.389077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602acc5-79bf-4cd4-9b47-678e3cbd2072 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:37.389361 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602acc5-79bf-4cd4-9b47-678e3cbd2072 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:37.389638 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602acc5-79bf-4cd4-9b47-678e3cbd2072 None admin] PATH_INFO: `/v3/users/01bf45ba3d234da6a0bf56276848a387` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:37.403192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602acc5-79bf-4cd4-9b47-678e3cbd2072 None admin] RBAC: Authorizing `identity:get_user(user_id=01bf45ba3d234da6a0bf56276848a387)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:37.404625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602acc5-79bf-4cd4-9b47-678e3cbd2072 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:37.406267 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 565/1114] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:37 2022] GET /identity/v3/users/01bf45ba3d234da6a0bf56276848a387 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:37.412145 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715913b8-2586-44d1-addd-bf332904efc2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:37.509528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715913b8-2586-44d1-addd-bf332904efc2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:37.543733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139218e-f989-47ba-9c14-5f65413fa38b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:37.544367 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139218e-f989-47ba-9c14-5f65413fa38b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:37.544650 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139218e-f989-47ba-9c14-5f65413fa38b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:37.544927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d139218e-f989-47ba-9c14-5f65413fa38b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:37.573349 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:37.612882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139218e-f989-47ba-9c14-5f65413fa38b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:37.614350 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d139218e-f989-47ba-9c14-5f65413fa38b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:37.709823 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 550/1115] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:37 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 15 19:17:37.715940 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602acc5-79bf-4cd4-9b47-678e3cbd2072 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:37.768987 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:37.815650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602acc5-79bf-4cd4-9b47-678e3cbd2072 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:37.848761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13bc32-e020-4dbc-8f30-f79bdb45ed6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:37.849609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13bc32-e020-4dbc-8f30-f79bdb45ed6a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:37.849891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13bc32-e020-4dbc-8f30-f79bdb45ed6a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:37.850167 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13bc32-e020-4dbc-8f30-f79bdb45ed6a None admin] PATH_INFO: `/v3/projects/ec4e615ccad4405da1a4dd0eb3e6e0cd` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:37.851427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13bc32-e020-4dbc-8f30-f79bdb45ed6a None admin] RBAC: Authorizing `identity:get_project(project_id=ec4e615ccad4405da1a4dd0eb3e6e0cd)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:37.852857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13bc32-e020-4dbc-8f30-f79bdb45ed6a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:37.855109 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 566/1116] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:37 2022] GET /identity/v3/projects/ec4e615ccad4405da1a4dd0eb3e6e0cd => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:37.861514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139218e-f989-47ba-9c14-5f65413fa38b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:37.920405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:37.961626 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d139218e-f989-47ba-9c14-5f65413fa38b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:37.996128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad871c7-5bf3-4f8e-a76b-947c67b5b1d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:37.996780 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad871c7-5bf3-4f8e-a76b-947c67b5b1d3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:37.996953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad871c7-5bf3-4f8e-a76b-947c67b5b1d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:37.997230 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad871c7-5bf3-4f8e-a76b-947c67b5b1d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:37.998057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad871c7-5bf3-4f8e-a76b-947c67b5b1d3 None admin] RBAC: Adding query filter params (role.id=a1dd99d822514511a82daa669061e683, scope.project.id=ec4e615ccad4405da1a4dd0eb3e6e0cd, user.id=01bf45ba3d234da6a0bf56276848a387) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:37.998659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad871c7-5bf3-4f8e-a76b-947c67b5b1d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:38.000162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad871c7-5bf3-4f8e-a76b-947c67b5b1d3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:38.005860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 551/1117] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:37 2022] GET /identity/v3/role_assignments?user.id=01bf45ba3d234da6a0bf56276848a387&scope.project.id=ec4e615ccad4405da1a4dd0eb3e6e0cd&role.id=a1dd99d822514511a82daa669061e683 => generated 259 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:40.002323 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d078236-e41d-4eb5-8468-2efea7084cdd None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.002877 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d078236-e41d-4eb5-8468-2efea7084cdd None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.002877 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d078236-e41d-4eb5-8468-2efea7084cdd None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.004259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 567/1118] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:40.009483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5e0f7-e258-4240-be5c-e730b5fc29f6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.010390 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5e0f7-e258-4240-be5c-e730b5fc29f6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.010671 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5e0f7-e258-4240-be5c-e730b5fc29f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.028041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ded5e0f7-e258-4240-be5c-e730b5fc29f6 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:40.029247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ded5e0f7-e258-4240-be5c-e730b5fc29f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:40.095895 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 552/1119] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:40 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:40.117833 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d078236-e41d-4eb5-8468-2efea7084cdd None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:40.218776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d078236-e41d-4eb5-8468-2efea7084cdd None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:40.238943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:40.259614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2eeae1-4070-45c6-bc69-7c88c9b38440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:40.259614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2eeae1-4070-45c6-bc69-7c88c9b38440 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.259614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2eeae1-4070-45c6-bc69-7c88c9b38440 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.259614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2eeae1-4070-45c6-bc69-7c88c9b38440 None admin] PATH_INFO: `/v3/roles/a1dd99d822514511a82daa669061e683` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.260647 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2eeae1-4070-45c6-bc69-7c88c9b38440 None admin] RBAC: Authorizing `identity:get_role(role_id=a1dd99d822514511a82daa669061e683)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:40.260647 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2eeae1-4070-45c6-bc69-7c88c9b38440 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:40.260647 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 568/1120] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:40 2022] GET /identity/v3/roles/a1dd99d822514511a82daa669061e683 => generated 223 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:40.265058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5e0f7-e258-4240-be5c-e730b5fc29f6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:40.319099 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:40.363224 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5e0f7-e258-4240-be5c-e730b5fc29f6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:40.396883 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a086f-4fe9-4077-bb40-0dd92db1aad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:40.397740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a086f-4fe9-4077-bb40-0dd92db1aad6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.398023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a086f-4fe9-4077-bb40-0dd92db1aad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.398300 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4a086f-4fe9-4077-bb40-0dd92db1aad6 None admin] PATH_INFO: `/v3/users/01bf45ba3d234da6a0bf56276848a387` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.399498 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a086f-4fe9-4077-bb40-0dd92db1aad6 None admin] RBAC: Authorizing `identity:get_user(user_id=01bf45ba3d234da6a0bf56276848a387)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:40.400979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4a086f-4fe9-4077-bb40-0dd92db1aad6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:40.402612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 553/1121] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:40 2022] GET /identity/v3/users/01bf45ba3d234da6a0bf56276848a387 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:40.408643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2eeae1-4070-45c6-bc69-7c88c9b38440 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:40.504511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2eeae1-4070-45c6-bc69-7c88c9b38440 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:40.537799 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62037fb-5c24-4ca3-bdf0-c841ecf15d0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:40.538570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62037fb-5c24-4ca3-bdf0-c841ecf15d0a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.538876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62037fb-5c24-4ca3-bdf0-c841ecf15d0a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.539147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62037fb-5c24-4ca3-bdf0-c841ecf15d0a None admin] PATH_INFO: `/v3/projects/ec4e615ccad4405da1a4dd0eb3e6e0cd` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.540294 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62037fb-5c24-4ca3-bdf0-c841ecf15d0a None admin] RBAC: Authorizing `identity:get_project(project_id=ec4e615ccad4405da1a4dd0eb3e6e0cd)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:40.541856 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62037fb-5c24-4ca3-bdf0-c841ecf15d0a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:40.543547 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 569/1122] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:40 2022] GET /identity/v3/projects/ec4e615ccad4405da1a4dd0eb3e6e0cd => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:40.549539 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a086f-4fe9-4077-bb40-0dd92db1aad6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:40.647778 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4a086f-4fe9-4077-bb40-0dd92db1aad6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:40.669159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:40.680139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de59cc64-a551-4c25-b63e-9928006e858a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:40.681004 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59cc64-a551-4c25-b63e-9928006e858a None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:40.688472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59cc64-a551-4c25-b63e-9928006e858a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:40.688472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de59cc64-a551-4c25-b63e-9928006e858a None admin] PATH_INFO: `/v3/projects/ec4e615ccad4405da1a4dd0eb3e6e0cd/users/01bf45ba3d234da6a0bf56276848a387/roles/a1dd99d822514511a82daa669061e683` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:40.688472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59cc64-a551-4c25-b63e-9928006e858a None admin] RBAC: Authorizing `identity:create_grant(project_id=ec4e615ccad4405da1a4dd0eb3e6e0cd, user_id=01bf45ba3d234da6a0bf56276848a387, role_id=a1dd99d822514511a82daa669061e683)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:40.688472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de59cc64-a551-4c25-b63e-9928006e858a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:40.796566 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 554/1123] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:17:40 2022] PUT /identity/v3/projects/ec4e615ccad4405da1a4dd0eb3e6e0cd/users/01bf45ba3d234da6a0bf56276848a387/roles/a1dd99d822514511a82daa669061e683 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:17:42.798781 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415e13d-811b-4006-ae78-0741a18d305f None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:42.799342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415e13d-811b-4006-ae78-0741a18d305f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:42.799474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5415e13d-811b-4006-ae78-0741a18d305f None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:42.800866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 570/1124] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:42.805975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86955e8-1b41-490e-a0dd-27cad0577c49 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:42.806404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86955e8-1b41-490e-a0dd-27cad0577c49 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:42.807141 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86955e8-1b41-490e-a0dd-27cad0577c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:42.825396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b86955e8-1b41-490e-a0dd-27cad0577c49 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:42.826602 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b86955e8-1b41-490e-a0dd-27cad0577c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:42.893350 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 555/1125] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:42 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:42.918686 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415e13d-811b-4006-ae78-0741a18d305f None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:42.977973 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:43.027959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5415e13d-811b-4006-ae78-0741a18d305f None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:43.063000 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60112d78-5717-4288-90a3-bf862989c3b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:43.063781 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60112d78-5717-4288-90a3-bf862989c3b9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:43.064064 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60112d78-5717-4288-90a3-bf862989c3b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:43.064337 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60112d78-5717-4288-90a3-bf862989c3b9 None admin] PATH_INFO: `/v3/roles/a1dd99d822514511a82daa669061e683` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:43.065832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60112d78-5717-4288-90a3-bf862989c3b9 None admin] RBAC: Authorizing `identity:get_role(role_id=a1dd99d822514511a82daa669061e683)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:43.067239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60112d78-5717-4288-90a3-bf862989c3b9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:43.068631 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 571/1126] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:42 2022] GET /identity/v3/roles/a1dd99d822514511a82daa669061e683 => generated 223 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:43.074935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86955e8-1b41-490e-a0dd-27cad0577c49 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:43.174162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86955e8-1b41-490e-a0dd-27cad0577c49 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:43.187585 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:43.214230 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70d95c-e074-48c9-aeff-2ad9a6b348cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:43.215133 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70d95c-e074-48c9-aeff-2ad9a6b348cb None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:43.215412 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70d95c-e074-48c9-aeff-2ad9a6b348cb None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:43.215686 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70d95c-e074-48c9-aeff-2ad9a6b348cb None admin] PATH_INFO: `/v3/users/01bf45ba3d234da6a0bf56276848a387` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:43.216954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70d95c-e074-48c9-aeff-2ad9a6b348cb None admin] RBAC: Authorizing `identity:get_user(user_id=01bf45ba3d234da6a0bf56276848a387)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:43.218383 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70d95c-e074-48c9-aeff-2ad9a6b348cb None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:43.220132 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 556/1127] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:43 2022] GET /identity/v3/users/01bf45ba3d234da6a0bf56276848a387 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:43.225967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60112d78-5717-4288-90a3-bf862989c3b9 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:43.328176 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60112d78-5717-4288-90a3-bf862989c3b9 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:43.354889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:43.365498 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2bf37-ac08-482a-9a02-f6aec657974b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:43.366148 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2bf37-ac08-482a-9a02-f6aec657974b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:43.366435 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2bf37-ac08-482a-9a02-f6aec657974b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:43.366714 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cc2bf37-ac08-482a-9a02-f6aec657974b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:43.434106 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2bf37-ac08-482a-9a02-f6aec657974b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:43.435584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cc2bf37-ac08-482a-9a02-f6aec657974b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:43.532219 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 572/1128] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:43 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:17:43.538131 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70d95c-e074-48c9-aeff-2ad9a6b348cb None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:43.634080 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70d95c-e074-48c9-aeff-2ad9a6b348cb None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:43.667172 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4378be53-06e2-422d-a19c-f1f63c9cd69b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:43.668001 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378be53-06e2-422d-a19c-f1f63c9cd69b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:43.668307 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378be53-06e2-422d-a19c-f1f63c9cd69b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:43.668551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4378be53-06e2-422d-a19c-f1f63c9cd69b None admin] PATH_INFO: `/v3/projects/ec4e615ccad4405da1a4dd0eb3e6e0cd` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:43.669710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378be53-06e2-422d-a19c-f1f63c9cd69b None admin] RBAC: Authorizing `identity:get_project(project_id=ec4e615ccad4405da1a4dd0eb3e6e0cd)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:43.671149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4378be53-06e2-422d-a19c-f1f63c9cd69b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:43.672818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 557/1129] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:43 2022] GET /identity/v3/projects/ec4e615ccad4405da1a4dd0eb3e6e0cd => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:43.678992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2bf37-ac08-482a-9a02-f6aec657974b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:43.704071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:43.779045 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cc2bf37-ac08-482a-9a02-f6aec657974b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:43.812119 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621275ff-8690-4708-9c3e-8ccbe9afc3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:43.812737 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621275ff-8690-4708-9c3e-8ccbe9afc3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:43.813015 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621275ff-8690-4708-9c3e-8ccbe9afc3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:43.813282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621275ff-8690-4708-9c3e-8ccbe9afc3f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:43.814097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621275ff-8690-4708-9c3e-8ccbe9afc3f8 None admin] RBAC: Adding query filter params (role.id=a1dd99d822514511a82daa669061e683, scope.project.id=ec4e615ccad4405da1a4dd0eb3e6e0cd, user.id=01bf45ba3d234da6a0bf56276848a387) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:43.814401 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621275ff-8690-4708-9c3e-8ccbe9afc3f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:43.815910 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621275ff-8690-4708-9c3e-8ccbe9afc3f8 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:43.821693 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 573/1130] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:43 2022] GET /identity/v3/role_assignments?user.id=01bf45ba3d234da6a0bf56276848a387&scope.project.id=ec4e615ccad4405da1a4dd0eb3e6e0cd&role.id=a1dd99d822514511a82daa669061e683 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:45.823092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c713a-59cf-4cb8-9cce-3258327a44d4 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:45.823653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c713a-59cf-4cb8-9cce-3258327a44d4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:45.823653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c713a-59cf-4cb8-9cce-3258327a44d4 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:45.825023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 558/1131] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:45.830336 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb7673-92b2-4c0e-a648-0616503ffdd9 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:45.830793 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb7673-92b2-4c0e-a648-0616503ffdd9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:45.831062 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2eb7673-92b2-4c0e-a648-0616503ffdd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:45.849023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c2eb7673-92b2-4c0e-a648-0616503ffdd9 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:45.850208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c2eb7673-92b2-4c0e-a648-0616503ffdd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:45.917487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 574/1132] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:45 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:45.941156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c713a-59cf-4cb8-9cce-3258327a44d4 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:45.995072 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:46.048208 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c713a-59cf-4cb8-9cce-3258327a44d4 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:46.082769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac033a1f-e2e3-4f4e-bb80-86fb4dbed2a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:46.083570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac033a1f-e2e3-4f4e-bb80-86fb4dbed2a9 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:46.084167 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac033a1f-e2e3-4f4e-bb80-86fb4dbed2a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:46.084167 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac033a1f-e2e3-4f4e-bb80-86fb4dbed2a9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:46.085316 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac033a1f-e2e3-4f4e-bb80-86fb4dbed2a9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:46.086739 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac033a1f-e2e3-4f4e-bb80-86fb4dbed2a9 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:46.089408 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 559/1133] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:45 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:46.095399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb7673-92b2-4c0e-a648-0616503ffdd9 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:46.113888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:46.194960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2eb7673-92b2-4c0e-a648-0616503ffdd9 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:46.229819 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99c2fc-b131-44a9-9c89-e81bf4b3d85e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:46.230463 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99c2fc-b131-44a9-9c89-e81bf4b3d85e None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:46.230742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99c2fc-b131-44a9-9c89-e81bf4b3d85e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:46.231038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99c2fc-b131-44a9-9c89-e81bf4b3d85e None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:46.231749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99c2fc-b131-44a9-9c89-e81bf4b3d85e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:46.233163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99c2fc-b131-44a9-9c89-e81bf4b3d85e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:46.345424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 575/1134] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Jul 15 19:17:46 2022] POST /identity/v3/projects => generated 311 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:17:48.408165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672282e-801c-45af-a636-ab70b320a3d2 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:48.408682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672282e-801c-45af-a636-ab70b320a3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:48.408777 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0672282e-801c-45af-a636-ab70b320a3d2 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:48.410077 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 560/1135] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:48.415242 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba44e8-2b3f-40c7-a919-885b52f020b3 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:48.416193 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba44e8-2b3f-40c7-a919-885b52f020b3 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:48.416302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ba44e8-2b3f-40c7-a919-885b52f020b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:48.433651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-21ba44e8-2b3f-40c7-a919-885b52f020b3 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:48.434863 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-21ba44e8-2b3f-40c7-a919-885b52f020b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:48.496013 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:48.500491 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 576/1136] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:17:48.525931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672282e-801c-45af-a636-ab70b320a3d2 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:48.625223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0672282e-801c-45af-a636-ab70b320a3d2 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:48.641368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:48.658979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b0d4dd-01bf-4064-9151-6e5b3a7024cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:48.659693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0d4dd-01bf-4064-9151-6e5b3a7024cc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:48.659977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0d4dd-01bf-4064-9151-6e5b3a7024cc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:48.660252 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b0d4dd-01bf-4064-9151-6e5b3a7024cc None admin] PATH_INFO: `/v3/domains/default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:48.661413 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0d4dd-01bf-4064-9151-6e5b3a7024cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:48.662876 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b0d4dd-01bf-4064-9151-6e5b3a7024cc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:48.664485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 561/1137] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:17:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:48.670979 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba44e8-2b3f-40c7-a919-885b52f020b3 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:48.768331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ba44e8-2b3f-40c7-a919-885b52f020b3 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:48.801707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8a5ce4-70c8-474b-adf5-4c55ef6bc30f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:48.802353 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a5ce4-70c8-474b-adf5-4c55ef6bc30f None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:48.802633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a5ce4-70c8-474b-adf5-4c55ef6bc30f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:48.803008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8a5ce4-70c8-474b-adf5-4c55ef6bc30f None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:48.803715 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a5ce4-70c8-474b-adf5-4c55ef6bc30f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:48.805127 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8a5ce4-70c8-474b-adf5-4c55ef6bc30f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:48.891633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 577/1138] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:17:48 2022] POST /identity/v3/users => generated 286 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:17:50.919445 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f14ccb-ae11-41b6-9a90-6716dfe81f07 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:50.919986 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f14ccb-ae11-41b6-9a90-6716dfe81f07 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:50.919986 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f14ccb-ae11-41b6-9a90-6716dfe81f07 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:50.921376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 562/1139] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:50.926948 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e818ee8-a94b-4816-9962-911d175fe0bf None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:50.927374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e818ee8-a94b-4816-9962-911d175fe0bf None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:50.927490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e818ee8-a94b-4816-9962-911d175fe0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:50.944592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5e818ee8-a94b-4816-9962-911d175fe0bf None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:50.945781 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5e818ee8-a94b-4816-9962-911d175fe0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:50.997412 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:51.014998 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 578/1140] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:51.037816 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f14ccb-ae11-41b6-9a90-6716dfe81f07 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:51.143737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f14ccb-ae11-41b6-9a90-6716dfe81f07 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:51.179331 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93657481-465e-4564-99ac-60f7515cd0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:51.180041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93657481-465e-4564-99ac-60f7515cd0aa None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:51.180326 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93657481-465e-4564-99ac-60f7515cd0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:51.180605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93657481-465e-4564-99ac-60f7515cd0aa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:51.191419 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93657481-465e-4564-99ac-60f7515cd0aa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:51.199225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-93657481-465e-4564-99ac-60f7515cd0aa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:51.199225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:51.199225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:51.199225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:51.199225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:51.199225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:51.199225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:51.199225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:51.199225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:51.199225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:51.199225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:51.199225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:51.199225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:51.199225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:51.199225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:51.199225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:51.200426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:51.200426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:51.200426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:51.200426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:51.200426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:51.200426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:51.200426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:51.200426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:51.200426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:51.200426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:51.200426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:51.200426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:51.200426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:51.200426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:51.200426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:51.200426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:51.201502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:51.201502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:51.201502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:51.201502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:51.201502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:51.201502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:51.201502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:51.201502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:51.201502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:51.201502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:51.201502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:51.201502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:51.201502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 563/1141] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:17:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:51.206849 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e818ee8-a94b-4816-9962-911d175fe0bf None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:51.304836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e818ee8-a94b-4816-9962-911d175fe0bf None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:51.339667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a5176-932b-4488-b236-5f04ed6a9272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:51.340326 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a5176-932b-4488-b236-5f04ed6a9272 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:51.340610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a5176-932b-4488-b236-5f04ed6a9272 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:51.340888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411a5176-932b-4488-b236-5f04ed6a9272 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:51.341635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a5176-932b-4488-b236-5f04ed6a9272 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:51.341947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a5176-932b-4488-b236-5f04ed6a9272 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:51.343350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411a5176-932b-4488-b236-5f04ed6a9272 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:51.351459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 579/1142] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:51.357749 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93657481-465e-4564-99ac-60f7515cd0aa None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:51.402427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:51.454975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93657481-465e-4564-99ac-60f7515cd0aa None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:51.487221 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48b956-c683-4600-8472-8e5477e811e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:51.488070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48b956-c683-4600-8472-8e5477e811e6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:51.488348 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48b956-c683-4600-8472-8e5477e811e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:51.488614 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe48b956-c683-4600-8472-8e5477e811e6 None admin] PATH_INFO: `/v3/users/7cd12b195c394aebbb5b46f178de62c3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:51.502123 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48b956-c683-4600-8472-8e5477e811e6 None admin] RBAC: Authorizing `identity:get_user(user_id=7cd12b195c394aebbb5b46f178de62c3)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:51.503588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe48b956-c683-4600-8472-8e5477e811e6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:51.505208 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 564/1143] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:51 2022] GET /identity/v3/users/7cd12b195c394aebbb5b46f178de62c3 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:51.511235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a5176-932b-4488-b236-5f04ed6a9272 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:51.561231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:51.611750 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411a5176-932b-4488-b236-5f04ed6a9272 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:51.644207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd262cb-67e7-402a-b48a-0089bfaff9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:51.644869 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd262cb-67e7-402a-b48a-0089bfaff9b1 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:51.645153 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd262cb-67e7-402a-b48a-0089bfaff9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:51.645427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd262cb-67e7-402a-b48a-0089bfaff9b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:51.711097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd262cb-67e7-402a-b48a-0089bfaff9b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:51.713237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd262cb-67e7-402a-b48a-0089bfaff9b1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:51.759888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:51.811324 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 580/1144] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:17:51.817550 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48b956-c683-4600-8472-8e5477e811e6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:51.917863 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe48b956-c683-4600-8472-8e5477e811e6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:51.919521 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:51.953065 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ccb3b5-2bd3-415b-b678-b21f8b6da7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:51.953952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccb3b5-2bd3-415b-b678-b21f8b6da7a4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:51.954231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccb3b5-2bd3-415b-b678-b21f8b6da7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:51.954499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ccb3b5-2bd3-415b-b678-b21f8b6da7a4 None admin] PATH_INFO: `/v3/projects/62ff5031b9704a77960438d208d8fa35` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:51.955700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccb3b5-2bd3-415b-b678-b21f8b6da7a4 None admin] RBAC: Authorizing `identity:get_project(project_id=62ff5031b9704a77960438d208d8fa35)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:51.957125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ccb3b5-2bd3-415b-b678-b21f8b6da7a4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:51.959007 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 565/1145] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:51 2022] GET /identity/v3/projects/62ff5031b9704a77960438d208d8fa35 => generated 311 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:51.969928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd262cb-67e7-402a-b48a-0089bfaff9b1 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:52.065316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd262cb-67e7-402a-b48a-0089bfaff9b1 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:52.100434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172372ce-c7a0-4119-a88a-7c6e1818c44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:52.101088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172372ce-c7a0-4119-a88a-7c6e1818c44b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:52.101372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172372ce-c7a0-4119-a88a-7c6e1818c44b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:52.101668 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172372ce-c7a0-4119-a88a-7c6e1818c44b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:52.102490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172372ce-c7a0-4119-a88a-7c6e1818c44b None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=62ff5031b9704a77960438d208d8fa35, user.id=7cd12b195c394aebbb5b46f178de62c3) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:52.102855 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172372ce-c7a0-4119-a88a-7c6e1818c44b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:52.104270 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172372ce-c7a0-4119-a88a-7c6e1818c44b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:52.109654 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 581/1146] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:51 2022] GET /identity/v3/role_assignments?user.id=7cd12b195c394aebbb5b46f178de62c3&scope.project.id=62ff5031b9704a77960438d208d8fa35&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:54.080947 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38880ef1-6e53-4c1e-893b-6e6b6f5e8c91 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:54.081402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38880ef1-6e53-4c1e-893b-6e6b6f5e8c91 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:54.081494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38880ef1-6e53-4c1e-893b-6e6b6f5e8c91 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:54.082931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 566/1147] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:54.088150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d450e-6898-4522-92ef-b04a75afff90 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:54.088539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d450e-6898-4522-92ef-b04a75afff90 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:54.088698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522d450e-6898-4522-92ef-b04a75afff90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:54.105593 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-522d450e-6898-4522-92ef-b04a75afff90 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:54.106793 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-522d450e-6898-4522-92ef-b04a75afff90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:54.114054 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:54.173765 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 582/1148] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:54.196861 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38880ef1-6e53-4c1e-893b-6e6b6f5e8c91 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:54.295207 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38880ef1-6e53-4c1e-893b-6e6b6f5e8c91 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:54.328124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbcf77-5c69-4d6f-a65b-dfdaa66b8868 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:54.328819 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbcf77-5c69-4d6f-a65b-dfdaa66b8868 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:54.329095 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbcf77-5c69-4d6f-a65b-dfdaa66b8868 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:54.329366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dbcf77-5c69-4d6f-a65b-dfdaa66b8868 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:54.339285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dbcf77-5c69-4d6f-a65b-dfdaa66b8868 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:54.346763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-22dbcf77-5c69-4d6f-a65b-dfdaa66b8868 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:54.346763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:54.346763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:54.346763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:54.346763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:54.346763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:54.346763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:54.346763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:54.346763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:54.346763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:54.346763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:54.346763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:54.346763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:54.346763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:54.346763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:54.346763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:54.347835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:54.347835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:54.347835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:54.347835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:54.347835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:54.347835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:54.347835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:54.347835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:54.347835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:54.347835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:54.347835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:54.347835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:54.347835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:54.347835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:54.347835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:54.347835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:54.348743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:54.348743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:54.348743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:54.348743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:54.348743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:54.348743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:54.348743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:54.348743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:54.348743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:54.348743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:54.348743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:54.348743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:17:54.348743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 567/1149] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:17:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:54.354711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d450e-6898-4522-92ef-b04a75afff90 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:54.451675 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522d450e-6898-4522-92ef-b04a75afff90 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:54.485028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c88a1-6dd2-4e4e-bb80-c199b45e4396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:54.485668 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c88a1-6dd2-4e4e-bb80-c199b45e4396 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:54.485946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c88a1-6dd2-4e4e-bb80-c199b45e4396 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:54.486217 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11c88a1-6dd2-4e4e-bb80-c199b45e4396 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:54.486975 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c88a1-6dd2-4e4e-bb80-c199b45e4396 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:54.487279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c88a1-6dd2-4e4e-bb80-c199b45e4396 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:54.488632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11c88a1-6dd2-4e4e-bb80-c199b45e4396 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:54.497018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 583/1150] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:54.502829 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbcf77-5c69-4d6f-a65b-dfdaa66b8868 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:54.533435 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:54.601816 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dbcf77-5c69-4d6f-a65b-dfdaa66b8868 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:54.636053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b064e-edee-40b6-a522-70fd335884b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:54.636902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b064e-edee-40b6-a522-70fd335884b6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:54.637184 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b064e-edee-40b6-a522-70fd335884b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:54.637452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c9b064e-edee-40b6-a522-70fd335884b6 None admin] PATH_INFO: `/v3/users/7cd12b195c394aebbb5b46f178de62c3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:54.638906 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b064e-edee-40b6-a522-70fd335884b6 None admin] RBAC: Authorizing `identity:get_user(user_id=7cd12b195c394aebbb5b46f178de62c3)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:54.640333 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c9b064e-edee-40b6-a522-70fd335884b6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:54.641962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 568/1151] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:54 2022] GET /identity/v3/users/7cd12b195c394aebbb5b46f178de62c3 => generated 286 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:54.647799 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c88a1-6dd2-4e4e-bb80-c199b45e4396 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:54.651595 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:54.745720 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11c88a1-6dd2-4e4e-bb80-c199b45e4396 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:54.778547 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90425589-bdf8-4df6-bdb5-460d5386c834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:54.779415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90425589-bdf8-4df6-bdb5-460d5386c834 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:54.779689 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90425589-bdf8-4df6-bdb5-460d5386c834 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:54.779954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90425589-bdf8-4df6-bdb5-460d5386c834 None admin] PATH_INFO: `/v3/projects/62ff5031b9704a77960438d208d8fa35` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:54.781111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90425589-bdf8-4df6-bdb5-460d5386c834 None admin] RBAC: Authorizing `identity:get_project(project_id=62ff5031b9704a77960438d208d8fa35)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:54.782535 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90425589-bdf8-4df6-bdb5-460d5386c834 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:54.784235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 584/1152] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:54 2022] GET /identity/v3/projects/62ff5031b9704a77960438d208d8fa35 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:54.790455 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b064e-edee-40b6-a522-70fd335884b6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:54.885409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:54.889368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c9b064e-edee-40b6-a522-70fd335884b6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:54.925430 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca97596-1b09-4c2b-9e31-13b1596ed4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:54.926321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca97596-1b09-4c2b-9e31-13b1596ed4af None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:54.926604 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca97596-1b09-4c2b-9e31-13b1596ed4af None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:54.926916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca97596-1b09-4c2b-9e31-13b1596ed4af None admin] PATH_INFO: `/v3/projects/62ff5031b9704a77960438d208d8fa35/users/7cd12b195c394aebbb5b46f178de62c3/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:54.928947 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca97596-1b09-4c2b-9e31-13b1596ed4af None admin] RBAC: Authorizing `identity:create_grant(project_id=62ff5031b9704a77960438d208d8fa35, user_id=7cd12b195c394aebbb5b46f178de62c3, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:54.930381 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca97596-1b09-4c2b-9e31-13b1596ed4af None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:55.023327 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 569/1153] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:17:54 2022] PUT /identity/v3/projects/62ff5031b9704a77960438d208d8fa35/users/7cd12b195c394aebbb5b46f178de62c3/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:17:57.003162 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218ed43-1cea-4633-a0c5-fba302b04c49 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:57.003765 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218ed43-1cea-4633-a0c5-fba302b04c49 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:57.003765 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5218ed43-1cea-4633-a0c5-fba302b04c49 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:57.005089 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 585/1154] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:17:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:17:57.010215 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace366d3-d583-4568-a3f8-efb361a30841 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:57.010646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace366d3-d583-4568-a3f8-efb361a30841 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:57.010767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace366d3-d583-4568-a3f8-efb361a30841 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:57.027780 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ace366d3-d583-4568-a3f8-efb361a30841 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:17:57.028945 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ace366d3-d583-4568-a3f8-efb361a30841 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:17:57.096451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 570/1155] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:17:57 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:17:57.120353 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218ed43-1cea-4633-a0c5-fba302b04c49 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:57.191807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:57.222535 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5218ed43-1cea-4633-a0c5-fba302b04c49 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:57.255384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93a12e-02c7-472c-ac7f-f115d9a5636e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:57.256099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93a12e-02c7-472c-ac7f-f115d9a5636e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:57.256382 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93a12e-02c7-472c-ac7f-f115d9a5636e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:57.256654 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae93a12e-02c7-472c-ac7f-f115d9a5636e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:57.268474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae93a12e-02c7-472c-ac7f-f115d9a5636e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:17:57.276640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-ae93a12e-02c7-472c-ac7f-f115d9a5636e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:57.276640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:17:57.276640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:17:57.276640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:17:57.276640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:17:57.276640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:17:57.276640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:17:57.276640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:17:57.276640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:17:57.276640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:17:57.276640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:17:57.276640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:17:57.276640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:17:57.276640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:17:57.276640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:17:57.276640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:17:57.277899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:17:57.277899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:17:57.277899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:17:57.277899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:17:57.277899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:17:57.277899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:17:57.277899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:17:57.277899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:17:57.277899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:17:57.277899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:17:57.277899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:17:57.277899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:17:57.277899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:17:57.277899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:17:57.277899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:17:57.277899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:17:57.279227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:17:57.279227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:17:57.279227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:17:57.279227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:17:57.279227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:17:57.279227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:17:57.279227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:17:57.279227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:17:57.279227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:17:57.279227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:17:57.279227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:17:57.279227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:17:57.279227 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 586/1156] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:17:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:17:57.283926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace366d3-d583-4568-a3f8-efb361a30841 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:57.368078 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:57.379510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace366d3-d583-4568-a3f8-efb361a30841 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:57.413991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca0606-fb55-4b81-a9a6-865660095736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:57.421165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca0606-fb55-4b81-a9a6-865660095736 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:57.421165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca0606-fb55-4b81-a9a6-865660095736 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:57.421165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ca0606-fb55-4b81-a9a6-865660095736 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:57.421165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca0606-fb55-4b81-a9a6-865660095736 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:57.421165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca0606-fb55-4b81-a9a6-865660095736 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:57.421165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ca0606-fb55-4b81-a9a6-865660095736 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:57.425928 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 571/1157] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:17:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:57.431884 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93a12e-02c7-472c-ac7f-f115d9a5636e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:57.530723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae93a12e-02c7-472c-ac7f-f115d9a5636e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:57.559230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:57.563982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adef16f-4e64-4981-b56f-0c594ccaf271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:57.564839 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adef16f-4e64-4981-b56f-0c594ccaf271 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:57.565128 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adef16f-4e64-4981-b56f-0c594ccaf271 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:57.565403 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adef16f-4e64-4981-b56f-0c594ccaf271 None admin] PATH_INFO: `/v3/users/7cd12b195c394aebbb5b46f178de62c3` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:57.566565 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adef16f-4e64-4981-b56f-0c594ccaf271 None admin] RBAC: Authorizing `identity:get_user(user_id=7cd12b195c394aebbb5b46f178de62c3)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:57.568020 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6adef16f-4e64-4981-b56f-0c594ccaf271 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:57.575721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 587/1158] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:17:57 2022] GET /identity/v3/users/7cd12b195c394aebbb5b46f178de62c3 => generated 286 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:57.575842 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca0606-fb55-4b81-a9a6-865660095736 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:57.672871 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ca0606-fb55-4b81-a9a6-865660095736 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:57.704787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fc247-dc70-4c52-a5a8-812980c53c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:57.705414 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fc247-dc70-4c52-a5a8-812980c53c54 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:57.705694 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fc247-dc70-4c52-a5a8-812980c53c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:57.705962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188fc247-dc70-4c52-a5a8-812980c53c54 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:57.724350 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:57.772142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fc247-dc70-4c52-a5a8-812980c53c54 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:57.773967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188fc247-dc70-4c52-a5a8-812980c53c54 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:57.869898 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 572/1159] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:17:57 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:17:57.875956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adef16f-4e64-4981-b56f-0c594ccaf271 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:57.976489 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6adef16f-4e64-4981-b56f-0c594ccaf271 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:58.009222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0de6dc-f97f-4afb-add6-da5e3a6cec0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:58.010236 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0de6dc-f97f-4afb-add6-da5e3a6cec0c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:58.010522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0de6dc-f97f-4afb-add6-da5e3a6cec0c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:58.010827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0de6dc-f97f-4afb-add6-da5e3a6cec0c None admin] PATH_INFO: `/v3/projects/62ff5031b9704a77960438d208d8fa35` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:58.012020 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0de6dc-f97f-4afb-add6-da5e3a6cec0c None admin] RBAC: Authorizing `identity:get_project(project_id=62ff5031b9704a77960438d208d8fa35)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:58.013698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0de6dc-f97f-4afb-add6-da5e3a6cec0c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:58.015423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 588/1160] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:17:57 2022] GET /identity/v3/projects/62ff5031b9704a77960438d208d8fa35 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:17:58.021710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fc247-dc70-4c52-a5a8-812980c53c54 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:17:58.072090 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:17:58.120815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188fc247-dc70-4c52-a5a8-812980c53c54 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:17:58.153666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac58bca-70d2-4379-a656-07a87c013ae4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:17:58.154301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac58bca-70d2-4379-a656-07a87c013ae4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:17:58.154580 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac58bca-70d2-4379-a656-07a87c013ae4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:17:58.154879 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac58bca-70d2-4379-a656-07a87c013ae4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:17:58.155699 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac58bca-70d2-4379-a656-07a87c013ae4 None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=62ff5031b9704a77960438d208d8fa35, user.id=7cd12b195c394aebbb5b46f178de62c3) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:17:58.156007 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac58bca-70d2-4379-a656-07a87c013ae4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:17:58.157432 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac58bca-70d2-4379-a656-07a87c013ae4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:17:58.163103 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 573/1161] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:17:58 2022] GET /identity/v3/role_assignments?user.id=7cd12b195c394aebbb5b46f178de62c3&scope.project.id=62ff5031b9704a77960438d208d8fa35&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:00.194280 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d3b0d-a8b4-4b07-a87b-11097aff88a6 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:00.194879 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d3b0d-a8b4-4b07-a87b-11097aff88a6 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:00.194879 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-241d3b0d-a8b4-4b07-a87b-11097aff88a6 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:00.196243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 589/1162] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:18:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:00.201681 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050f2b0-e0e1-45e8-9373-e93ba44ffc3a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:00.202064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050f2b0-e0e1-45e8-9373-e93ba44ffc3a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:00.202230 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8050f2b0-e0e1-45e8-9373-e93ba44ffc3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:00.219507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8050f2b0-e0e1-45e8-9373-e93ba44ffc3a None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:00.220706 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8050f2b0-e0e1-45e8-9373-e93ba44ffc3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:00.287472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 574/1163] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:00.310798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d3b0d-a8b4-4b07-a87b-11097aff88a6 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:00.376128 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:00.409923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-241d3b0d-a8b4-4b07-a87b-11097aff88a6 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:00.445040 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19217b3c-5f14-4177-ac1b-b627faed6bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:00.445682 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217b3c-5f14-4177-ac1b-b627faed6bd3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:00.445960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217b3c-5f14-4177-ac1b-b627faed6bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:00.446431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19217b3c-5f14-4177-ac1b-b627faed6bd3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:00.523361 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19217b3c-5f14-4177-ac1b-b627faed6bd3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:00.525519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19217b3c-5f14-4177-ac1b-b627faed6bd3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:00.592453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:00.628721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 590/1164] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:18:00 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:18:00.634675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050f2b0-e0e1-45e8-9373-e93ba44ffc3a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:00.680582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:00.735573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8050f2b0-e0e1-45e8-9373-e93ba44ffc3a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:00.769374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e87afdfd-e87f-4a3c-97e4-43f7d64650ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:00.770167 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87afdfd-e87f-4a3c-97e4-43f7d64650ae None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:00.770446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87afdfd-e87f-4a3c-97e4-43f7d64650ae None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:00.770720 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e87afdfd-e87f-4a3c-97e4-43f7d64650ae None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:00.778591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87afdfd-e87f-4a3c-97e4-43f7d64650ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:00.781234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e87afdfd-e87f-4a3c-97e4-43f7d64650ae None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:00.808610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-e87afdfd-e87f-4a3c-97e4-43f7d64650ae None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 15 19:18:00.808610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:00.808610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 15 19:18:00.808610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 15 19:18:00.808610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:18:00.808610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:18:00.808610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:18:00.808610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:18:00.808610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 15 19:18:00.808610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:18:00.808610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:18:00.808610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:18:00.808610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:00.808610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:00.808610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:00.808610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:00.808610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:00.809948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:00.809948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:00.809948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:00.809948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:00.809948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:00.809948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:00.809948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:18:00.809948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:18:00.809948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:18:00.809948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:18:00.809948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:00.809948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:00.809948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:00.809948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:00.809948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:00.809948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:00.811071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:00.811071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:00.811071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:00.811071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:00.811071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:00.811071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:00.811071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:00.811071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:00.811071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:00.811071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:00.811071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 15 19:18:00.811071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:18:00.811071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 15 19:18:00.811071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:18:00.819140 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 575/1165] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Jul 15 19:18:00 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:00.820312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19217b3c-5f14-4177-ac1b-b627faed6bd3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:00.922246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19217b3c-5f14-4177-ac1b-b627faed6bd3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:00.959158 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa24b93e-45e6-4fa1-91fa-1c804446ab8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:00.959886 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24b93e-45e6-4fa1-91fa-1c804446ab8e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:00.960218 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24b93e-45e6-4fa1-91fa-1c804446ab8e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:00.960541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa24b93e-45e6-4fa1-91fa-1c804446ab8e None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:00.961327 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24b93e-45e6-4fa1-91fa-1c804446ab8e None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:00.961739 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24b93e-45e6-4fa1-91fa-1c804446ab8e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:00.963826 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa24b93e-45e6-4fa1-91fa-1c804446ab8e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:00.972221 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 591/1166] 10.222.0.40 () {56 vars in 1115 bytes} [Fri Jul 15 19:18:00 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:03.047161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af053e1-ab99-49a9-8db1-80852bbc5167 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:03.047728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af053e1-ab99-49a9-8db1-80852bbc5167 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:03.047728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af053e1-ab99-49a9-8db1-80852bbc5167 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:03.049131 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 576/1167] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:18:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:03.054708 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6ec15-cd56-4734-bbca-9876a4607cae None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:03.055178 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6ec15-cd56-4734-bbca-9876a4607cae None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:03.055317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd6ec15-cd56-4734-bbca-9876a4607cae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:03.076678 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-4bd6ec15-cd56-4734-bbca-9876a4607cae None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:03.077925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4bd6ec15-cd56-4734-bbca-9876a4607cae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:03.108482 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:03.152163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 592/1168] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:03 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:03.174822 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af053e1-ab99-49a9-8db1-80852bbc5167 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:03.311877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af053e1-ab99-49a9-8db1-80852bbc5167 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:03.314399 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:03.348293 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d547820c-4b78-4a62-b1ca-761988b5da64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:03.348960 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547820c-4b78-4a62-b1ca-761988b5da64 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:03.349250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547820c-4b78-4a62-b1ca-761988b5da64 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:03.349533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d547820c-4b78-4a62-b1ca-761988b5da64 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:03.350297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547820c-4b78-4a62-b1ca-761988b5da64 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:03.351717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d547820c-4b78-4a62-b1ca-761988b5da64 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:03.436826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 577/1169] 10.222.0.40 () {60 vars in 1138 bytes} [Fri Jul 15 19:18:03 2022] POST /identity/v3/domains => generated 267 bytes in 263 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:18:05.519057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3028ec-db00-4f66-b356-8c3b84311b62 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:05.519635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3028ec-db00-4f66-b356-8c3b84311b62 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:05.519635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3028ec-db00-4f66-b356-8c3b84311b62 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:05.520969 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 593/1170] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:05.527068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae17355-b920-4426-8dbd-0b2555ace7ae None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:05.527520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae17355-b920-4426-8dbd-0b2555ace7ae None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:05.527626 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae17355-b920-4426-8dbd-0b2555ace7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:05.544371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7ae17355-b920-4426-8dbd-0b2555ace7ae None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:05.545590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7ae17355-b920-4426-8dbd-0b2555ace7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:05.612786 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 578/1171] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:05.636079 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3028ec-db00-4f66-b356-8c3b84311b62 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:05.741173 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3028ec-db00-4f66-b356-8c3b84311b62 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:05.785296 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de497fc0-8f14-46e5-96c4-b4ab93f629ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:05.786075 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de497fc0-8f14-46e5-96c4-b4ab93f629ec None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:05.786370 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de497fc0-8f14-46e5-96c4-b4ab93f629ec None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:05.786653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de497fc0-8f14-46e5-96c4-b4ab93f629ec None admin] PATH_INFO: `/v3/domains/111233f2bbb5421bbc994a48820284aa` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:05.797856 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de497fc0-8f14-46e5-96c4-b4ab93f629ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=111233f2bbb5421bbc994a48820284aa)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:05.799407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de497fc0-8f14-46e5-96c4-b4ab93f629ec None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:05.801122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 594/1172] 10.222.0.40 () {56 vars in 1183 bytes} [Fri Jul 15 19:18:05 2022] GET /identity/v3/domains/111233f2bbb5421bbc994a48820284aa => generated 267 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:05.807652 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae17355-b920-4426-8dbd-0b2555ace7ae None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:05.910021 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:05.917801 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae17355-b920-4426-8dbd-0b2555ace7ae None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:05.959386 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1696247f-82e7-42a6-bf42-8f621c062745 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:05.960044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696247f-82e7-42a6-bf42-8f621c062745 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:05.960330 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696247f-82e7-42a6-bf42-8f621c062745 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:05.960609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1696247f-82e7-42a6-bf42-8f621c062745 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:05.961846 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696247f-82e7-42a6-bf42-8f621c062745 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:05.963321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1696247f-82e7-42a6-bf42-8f621c062745 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:06.053275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 579/1173] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Jul 15 19:18:05 2022] POST /identity/v3/projects => generated 361 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:18:08.122777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb86cd-6f31-4f72-a55f-334a62c7b0a9 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:08.123321 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb86cd-6f31-4f72-a55f-334a62c7b0a9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:08.123321 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20cb86cd-6f31-4f72-a55f-334a62c7b0a9 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:08.124689 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 595/1174] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:18:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:08.129887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ac0a1-4833-4f26-a93b-252a8085033d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:08.130331 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ac0a1-4833-4f26-a93b-252a8085033d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:08.130438 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7ac0a1-4833-4f26-a93b-252a8085033d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:08.148845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0c7ac0a1-4833-4f26-a93b-252a8085033d None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:08.150058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0c7ac0a1-4833-4f26-a93b-252a8085033d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:08.218527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 580/1175] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:08.244097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb86cd-6f31-4f72-a55f-334a62c7b0a9 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:08.270677 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:08.359926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20cb86cd-6f31-4f72-a55f-334a62c7b0a9 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:08.394610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502c1911-e6bb-4669-a3c6-38f848233dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:08.395495 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c1911-e6bb-4669-a3c6-38f848233dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:08.395776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c1911-e6bb-4669-a3c6-38f848233dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:08.396054 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c1911-e6bb-4669-a3c6-38f848233dd4 None admin] PATH_INFO: `/v3/domains/111233f2bbb5421bbc994a48820284aa` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:08.397232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c1911-e6bb-4669-a3c6-38f848233dd4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=111233f2bbb5421bbc994a48820284aa)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:08.398649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502c1911-e6bb-4669-a3c6-38f848233dd4 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:08.400293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 596/1176] 10.222.0.40 () {56 vars in 1183 bytes} [Fri Jul 15 19:18:08 2022] GET /identity/v3/domains/111233f2bbb5421bbc994a48820284aa => generated 267 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:08.406328 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ac0a1-4833-4f26-a93b-252a8085033d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:08.482292 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:08.506086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7ac0a1-4833-4f26-a93b-252a8085033d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:08.541717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bc8837-9337-4337-ab8b-5ba9ba42ce9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:08.542381 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc8837-9337-4337-ab8b-5ba9ba42ce9e None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:08.542668 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc8837-9337-4337-ab8b-5ba9ba42ce9e None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:08.542973 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bc8837-9337-4337-ab8b-5ba9ba42ce9e None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:08.543679 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc8837-9337-4337-ab8b-5ba9ba42ce9e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:08.545124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bc8837-9337-4337-ab8b-5ba9ba42ce9e None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:08.657593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 581/1177] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:18:08 2022] POST /identity/v3/users => generated 311 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:18:10.756875 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c6e7b-59a7-4524-8653-4bba9727b7a7 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:10.757412 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c6e7b-59a7-4524-8653-4bba9727b7a7 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:10.757412 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494c6e7b-59a7-4524-8653-4bba9727b7a7 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:10.758865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 597/1178] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:18:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:10.764541 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc3e92-3438-499e-a198-ade9d8a93e38 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:10.765008 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc3e92-3438-499e-a198-ade9d8a93e38 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:10.765150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc3e92-3438-499e-a198-ade9d8a93e38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:10.781811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6bbc3e92-3438-499e-a198-ade9d8a93e38 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:10.783023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6bbc3e92-3438-499e-a198-ade9d8a93e38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:10.849598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 582/1179] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:10.880790 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c6e7b-59a7-4524-8653-4bba9727b7a7 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:10.974246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:10.986477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-494c6e7b-59a7-4524-8653-4bba9727b7a7 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:11.022608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85156213-ccd6-4758-9405-4822fffa436d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:11.023353 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85156213-ccd6-4758-9405-4822fffa436d None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:11.023631 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85156213-ccd6-4758-9405-4822fffa436d None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:11.023900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85156213-ccd6-4758-9405-4822fffa436d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:11.035813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85156213-ccd6-4758-9405-4822fffa436d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:18:11.044586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-85156213-ccd6-4758-9405-4822fffa436d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:11.044586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:11.044586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:11.044586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:11.044586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:11.044586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:11.044586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:11.044586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:11.044586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:11.044586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:11.044586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:11.044586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:11.044586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:18:11.044586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:18:11.044586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:18:11.044586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:18:11.045731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:18:11.045731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:18:11.045731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:18:11.045731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:18:11.045731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:11.045731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:11.045731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:11.045731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:11.045731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:11.045731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:11.045731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:11.045731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:11.045731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:11.045731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:11.045731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:11.045731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:11.046685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:11.046685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:11.046685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:11.046685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:11.046685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:18:11.046685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:18:11.046685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:18:11.046685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:18:11.046685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:18:11.046685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:18:11.046685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:11.046685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:18:11.046685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 598/1180] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:18:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:11.052319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc3e92-3438-499e-a198-ade9d8a93e38 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:11.114964 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:11.155977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc3e92-3438-499e-a198-ade9d8a93e38 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:11.193255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f03735-5ac3-40c5-ae08-d9127a3d0ca2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:11.194474 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f03735-5ac3-40c5-ae08-d9127a3d0ca2 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:11.194717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f03735-5ac3-40c5-ae08-d9127a3d0ca2 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:11.194867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02f03735-5ac3-40c5-ae08-d9127a3d0ca2 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:11.195562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f03735-5ac3-40c5-ae08-d9127a3d0ca2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:11.195869 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f03735-5ac3-40c5-ae08-d9127a3d0ca2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:11.197460 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02f03735-5ac3-40c5-ae08-d9127a3d0ca2 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:11.207950 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 583/1181] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:18:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:11.214552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85156213-ccd6-4758-9405-4822fffa436d None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:11.316433 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85156213-ccd6-4758-9405-4822fffa436d None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:11.351101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87580891-64b6-4949-a2b6-daa46bb20513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:11.351962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87580891-64b6-4949-a2b6-daa46bb20513 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:11.352789 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87580891-64b6-4949-a2b6-daa46bb20513 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:11.353136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87580891-64b6-4949-a2b6-daa46bb20513 None admin] PATH_INFO: `/v3/users/a2fc4f113a98402d8f2531b6ff48f276` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:11.367712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87580891-64b6-4949-a2b6-daa46bb20513 None admin] RBAC: Authorizing `identity:get_user(user_id=a2fc4f113a98402d8f2531b6ff48f276)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:11.370088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87580891-64b6-4949-a2b6-daa46bb20513 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:11.371813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 599/1182] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:18:11 2022] GET /identity/v3/users/a2fc4f113a98402d8f2531b6ff48f276 => generated 311 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:11.377624 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f03735-5ac3-40c5-ae08-d9127a3d0ca2 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:11.479350 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02f03735-5ac3-40c5-ae08-d9127a3d0ca2 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:11.503455 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:11.515105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7340bf-376d-4456-bb3a-f0c794c286cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:11.515745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7340bf-376d-4456-bb3a-f0c794c286cc None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:11.516023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7340bf-376d-4456-bb3a-f0c794c286cc None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:11.516296 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7340bf-376d-4456-bb3a-f0c794c286cc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:11.586269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7340bf-376d-4456-bb3a-f0c794c286cc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:11.588435 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7340bf-376d-4456-bb3a-f0c794c286cc None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:11.692233 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 584/1183] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:18:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:18:11.698730 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87580891-64b6-4949-a2b6-daa46bb20513 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:11.709444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:11.801277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87580891-64b6-4949-a2b6-daa46bb20513 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:11.837806 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755e5053-7f6a-47f3-9f2e-d5f9cfe2361f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:11.838659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e5053-7f6a-47f3-9f2e-d5f9cfe2361f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:11.838968 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e5053-7f6a-47f3-9f2e-d5f9cfe2361f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:11.839245 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755e5053-7f6a-47f3-9f2e-d5f9cfe2361f None admin] PATH_INFO: `/v3/projects/eb5bb6c46f414b7b926a23f2f6ea1e6f` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:11.840467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e5053-7f6a-47f3-9f2e-d5f9cfe2361f None admin] RBAC: Authorizing `identity:get_project(project_id=eb5bb6c46f414b7b926a23f2f6ea1e6f)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:11.841903 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755e5053-7f6a-47f3-9f2e-d5f9cfe2361f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:11.843738 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 600/1184] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:18:11 2022] GET /identity/v3/projects/eb5bb6c46f414b7b926a23f2f6ea1e6f => generated 361 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:11.850384 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7340bf-376d-4456-bb3a-f0c794c286cc None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:11.876671 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:11.952490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7340bf-376d-4456-bb3a-f0c794c286cc None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:11.990522 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2682a0e-bff7-4cb6-ab21-9212f1c2d090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:11.991599 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2682a0e-bff7-4cb6-ab21-9212f1c2d090 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:11.992068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2682a0e-bff7-4cb6-ab21-9212f1c2d090 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:11.992526 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2682a0e-bff7-4cb6-ab21-9212f1c2d090 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:11.994182 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2682a0e-bff7-4cb6-ab21-9212f1c2d090 None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=eb5bb6c46f414b7b926a23f2f6ea1e6f, user.id=a2fc4f113a98402d8f2531b6ff48f276) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:11.994488 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2682a0e-bff7-4cb6-ab21-9212f1c2d090 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:11.995944 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2682a0e-bff7-4cb6-ab21-9212f1c2d090 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:12.001533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 585/1185] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:18:11 2022] GET /identity/v3/role_assignments?user.id=a2fc4f113a98402d8f2531b6ff48f276&scope.project.id=eb5bb6c46f414b7b926a23f2f6ea1e6f&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:14.020077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c21f5-a20b-4475-ad7a-e6ef3f68a073 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:14.020636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c21f5-a20b-4475-ad7a-e6ef3f68a073 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:14.020636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8c21f5-a20b-4475-ad7a-e6ef3f68a073 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:14.022152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 601/1186] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:18:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:14.027728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63d6b9-b114-4b33-9b41-5f01e0e89c2e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:14.028165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63d6b9-b114-4b33-9b41-5f01e0e89c2e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:14.028287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db63d6b9-b114-4b33-9b41-5f01e0e89c2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:14.044962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-db63d6b9-b114-4b33-9b41-5f01e0e89c2e None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:14.046148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-db63d6b9-b114-4b33-9b41-5f01e0e89c2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:14.121119 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 586/1187] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:14.144100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c21f5-a20b-4475-ad7a-e6ef3f68a073 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:14.221465 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:14.245325 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8c21f5-a20b-4475-ad7a-e6ef3f68a073 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:14.279695 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ae4ca-8803-4576-83c5-df6e5140a0e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:14.280400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ae4ca-8803-4576-83c5-df6e5140a0e7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:14.280677 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ae4ca-8803-4576-83c5-df6e5140a0e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:14.280944 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ae4ca-8803-4576-83c5-df6e5140a0e7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:14.290902 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ae4ca-8803-4576-83c5-df6e5140a0e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:18:14.298320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-7f6ae4ca-8803-4576-83c5-df6e5140a0e7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:14.298320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:14.298320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:14.298320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:14.298320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:14.298320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:14.298320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:14.298320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:14.298320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:14.298320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:14.298320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:14.298320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:14.298320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:18:14.298320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:18:14.298320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:18:14.298320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:18:14.299446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:18:14.299446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:18:14.299446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:18:14.299446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:18:14.299446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:14.299446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:14.299446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:14.299446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:14.299446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:14.299446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:14.299446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:14.299446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:14.299446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:14.299446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:14.299446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:14.299446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:14.300436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:14.300436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:14.300436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:14.300436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:14.300436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:18:14.300436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:18:14.300436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:18:14.300436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:18:14.300436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:18:14.300436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:18:14.300436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:14.300436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:18:14.300436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 602/1188] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:18:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:14.306561 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63d6b9-b114-4b33-9b41-5f01e0e89c2e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:14.325129 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:14.405577 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db63d6b9-b114-4b33-9b41-5f01e0e89c2e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:14.440781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5fdb6-5d4c-4105-a406-4a5eabc94054 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:14.441448 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5fdb6-5d4c-4105-a406-4a5eabc94054 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:14.441732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5fdb6-5d4c-4105-a406-4a5eabc94054 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:14.442006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c5fdb6-5d4c-4105-a406-4a5eabc94054 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:14.442823 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5fdb6-5d4c-4105-a406-4a5eabc94054 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:14.443137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5fdb6-5d4c-4105-a406-4a5eabc94054 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:14.444505 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c5fdb6-5d4c-4105-a406-4a5eabc94054 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:14.453585 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 587/1189] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:18:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:14.459508 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ae4ca-8803-4576-83c5-df6e5140a0e7 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:14.564150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ae4ca-8803-4576-83c5-df6e5140a0e7 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:14.597950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d924ef9-ba50-46f3-b1b2-5c4d59adf906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:14.598833 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924ef9-ba50-46f3-b1b2-5c4d59adf906 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:14.599114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924ef9-ba50-46f3-b1b2-5c4d59adf906 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:14.599385 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d924ef9-ba50-46f3-b1b2-5c4d59adf906 None admin] PATH_INFO: `/v3/users/a2fc4f113a98402d8f2531b6ff48f276` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:14.600552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d924ef9-ba50-46f3-b1b2-5c4d59adf906 None admin] RBAC: Authorizing `identity:get_user(user_id=a2fc4f113a98402d8f2531b6ff48f276)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:14.601972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d924ef9-ba50-46f3-b1b2-5c4d59adf906 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:14.603958 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 603/1190] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:18:14 2022] GET /identity/v3/users/a2fc4f113a98402d8f2531b6ff48f276 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:14.609752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5fdb6-5d4c-4105-a406-4a5eabc94054 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:14.690172 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:14.709252 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c5fdb6-5d4c-4105-a406-4a5eabc94054 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:14.744639 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb6d8a5-cdd3-4efd-84b7-dc6859444551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:14.745524 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6d8a5-cdd3-4efd-84b7-dc6859444551 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:14.745808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6d8a5-cdd3-4efd-84b7-dc6859444551 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:14.746083 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb6d8a5-cdd3-4efd-84b7-dc6859444551 None admin] PATH_INFO: `/v3/projects/eb5bb6c46f414b7b926a23f2f6ea1e6f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:14.747304 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6d8a5-cdd3-4efd-84b7-dc6859444551 None admin] RBAC: Authorizing `identity:get_project(project_id=eb5bb6c46f414b7b926a23f2f6ea1e6f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:14.748743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb6d8a5-cdd3-4efd-84b7-dc6859444551 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:14.750501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 588/1191] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:18:14 2022] GET /identity/v3/projects/eb5bb6c46f414b7b926a23f2f6ea1e6f => generated 361 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:14.756714 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d924ef9-ba50-46f3-b1b2-5c4d59adf906 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:14.761320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:14.859335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d924ef9-ba50-46f3-b1b2-5c4d59adf906 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:14.893681 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873eb089-ac3f-4645-b725-29d5658eb7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:14.894565 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb089-ac3f-4645-b725-29d5658eb7b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:14.894875 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb089-ac3f-4645-b725-29d5658eb7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:14.895156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873eb089-ac3f-4645-b725-29d5658eb7b1 None admin] PATH_INFO: `/v3/projects/eb5bb6c46f414b7b926a23f2f6ea1e6f/users/a2fc4f113a98402d8f2531b6ff48f276/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:14.897152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873eb089-ac3f-4645-b725-29d5658eb7b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=eb5bb6c46f414b7b926a23f2f6ea1e6f, user_id=a2fc4f113a98402d8f2531b6ff48f276, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:14.898582 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873eb089-ac3f-4645-b725-29d5658eb7b1 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:14.965064 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 604/1192] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:18:14 2022] PUT /identity/v3/projects/eb5bb6c46f414b7b926a23f2f6ea1e6f/users/a2fc4f113a98402d8f2531b6ff48f276/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:18:16.986172 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73119a7-d522-4a26-ac65-373e24503cb9 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:16.986794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73119a7-d522-4a26-ac65-373e24503cb9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:16.986794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73119a7-d522-4a26-ac65-373e24503cb9 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:16.988101 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 589/1193] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:18:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:18:16.993190 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea8a5c-d05a-4977-adc8-931faeabf04b None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:16.993618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea8a5c-d05a-4977-adc8-931faeabf04b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:16.993749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21ea8a5c-d05a-4977-adc8-931faeabf04b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:17.010807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-21ea8a5c-d05a-4977-adc8-931faeabf04b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:18:17.012234 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-21ea8a5c-d05a-4977-adc8-931faeabf04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:18:17.071111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:17.079655 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 605/1194] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:18:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:18:17.104381 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73119a7-d522-4a26-ac65-373e24503cb9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:17.205810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73119a7-d522-4a26-ac65-373e24503cb9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:17.240315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4201e-fd1c-4c60-b59b-0267768bd254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:17.241022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4201e-fd1c-4c60-b59b-0267768bd254 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:17.241301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4201e-fd1c-4c60-b59b-0267768bd254 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:17.241573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb4201e-fd1c-4c60-b59b-0267768bd254 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:17.251379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb4201e-fd1c-4c60-b59b-0267768bd254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:18:17.259955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-bfb4201e-fd1c-4c60-b59b-0267768bd254 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:17.259955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:18:17.259955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:18:17.259955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:18:17.259955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:18:17.259955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:18:17.259955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:18:17.259955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:18:17.259955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:18:17.259955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:18:17.259955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:18:17.259955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:18:17.259955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:18:17.259955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:18:17.259955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:18:17.259955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:18:17.261111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:18:17.261111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:18:17.261111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:18:17.261111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:18:17.261111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:18:17.261111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:18:17.261111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:18:17.261111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:18:17.261111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:18:17.261111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:18:17.261111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:18:17.261111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:18:17.261111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:18:17.261111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:18:17.261111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:18:17.261111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:18:17.262306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:18:17.262306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:18:17.262306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:18:17.262306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:18:17.262306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:18:17.262306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:18:17.262306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:18:17.262306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:18:17.262306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:18:17.262306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:18:17.262306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:18:17.262306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:18:17.262306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 590/1195] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:18:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:18:17.267535 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea8a5c-d05a-4977-adc8-931faeabf04b None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:17.363858 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21ea8a5c-d05a-4977-adc8-931faeabf04b None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:17.397053 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6a9e3-4a21-48d7-8973-c2518a886e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:17.397705 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6a9e3-4a21-48d7-8973-c2518a886e47 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:17.397981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6a9e3-4a21-48d7-8973-c2518a886e47 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:17.398250 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e6a9e3-4a21-48d7-8973-c2518a886e47 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:17.399551 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6a9e3-4a21-48d7-8973-c2518a886e47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:17.399875 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6a9e3-4a21-48d7-8973-c2518a886e47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:17.401335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05e6a9e3-4a21-48d7-8973-c2518a886e47 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:17.409314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 606/1196] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:18:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:17.415361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4201e-fd1c-4c60-b59b-0267768bd254 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:17.426605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:17.514197 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb4201e-fd1c-4c60-b59b-0267768bd254 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:17.546795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e661ac6-3915-42ad-b990-6bf2b1c9fe47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:17.547659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e661ac6-3915-42ad-b990-6bf2b1c9fe47 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:17.547941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e661ac6-3915-42ad-b990-6bf2b1c9fe47 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:17.548217 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e661ac6-3915-42ad-b990-6bf2b1c9fe47 None admin] PATH_INFO: `/v3/users/a2fc4f113a98402d8f2531b6ff48f276` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:17.549396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e661ac6-3915-42ad-b990-6bf2b1c9fe47 None admin] RBAC: Authorizing `identity:get_user(user_id=a2fc4f113a98402d8f2531b6ff48f276)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:17.550850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e661ac6-3915-42ad-b990-6bf2b1c9fe47 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:17.552471 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 591/1197] 10.222.0.40 () {56 vars in 1177 bytes} [Fri Jul 15 19:18:17 2022] GET /identity/v3/users/a2fc4f113a98402d8f2531b6ff48f276 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:17.558512 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6a9e3-4a21-48d7-8973-c2518a886e47 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:17.614406 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:17.658722 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e6a9e3-4a21-48d7-8973-c2518a886e47 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:17.691065 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a97b8-4f43-4ea7-b690-380223ebad82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:17.691699 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a97b8-4f43-4ea7-b690-380223ebad82 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:17.691980 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a97b8-4f43-4ea7-b690-380223ebad82 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:17.692252 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9a97b8-4f43-4ea7-b690-380223ebad82 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:17.759177 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a97b8-4f43-4ea7-b690-380223ebad82 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:17.760610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba9a97b8-4f43-4ea7-b690-380223ebad82 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:17.814255 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:17.860921 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 607/1198] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:18:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:18:17.866803 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e661ac6-3915-42ad-b990-6bf2b1c9fe47 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:17.947255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:17.969846 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e661ac6-3915-42ad-b990-6bf2b1c9fe47 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:18.005631 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9865cd90-b97f-4cb4-90cd-f556946bf8ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:18.006497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865cd90-b97f-4cb4-90cd-f556946bf8ea None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:18.006799 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865cd90-b97f-4cb4-90cd-f556946bf8ea None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:18.007081 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9865cd90-b97f-4cb4-90cd-f556946bf8ea None admin] PATH_INFO: `/v3/projects/eb5bb6c46f414b7b926a23f2f6ea1e6f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:18.009382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865cd90-b97f-4cb4-90cd-f556946bf8ea None admin] RBAC: Authorizing `identity:get_project(project_id=eb5bb6c46f414b7b926a23f2f6ea1e6f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:18.010846 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9865cd90-b97f-4cb4-90cd-f556946bf8ea None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:18.012834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 592/1199] 10.222.0.40 () {56 vars in 1186 bytes} [Fri Jul 15 19:18:17 2022] GET /identity/v3/projects/eb5bb6c46f414b7b926a23f2f6ea1e6f => generated 361 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:18.020426 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a97b8-4f43-4ea7-b690-380223ebad82 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:18:18.126221 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9a97b8-4f43-4ea7-b690-380223ebad82 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:18:18.166534 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8470b0-0d07-4fa3-88ac-9ba7d9f97d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:18:18.167222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8470b0-0d07-4fa3-88ac-9ba7d9f97d1f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:18:18.167507 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8470b0-0d07-4fa3-88ac-9ba7d9f97d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:18:18.167783 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8470b0-0d07-4fa3-88ac-9ba7d9f97d1f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:18:18.168627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8470b0-0d07-4fa3-88ac-9ba7d9f97d1f None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=eb5bb6c46f414b7b926a23f2f6ea1e6f, user.id=a2fc4f113a98402d8f2531b6ff48f276) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:18:18.168953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8470b0-0d07-4fa3-88ac-9ba7d9f97d1f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:18:18.170391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8470b0-0d07-4fa3-88ac-9ba7d9f97d1f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:18:18.176984 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 608/1200] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:18:18 2022] GET /identity/v3/role_assignments?user.id=a2fc4f113a98402d8f2531b6ff48f276&scope.project.id=eb5bb6c46f414b7b926a23f2f6ea1e6f&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:18:28.001255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=28 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:18:28.173973 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=90 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:39.081092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754cf5-41be-457f-bc37-7824294faf76 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:39.084582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754cf5-41be-457f-bc37-7824294faf76 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:39.084582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3754cf5-41be-457f-bc37-7824294faf76 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:39.084582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 593/1201] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:19:39.088746 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52fba0-3716-4c86-9add-84ae9db03d55 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:39.089164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52fba0-3716-4c86-9add-84ae9db03d55 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:39.089306 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb52fba0-3716-4c86-9add-84ae9db03d55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:39.106458 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-eb52fba0-3716-4c86-9add-84ae9db03d55 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:19:39.107749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-eb52fba0-3716-4c86-9add-84ae9db03d55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:19:39.174280 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 609/1202] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:19:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:19:39.198569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3754cf5-41be-457f-bc37-7824294faf76 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:39.302113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3754cf5-41be-457f-bc37-7824294faf76 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:39.335636 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339f199-a151-404d-8583-7941a8cb5a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:39.336407 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339f199-a151-404d-8583-7941a8cb5a41 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:39.337177 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339f199-a151-404d-8583-7941a8cb5a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:39.337460 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8339f199-a151-404d-8583-7941a8cb5a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:39.347470 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339f199-a151-404d-8583-7941a8cb5a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:39.348955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8339f199-a151-404d-8583-7941a8cb5a41 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:39.366962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-8339f199-a151-404d-8583-7941a8cb5a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:39.366962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:39.366962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:39.366962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:39.366962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:39.366962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:39.366962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:39.366962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:39.366962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:39.366962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:39.366962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:39.366962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:39.366962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:19:39.366962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:19:39.366962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:19:39.368260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:19:39.368260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:39.368260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:39.368260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:39.368260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:39.368260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:39.368260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:39.368260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:39.368260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:39.368260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:39.368260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:39.368260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:39.368260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:39.368260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:39.368260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:39.368260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:39.368260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:39.369280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:19:39.369280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:19:39.369280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:39.369280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:19:39.369280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 594/1203] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:19:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:19:39.374684 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52fba0-3716-4c86-9add-84ae9db03d55 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:39.476518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb52fba0-3716-4c86-9add-84ae9db03d55 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:39.505656 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:39.512200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b116fe-3273-4f56-8dc5-373fc42ad843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:39.512860 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b116fe-3273-4f56-8dc5-373fc42ad843 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:39.513132 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b116fe-3273-4f56-8dc5-373fc42ad843 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:39.513402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b116fe-3273-4f56-8dc5-373fc42ad843 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:39.514120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b116fe-3273-4f56-8dc5-373fc42ad843 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:39.514421 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b116fe-3273-4f56-8dc5-373fc42ad843 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:39.515820 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b116fe-3273-4f56-8dc5-373fc42ad843 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:39.527453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 610/1204] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:19:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:39.533497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339f199-a151-404d-8583-7941a8cb5a41 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:39.586451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:39.633045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8339f199-a151-404d-8583-7941a8cb5a41 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:39.666851 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1b1540-81f2-4563-938b-12f638db92a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:39.667518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b1540-81f2-4563-938b-12f638db92a7 None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:39.667810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b1540-81f2-4563-938b-12f638db92a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:39.668079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1b1540-81f2-4563-938b-12f638db92a7 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:39.668776 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b1540-81f2-4563-938b-12f638db92a7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:39.670310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1b1540-81f2-4563-938b-12f638db92a7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:39.768293 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 595/1205] 10.222.0.40 () {60 vars in 1132 bytes} [Fri Jul 15 19:19:39 2022] POST /identity/v3/users => generated 251 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:19:41.819432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64ed31-9c53-4298-8ef4-59bf84e1f200 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:41.820001 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64ed31-9c53-4298-8ef4-59bf84e1f200 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:41.820001 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b64ed31-9c53-4298-8ef4-59bf84e1f200 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:41.821354 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 611/1206] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:19:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:19:41.826640 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c951a-d8b3-40ea-9f23-bb04b888dd0d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:41.827137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c951a-d8b3-40ea-9f23-bb04b888dd0d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:41.827294 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12c951a-d8b3-40ea-9f23-bb04b888dd0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:41.844097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d12c951a-d8b3-40ea-9f23-bb04b888dd0d None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:19:41.845328 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d12c951a-d8b3-40ea-9f23-bb04b888dd0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:19:41.916370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 596/1207] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:19:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:19:41.941508 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64ed31-9c53-4298-8ef4-59bf84e1f200 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:42.049558 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b64ed31-9c53-4298-8ef4-59bf84e1f200 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:42.086566 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788ea56-46cf-4635-9232-bf183335c591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:42.087394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788ea56-46cf-4635-9232-bf183335c591 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:42.088326 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788ea56-46cf-4635-9232-bf183335c591 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:42.088634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4788ea56-46cf-4635-9232-bf183335c591 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:42.098868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4788ea56-46cf-4635-9232-bf183335c591 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:19:42.107208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-4788ea56-46cf-4635-9232-bf183335c591 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:19:42.107208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:42.107208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:42.107208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:42.107208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:42.107208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:42.107208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:42.107208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:42.107208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:42.107208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:42.107208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:42.107208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:42.107208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:19:42.107208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:19:42.107208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:19:42.107208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:19:42.108384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:19:42.108384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:19:42.108384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:19:42.108384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:19:42.108384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:42.108384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:42.108384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:42.108384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:42.108384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:42.108384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:42.108384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:42.108384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:42.108384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:42.108384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:42.108384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:42.108384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:42.109473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:42.109473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:42.109473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:42.109473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:42.109473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:19:42.109473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:19:42.109473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:19:42.109473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:19:42.109473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:19:42.109473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:19:42.109473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:19:42.109473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:19:42.109473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 612/1208] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:19:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:42.116865 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c951a-d8b3-40ea-9f23-bb04b888dd0d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:42.160858 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:42.224746 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12c951a-d8b3-40ea-9f23-bb04b888dd0d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:42.260460 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0733d2-ec52-4441-b0e5-c354770485d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:42.261198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0733d2-ec52-4441-b0e5-c354770485d0 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:42.261482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0733d2-ec52-4441-b0e5-c354770485d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:42.261759 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0733d2-ec52-4441-b0e5-c354770485d0 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:42.262564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0733d2-ec52-4441-b0e5-c354770485d0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:42.262892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0733d2-ec52-4441-b0e5-c354770485d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:42.264295 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0733d2-ec52-4441-b0e5-c354770485d0 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:42.273533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 597/1209] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:19:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:42.279888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788ea56-46cf-4635-9232-bf183335c591 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:42.331601 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:42.381993 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4788ea56-46cf-4635-9232-bf183335c591 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:42.417405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672a6ba-6ed1-4aaa-9cf1-624843071b05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:42.418192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672a6ba-6ed1-4aaa-9cf1-624843071b05 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:42.418477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672a6ba-6ed1-4aaa-9cf1-624843071b05 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:42.418776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672a6ba-6ed1-4aaa-9cf1-624843071b05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:42.429692 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672a6ba-6ed1-4aaa-9cf1-624843071b05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:42.431177 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672a6ba-6ed1-4aaa-9cf1-624843071b05 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:42.449391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-2672a6ba-6ed1-4aaa-9cf1-624843071b05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:42.449391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:42.449391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:42.449391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:42.449391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:42.449391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:42.449391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:42.449391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:42.449391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:42.449391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:42.449391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:42.449391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:42.449391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:19:42.449391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:19:42.449391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:19:42.450509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:19:42.450509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:42.450509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:42.450509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:42.450509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:42.450509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:42.450509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:42.450509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:42.450509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:42.450509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:42.450509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:42.450509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:42.450509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:42.450509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:42.450509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:42.450509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:42.450509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:42.451559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:19:42.451559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:19:42.451559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:42.451559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:19:42.451559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 613/1210] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:19:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:42.456844 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0733d2-ec52-4441-b0e5-c354770485d0 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:42.557452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:42.560369 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0733d2-ec52-4441-b0e5-c354770485d0 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:42.595258 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5c4f6-31b7-4081-a887-df6b97820fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:42.595846 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5c4f6-31b7-4081-a887-df6b97820fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:42.596149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5c4f6-31b7-4081-a887-df6b97820fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:42.596434 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b5c4f6-31b7-4081-a887-df6b97820fd7 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:42.597162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5c4f6-31b7-4081-a887-df6b97820fd7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:42.597470 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5c4f6-31b7-4081-a887-df6b97820fd7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:42.598885 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b5c4f6-31b7-4081-a887-df6b97820fd7 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:42.610970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 598/1211] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:19:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:42.617171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672a6ba-6ed1-4aaa-9cf1-624843071b05 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:42.718920 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672a6ba-6ed1-4aaa-9cf1-624843071b05 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:42.720423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:42.753378 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55910560-1f02-4e06-88fc-0fa2eac3b3eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:42.754167 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55910560-1f02-4e06-88fc-0fa2eac3b3eb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:42.754448 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55910560-1f02-4e06-88fc-0fa2eac3b3eb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:42.754719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55910560-1f02-4e06-88fc-0fa2eac3b3eb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:42.762104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55910560-1f02-4e06-88fc-0fa2eac3b3eb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:42.763570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55910560-1f02-4e06-88fc-0fa2eac3b3eb None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:42.778874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-55910560-1f02-4e06-88fc-0fa2eac3b3eb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:19:42.778874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:42.778874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:42.778874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:42.778874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:42.778874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:42.778874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:42.778874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:42.778874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:42.778874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:42.778874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:42.778874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:42.778874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:19:42.778874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:19:42.778874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:19:42.778874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:42.780046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:42.781371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:42.781371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:42.781371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:19:42.781371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:19:42.781371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:19:42.781371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:19:42.781371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:19:42.781371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:19:42.781371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:19:42.781371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:19:42.781371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 614/1212] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:19:42 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:42.786045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5c4f6-31b7-4081-a887-df6b97820fd7 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:42.887800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b5c4f6-31b7-4081-a887-df6b97820fd7 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:42.921727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710e7e6-a973-42d9-8306-7f790c4e1700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:42.922392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710e7e6-a973-42d9-8306-7f790c4e1700 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:42.922670 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710e7e6-a973-42d9-8306-7f790c4e1700 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:42.922966 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a710e7e6-a973-42d9-8306-7f790c4e1700 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:42.923798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710e7e6-a973-42d9-8306-7f790c4e1700 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:42.924105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710e7e6-a973-42d9-8306-7f790c4e1700 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:42.925528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a710e7e6-a973-42d9-8306-7f790c4e1700 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:42.943169 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 599/1213] 10.222.0.40 () {56 vars in 1143 bytes} [Fri Jul 15 19:19:42 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:42.951165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55910560-1f02-4e06-88fc-0fa2eac3b3eb None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:43.050185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55910560-1f02-4e06-88fc-0fa2eac3b3eb None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:43.085944 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8f541-8fb0-487a-a2f6-a7daa1af64c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:43.086721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8f541-8fb0-487a-a2f6-a7daa1af64c3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:43.086906 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8f541-8fb0-487a-a2f6-a7daa1af64c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:43.087181 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3a8f541-8fb0-487a-a2f6-a7daa1af64c3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:43.124738 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:43.162657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8f541-8fb0-487a-a2f6-a7daa1af64c3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:43.164145 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3a8f541-8fb0-487a-a2f6-a7daa1af64c3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:43.264032 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 615/1214] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:19:42 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:19:43.269823 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710e7e6-a973-42d9-8306-7f790c4e1700 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:43.288752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:43.368636 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a710e7e6-a973-42d9-8306-7f790c4e1700 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:43.403495 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab3220-f2c6-49c9-bd15-3958dd8da95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:43.404324 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab3220-f2c6-49c9-bd15-3958dd8da95a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:43.404606 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab3220-f2c6-49c9-bd15-3958dd8da95a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:43.404875 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fab3220-f2c6-49c9-bd15-3958dd8da95a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:43.417050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab3220-f2c6-49c9-bd15-3958dd8da95a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:43.417517 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fab3220-f2c6-49c9-bd15-3958dd8da95a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:43.435069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-1fab3220-f2c6-49c9-bd15-3958dd8da95a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:43.435069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:43.435069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:43.435069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:43.435069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:43.435069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:43.435069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:43.435069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:43.435069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:43.435069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:43.435069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:43.435069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:43.435069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:19:43.435069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:19:43.435069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:19:43.436200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:19:43.436200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:43.436200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:43.436200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:43.436200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:43.436200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:43.436200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:43.436200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:43.436200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:43.436200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:43.436200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:43.436200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:43.436200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:43.436200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:43.436200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:43.436200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:43.436200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:43.437343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:19:43.437343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:19:43.437343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:43.437343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:19:43.437343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 600/1215] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:19:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:43.442074 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8f541-8fb0-487a-a2f6-a7daa1af64c3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:43.505266 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:43.545187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3a8f541-8fb0-487a-a2f6-a7daa1af64c3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:43.578935 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed3a3c-02e2-4178-addd-d90af91f0ecf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:43.579583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed3a3c-02e2-4178-addd-d90af91f0ecf None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:43.579864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed3a3c-02e2-4178-addd-d90af91f0ecf None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:43.580134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ed3a3c-02e2-4178-addd-d90af91f0ecf None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:43.580844 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed3a3c-02e2-4178-addd-d90af91f0ecf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:43.581146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed3a3c-02e2-4178-addd-d90af91f0ecf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:43.582488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ed3a3c-02e2-4178-addd-d90af91f0ecf None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:43.594124 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 616/1216] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:19:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:43.600176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab3220-f2c6-49c9-bd15-3958dd8da95a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:43.671213 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:43.701964 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fab3220-f2c6-49c9-bd15-3958dd8da95a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:43.735358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473d06a-1ffb-4bd5-956d-6c3399a17a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:43.736153 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473d06a-1ffb-4bd5-956d-6c3399a17a7a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:43.736434 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473d06a-1ffb-4bd5-956d-6c3399a17a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:43.736712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0473d06a-1ffb-4bd5-956d-6c3399a17a7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:43.744969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473d06a-1ffb-4bd5-956d-6c3399a17a7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:43.746421 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0473d06a-1ffb-4bd5-956d-6c3399a17a7a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:43.761494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-0473d06a-1ffb-4bd5-956d-6c3399a17a7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:19:43.761494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:43.761494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:43.761494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:43.761494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:43.761494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:43.761494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:43.761494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:43.761494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:43.761494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:43.761494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:43.761494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:43.761494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:19:43.761494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:19:43.761494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:19:43.762630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:19:43.762630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:43.762630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:43.762630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:43.762630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:43.762630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:43.762630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:43.762630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:43.762630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:43.762630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:43.762630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:43.762630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:43.762630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:43.762630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:43.762630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:43.762630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:43.762630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:43.764010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:19:43.764010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:19:43.764010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:19:43.764010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:19:43.764010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:19:43.764010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:19:43.764010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:19:43.764010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:19:43.764010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 601/1217] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:19:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:43.768633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed3a3c-02e2-4178-addd-d90af91f0ecf None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:43.867973 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ed3a3c-02e2-4178-addd-d90af91f0ecf None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:43.891320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:43.903722 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a616a5e-1ffa-49ce-b89a-7526cf398315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:43.904379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a616a5e-1ffa-49ce-b89a-7526cf398315 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:43.904667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a616a5e-1ffa-49ce-b89a-7526cf398315 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:43.904932 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a616a5e-1ffa-49ce-b89a-7526cf398315 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:43.905722 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a616a5e-1ffa-49ce-b89a-7526cf398315 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:43.906031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a616a5e-1ffa-49ce-b89a-7526cf398315 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:43.907510 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a616a5e-1ffa-49ce-b89a-7526cf398315 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:43.919960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 617/1218] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:19:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:19:43.926527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473d06a-1ffb-4bd5-956d-6c3399a17a7a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:44.029709 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0473d06a-1ffb-4bd5-956d-6c3399a17a7a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:44.058558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:44.065226 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195104b9-efae-4c76-8ca9-3dab780f0725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:44.070297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195104b9-efae-4c76-8ca9-3dab780f0725 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:44.070297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195104b9-efae-4c76-8ca9-3dab780f0725 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:44.070297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195104b9-efae-4c76-8ca9-3dab780f0725 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:44.070297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195104b9-efae-4c76-8ca9-3dab780f0725 None admin] RBAC: Adding query filter params (role.id=579726a957a7468abecab3fbdb4351a9, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=ad68d871464f4b5588c22070205f159e) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:44.070297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195104b9-efae-4c76-8ca9-3dab780f0725 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:44.070297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195104b9-efae-4c76-8ca9-3dab780f0725 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:44.076120 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 602/1219] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:19:43 2022] GET /identity/v3/role_assignments?user.id=ad68d871464f4b5588c22070205f159e&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=579726a957a7468abecab3fbdb4351a9 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:19:46.083945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662b7be-8395-487b-a149-567d4adff5b0 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:46.084455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662b7be-8395-487b-a149-567d4adff5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:46.084557 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9662b7be-8395-487b-a149-567d4adff5b0 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:46.085906 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 618/1220] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:19:46.092443 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e4e5-e02b-4e1c-a51f-f79ab7631e22 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:46.092903 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e4e5-e02b-4e1c-a51f-f79ab7631e22 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:46.110682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc8e4e5-e02b-4e1c-a51f-f79ab7631e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:46.110682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4dc8e4e5-e02b-4e1c-a51f-f79ab7631e22 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:19:46.111399 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4dc8e4e5-e02b-4e1c-a51f-f79ab7631e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:19:46.182024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 603/1221] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:19:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:19:46.204844 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662b7be-8395-487b-a149-567d4adff5b0 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:46.310772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9662b7be-8395-487b-a149-567d4adff5b0 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:46.345117 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806e1ae-d79b-4d0b-af24-580985d61ddb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:46.345825 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806e1ae-d79b-4d0b-af24-580985d61ddb None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:46.346109 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806e1ae-d79b-4d0b-af24-580985d61ddb None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:46.346446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4806e1ae-d79b-4d0b-af24-580985d61ddb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:46.357283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4806e1ae-d79b-4d0b-af24-580985d61ddb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:19:46.365041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-4806e1ae-d79b-4d0b-af24-580985d61ddb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:19:46.365041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:46.365041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:46.365041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:46.365041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:46.365041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:46.365041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:46.365041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:46.365041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:46.365041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:46.365041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:46.365041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:46.365041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:19:46.365041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:19:46.365041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:19:46.365041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:19:46.366180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:19:46.366180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:19:46.366180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:19:46.366180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:19:46.366180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:46.366180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:46.366180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:46.366180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:46.366180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:46.366180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:46.366180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:46.366180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:46.366180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:46.366180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:46.366180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:46.366180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:46.367248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:46.367248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:46.367248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:46.367248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:46.367248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:19:46.367248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:19:46.367248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:19:46.367248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:19:46.367248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:19:46.367248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:19:46.367248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:19:46.367248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:19:46.367248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 619/1222] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:19:46 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:46.374489 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8e4e5-e02b-4e1c-a51f-f79ab7631e22 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:46.477533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc8e4e5-e02b-4e1c-a51f-f79ab7631e22 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:46.504216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:46.516656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc1b24-374a-4922-9d65-0703bd927ac5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:46.517337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc1b24-374a-4922-9d65-0703bd927ac5 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:46.517620 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc1b24-374a-4922-9d65-0703bd927ac5 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:46.517900 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efc1b24-374a-4922-9d65-0703bd927ac5 None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:46.518662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc1b24-374a-4922-9d65-0703bd927ac5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:46.519042 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc1b24-374a-4922-9d65-0703bd927ac5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:46.520457 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efc1b24-374a-4922-9d65-0703bd927ac5 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:46.529878 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 604/1223] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:19:46 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:46.535795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806e1ae-d79b-4d0b-af24-580985d61ddb None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:46.583716 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:46.642677 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4806e1ae-d79b-4d0b-af24-580985d61ddb None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:46.677924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fc496-d38f-4445-a638-9b1c1a6a3464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:46.678722 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fc496-d38f-4445-a638-9b1c1a6a3464 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:46.679040 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fc496-d38f-4445-a638-9b1c1a6a3464 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:46.679320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-063fc496-d38f-4445-a638-9b1c1a6a3464 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:46.692073 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fc496-d38f-4445-a638-9b1c1a6a3464 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:46.693522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-063fc496-d38f-4445-a638-9b1c1a6a3464 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:46.711764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-063fc496-d38f-4445-a638-9b1c1a6a3464 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:46.711764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:46.711764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:46.711764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:46.711764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:46.711764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:46.711764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:46.711764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:46.711764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:46.711764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:46.711764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:46.711764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:46.711764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:19:46.711764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:19:46.711764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:19:46.712967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:19:46.712967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:46.712967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:46.712967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:46.712967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:46.712967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:46.712967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:46.712967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:46.712967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:46.712967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:46.712967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:46.712967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:46.712967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:46.712967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:46.712967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:46.712967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:46.712967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:46.719421 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:19:46.719421 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:19:46.719421 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:46.719421 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:19:46.719421 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 620/1224] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:19:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:46.719851 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc1b24-374a-4922-9d65-0703bd927ac5 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:46.825999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efc1b24-374a-4922-9d65-0703bd927ac5 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:46.862340 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0919b6a-0ddc-475b-9acf-8ed0549f254a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:46.863061 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0919b6a-0ddc-475b-9acf-8ed0549f254a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:46.863347 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0919b6a-0ddc-475b-9acf-8ed0549f254a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:46.863646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0919b6a-0ddc-475b-9acf-8ed0549f254a None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:46.864407 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0919b6a-0ddc-475b-9acf-8ed0549f254a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:46.864737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0919b6a-0ddc-475b-9acf-8ed0549f254a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:46.866114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0919b6a-0ddc-475b-9acf-8ed0549f254a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:46.879322 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 605/1225] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:19:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:46.885962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fc496-d38f-4445-a638-9b1c1a6a3464 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:46.982955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:46.989496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-063fc496-d38f-4445-a638-9b1c1a6a3464 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:47.024165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b623b-3093-4e29-8536-26974f521f5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:47.025578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b623b-3093-4e29-8536-26974f521f5f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:47.025853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b623b-3093-4e29-8536-26974f521f5f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:47.026121 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6b623b-3093-4e29-8536-26974f521f5f None admin] PATH_INFO: `/v3/users/placement` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:47.033328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b623b-3093-4e29-8536-26974f521f5f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:47.034826 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6b623b-3093-4e29-8536-26974f521f5f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:47.050314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-ea6b623b-3093-4e29-8536-26974f521f5f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:19:47.050314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:47.050314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:47.050314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:47.050314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:47.050314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:47.050314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:47.050314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:47.050314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:47.050314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:47.050314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:47.050314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:47.050314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:19:47.050314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:19:47.050314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:19:47.050314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:47.051744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:47.052887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:47.052887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:47.052887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:19:47.052887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:19:47.052887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:19:47.052887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:19:47.052887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:19:47.052887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:19:47.052887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:19:47.052887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:19:47.052887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 621/1226] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:19:46 2022] GET /identity/v3/users/placement => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:47.058808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0919b6a-0ddc-475b-9acf-8ed0549f254a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:47.112269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:47.167102 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0919b6a-0ddc-475b-9acf-8ed0549f254a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:47.200737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63252815-d7d9-474e-b56b-5d2922398ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:47.201395 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63252815-d7d9-474e-b56b-5d2922398ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:47.201677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63252815-d7d9-474e-b56b-5d2922398ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:47.202024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63252815-d7d9-474e-b56b-5d2922398ba4 None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:47.202797 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63252815-d7d9-474e-b56b-5d2922398ba4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:47.203109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63252815-d7d9-474e-b56b-5d2922398ba4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:47.204551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63252815-d7d9-474e-b56b-5d2922398ba4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:47.222137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 606/1227] 10.222.0.40 () {56 vars in 1143 bytes} [Fri Jul 15 19:19:47 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:47.228999 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b623b-3093-4e29-8536-26974f521f5f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:47.330366 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6b623b-3093-4e29-8536-26974f521f5f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:47.363919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09adb06-619f-4a1f-b14e-3cfdf4a28219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:47.364698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09adb06-619f-4a1f-b14e-3cfdf4a28219 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:47.364978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09adb06-619f-4a1f-b14e-3cfdf4a28219 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:47.365251 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09adb06-619f-4a1f-b14e-3cfdf4a28219 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:47.375890 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09adb06-619f-4a1f-b14e-3cfdf4a28219 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:47.377333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09adb06-619f-4a1f-b14e-3cfdf4a28219 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:47.395667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-d09adb06-619f-4a1f-b14e-3cfdf4a28219 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:47.395667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:47.395667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:47.395667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:47.395667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:47.395667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:47.395667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:47.395667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:47.395667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:47.395667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:47.395667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:47.395667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:47.395667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:19:47.395667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:19:47.395667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:19:47.396795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:19:47.396795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:47.396795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:47.396795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:47.396795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:47.396795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:47.396795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:47.396795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:47.396795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:47.396795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:47.396795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:47.396795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:47.396795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:47.396795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:47.396795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:47.396795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:47.396795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:47.397892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:19:47.397892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:19:47.397892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:47.397892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:19:47.397892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 622/1228] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:19:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:47.404499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63252815-d7d9-474e-b56b-5d2922398ba4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:47.503145 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63252815-d7d9-474e-b56b-5d2922398ba4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:47.505447 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:47.539091 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bb2f4-6582-4aa2-a8bd-e1b266235d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:47.539786 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bb2f4-6582-4aa2-a8bd-e1b266235d1f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:47.540069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bb2f4-6582-4aa2-a8bd-e1b266235d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:47.540410 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4bb2f4-6582-4aa2-a8bd-e1b266235d1f None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:47.541311 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bb2f4-6582-4aa2-a8bd-e1b266235d1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:47.541620 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bb2f4-6582-4aa2-a8bd-e1b266235d1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:47.543006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4bb2f4-6582-4aa2-a8bd-e1b266235d1f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:47.554502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 607/1229] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:19:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:47.560818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09adb06-619f-4a1f-b14e-3cfdf4a28219 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:47.569653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:47.661326 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09adb06-619f-4a1f-b14e-3cfdf4a28219 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:47.694554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e392d5-46e2-4717-8412-eced633fc81f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:47.695365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e392d5-46e2-4717-8412-eced633fc81f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:47.695648 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e392d5-46e2-4717-8412-eced633fc81f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:47.695919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e392d5-46e2-4717-8412-eced633fc81f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:47.703263 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e392d5-46e2-4717-8412-eced633fc81f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:47.705161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e392d5-46e2-4717-8412-eced633fc81f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:47.720476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-f2e392d5-46e2-4717-8412-eced633fc81f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:19:47.720476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:47.720476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:47.720476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:47.720476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:47.720476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:47.720476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:47.720476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:47.720476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:47.720476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:47.720476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:47.720476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:47.720476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:19:47.720476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:19:47.720476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:19:47.737261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:19:47.737261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:47.737261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:47.737261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:47.737261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:47.737261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:47.737261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:47.737261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:47.737261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:47.737261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:47.737261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:47.737261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:47.737261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:47.737261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:47.737261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:47.737261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:47.737261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:47.738369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:19:47.738369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:19:47.738369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:19:47.738369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:19:47.738369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:19:47.738369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:19:47.738369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:19:47.738369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:19:47.738369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 623/1230] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:19:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:47.738987 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bb2f4-6582-4aa2-a8bd-e1b266235d1f None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:47.830861 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4bb2f4-6582-4aa2-a8bd-e1b266235d1f None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:47.864838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fe25ac-c7ec-423f-9c08-fa5266bff44b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:47.865490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe25ac-c7ec-423f-9c08-fa5266bff44b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:47.865779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe25ac-c7ec-423f-9c08-fa5266bff44b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:47.866052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fe25ac-c7ec-423f-9c08-fa5266bff44b None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:47.866857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe25ac-c7ec-423f-9c08-fa5266bff44b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:47.867171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe25ac-c7ec-423f-9c08-fa5266bff44b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:47.868662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35fe25ac-c7ec-423f-9c08-fa5266bff44b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:47.880559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 608/1231] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:19:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:47.887733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e392d5-46e2-4717-8412-eced633fc81f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:47.956170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:47.991712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e392d5-46e2-4717-8412-eced633fc81f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:48.025756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8582d-078f-4951-a605-630ce5dde432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:48.026639 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8582d-078f-4951-a605-630ce5dde432 None admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:48.026949 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8582d-078f-4951-a605-630ce5dde432 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:48.027224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8582d-078f-4951-a605-630ce5dde432 None admin] PATH_INFO: `/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/ad68d871464f4b5588c22070205f159e/roles/579726a957a7468abecab3fbdb4351a9` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:48.042060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8582d-078f-4951-a605-630ce5dde432 None admin] RBAC: Authorizing `identity:create_grant(project_id=861de78bbfe84bd991c3ab54e85573a7, user_id=ad68d871464f4b5588c22070205f159e, role_id=579726a957a7468abecab3fbdb4351a9)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:48.043554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8582d-078f-4951-a605-630ce5dde432 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:48.138360 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 624/1232] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:19:47 2022] PUT /identity/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/ad68d871464f4b5588c22070205f159e/roles/579726a957a7468abecab3fbdb4351a9 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:19:50.130374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5ff4b-8b20-4bb7-8f23-5005329ff40b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:50.130920 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5ff4b-8b20-4bb7-8f23-5005329ff40b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:50.131056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d5ff4b-8b20-4bb7-8f23-5005329ff40b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:50.132560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 609/1233] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:19:50.137832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7bdac-c9a6-4bee-a556-2dd7e9ecac79 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:50.138269 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7bdac-c9a6-4bee-a556-2dd7e9ecac79 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:50.138376 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e7bdac-c9a6-4bee-a556-2dd7e9ecac79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:50.155372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c3e7bdac-c9a6-4bee-a556-2dd7e9ecac79 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:19:50.156557 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c3e7bdac-c9a6-4bee-a556-2dd7e9ecac79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:19:50.224397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 625/1234] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:19:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:19:50.247801 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5ff4b-8b20-4bb7-8f23-5005329ff40b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:50.273681 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:50.349157 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d5ff4b-8b20-4bb7-8f23-5005329ff40b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:50.381977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03290631-9989-4694-8ea6-94d8e2ab1b5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:50.383075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03290631-9989-4694-8ea6-94d8e2ab1b5d None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:50.383360 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03290631-9989-4694-8ea6-94d8e2ab1b5d None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:50.383635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03290631-9989-4694-8ea6-94d8e2ab1b5d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:50.394480 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03290631-9989-4694-8ea6-94d8e2ab1b5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:19:50.402815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-03290631-9989-4694-8ea6-94d8e2ab1b5d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:19:50.402815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:50.402815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:50.402815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:50.402815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:50.402815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:50.402815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:50.402815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:50.402815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:50.402815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:50.402815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:50.402815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:50.402815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:19:50.402815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:19:50.402815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:19:50.402815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:19:50.404515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:19:50.404515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:19:50.404515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:19:50.404515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:19:50.404515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:50.404515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:50.404515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:50.404515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:50.404515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:50.404515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:50.404515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:50.404515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:50.404515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:50.404515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:50.404515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:50.404515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:50.405957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:50.405957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:50.405957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:50.405957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:50.405957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:19:50.405957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:19:50.405957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:19:50.405957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:19:50.405957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:19:50.405957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:19:50.405957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 15 19:19:50.405957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:19:50.405957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 610/1235] 10.222.0.40 () {56 vars in 1102 bytes} [Fri Jul 15 19:19:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:50.410284 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7bdac-c9a6-4bee-a556-2dd7e9ecac79 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:50.457107 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:50.510071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e7bdac-c9a6-4bee-a556-2dd7e9ecac79 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:50.544363 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de5753-778a-492b-85ab-b70f382a084b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:50.545015 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de5753-778a-492b-85ab-b70f382a084b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:50.545299 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de5753-778a-492b-85ab-b70f382a084b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:50.545576 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30de5753-778a-492b-85ab-b70f382a084b None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:50.546318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de5753-778a-492b-85ab-b70f382a084b None admin] RBAC: Adding query filter params (name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:50.546621 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de5753-778a-492b-85ab-b70f382a084b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:50.548015 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30de5753-778a-492b-85ab-b70f382a084b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:50.558789 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 626/1236] 10.222.0.40 () {56 vars in 1103 bytes} [Fri Jul 15 19:19:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:50.562615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03290631-9989-4694-8ea6-94d8e2ab1b5d None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:50.649024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:50.665365 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03290631-9989-4694-8ea6-94d8e2ab1b5d None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:50.699049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c40c92-c2a9-40e3-b85e-02dcb236b41a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:50.699834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c40c92-c2a9-40e3-b85e-02dcb236b41a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:50.700116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c40c92-c2a9-40e3-b85e-02dcb236b41a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:50.700390 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c40c92-c2a9-40e3-b85e-02dcb236b41a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:50.710651 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c40c92-c2a9-40e3-b85e-02dcb236b41a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:50.712725 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c40c92-c2a9-40e3-b85e-02dcb236b41a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:50.730675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-26c40c92-c2a9-40e3-b85e-02dcb236b41a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:50.730675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:50.730675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:50.730675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:50.730675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:50.730675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:50.730675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:50.730675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:50.730675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:50.730675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:50.730675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:50.730675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:50.730675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:19:50.730675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:19:50.730675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:19:50.731880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:19:50.731880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:50.731880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:50.731880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:50.731880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:50.731880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:50.731880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:50.731880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:50.731880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:50.731880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:50.731880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:50.731880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:50.731880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:50.731880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:50.731880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:50.731880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:50.731880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:50.732859 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:19:50.732859 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:19:50.732859 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:50.732859 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:19:50.732859 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 611/1237] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:19:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:19:50.738015 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de5753-778a-492b-85ab-b70f382a084b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:50.836850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30de5753-778a-492b-85ab-b70f382a084b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:50.846573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:50.871102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411600d-6a67-4ed2-a400-a28c7d58f6d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:50.871756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411600d-6a67-4ed2-a400-a28c7d58f6d3 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:50.872037 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411600d-6a67-4ed2-a400-a28c7d58f6d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:50.872348 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1411600d-6a67-4ed2-a400-a28c7d58f6d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:50.873071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411600d-6a67-4ed2-a400-a28c7d58f6d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:50.873395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411600d-6a67-4ed2-a400-a28c7d58f6d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:50.874724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1411600d-6a67-4ed2-a400-a28c7d58f6d3 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:50.887477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 627/1238] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:19:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:50.893557 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c40c92-c2a9-40e3-b85e-02dcb236b41a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:50.996253 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c40c92-c2a9-40e3-b85e-02dcb236b41a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:51.031398 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad81d8a-2e18-4ce0-af8a-5f62d7acaaa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:51.032190 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad81d8a-2e18-4ce0-af8a-5f62d7acaaa6 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:51.032473 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad81d8a-2e18-4ce0-af8a-5f62d7acaaa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:51.032751 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad81d8a-2e18-4ce0-af8a-5f62d7acaaa6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:51.035441 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:51.040198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad81d8a-2e18-4ce0-af8a-5f62d7acaaa6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:51.041647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad81d8a-2e18-4ce0-af8a-5f62d7acaaa6 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:51.056779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-4ad81d8a-2e18-4ce0-af8a-5f62d7acaaa6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:19:51.056779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:51.056779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:51.056779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:51.056779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:51.056779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:51.056779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:51.056779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:51.056779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:51.056779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:51.056779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:51.056779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:51.056779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:19:51.056779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:19:51.056779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:19:51.056779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:51.058520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:51.060379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:51.060379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:51.060379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:19:51.060379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:19:51.060379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:19:51.060379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:19:51.060379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:19:51.060379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:19:51.060379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:19:51.060379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:19:51.060379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 612/1239] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:19:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:51.064022 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411600d-6a67-4ed2-a400-a28c7d58f6d3 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:51.166109 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1411600d-6a67-4ed2-a400-a28c7d58f6d3 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:51.204052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062afce6-3fa1-4e4d-96e4-a0046349e64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:51.204772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062afce6-3fa1-4e4d-96e4-a0046349e64b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:51.205058 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062afce6-3fa1-4e4d-96e4-a0046349e64b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:51.205333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062afce6-3fa1-4e4d-96e4-a0046349e64b None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:51.206373 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062afce6-3fa1-4e4d-96e4-a0046349e64b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:51.206687 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062afce6-3fa1-4e4d-96e4-a0046349e64b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:51.208215 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062afce6-3fa1-4e4d-96e4-a0046349e64b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:51.229544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 628/1240] 10.222.0.40 () {56 vars in 1143 bytes} [Fri Jul 15 19:19:51 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:19:51.235873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad81d8a-2e18-4ce0-af8a-5f62d7acaaa6 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:51.345293 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad81d8a-2e18-4ce0-af8a-5f62d7acaaa6 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:51.379944 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79325aa1-1405-4dab-97ab-faa675494aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:51.383811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79325aa1-1405-4dab-97ab-faa675494aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:51.383811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79325aa1-1405-4dab-97ab-faa675494aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:51.383811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79325aa1-1405-4dab-97ab-faa675494aa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:51.443270 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:51.450442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79325aa1-1405-4dab-97ab-faa675494aa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:51.451971 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79325aa1-1405-4dab-97ab-faa675494aa3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:51.549521 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 613/1241] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:19:51 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:19:51.555513 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062afce6-3fa1-4e4d-96e4-a0046349e64b None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:51.584157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:51.653739 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062afce6-3fa1-4e4d-96e4-a0046349e64b None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:51.688380 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6bd73-0cb8-4016-a3de-af37c532aa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:51.689166 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6bd73-0cb8-4016-a3de-af37c532aa74 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:51.689452 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6bd73-0cb8-4016-a3de-af37c532aa74 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:51.689728 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc6bd73-0cb8-4016-a3de-af37c532aa74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:51.699966 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6bd73-0cb8-4016-a3de-af37c532aa74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:51.701393 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc6bd73-0cb8-4016-a3de-af37c532aa74 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:51.719140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-2bc6bd73-0cb8-4016-a3de-af37c532aa74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:51.719140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:51.719140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:51.719140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:51.719140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:51.719140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:51.719140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:51.719140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:51.719140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:51.719140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:51.719140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:51.719140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:51.719140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:19:51.719140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:19:51.719140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:19:51.739763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:19:51.739763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:51.739763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:51.739763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:51.739763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:51.739763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:51.739763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:51.739763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:51.739763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:51.739763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:51.739763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:51.739763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:51.739763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:51.739763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:51.739763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:51.739763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:51.739763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:51.740704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:19:51.740704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:19:51.740704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:51.740704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:19:51.740704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 629/1242] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:19:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:51.740991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79325aa1-1405-4dab-97ab-faa675494aa3 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:51.820580 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:51.826600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79325aa1-1405-4dab-97ab-faa675494aa3 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:51.861198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4014cd9-e32d-4165-b7eb-be90760541d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:51.861856 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4014cd9-e32d-4165-b7eb-be90760541d1 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:51.862141 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4014cd9-e32d-4165-b7eb-be90760541d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:51.862420 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4014cd9-e32d-4165-b7eb-be90760541d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:51.863196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4014cd9-e32d-4165-b7eb-be90760541d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:51.863492 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4014cd9-e32d-4165-b7eb-be90760541d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:51.864875 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4014cd9-e32d-4165-b7eb-be90760541d1 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:51.877126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 614/1243] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:19:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:51.883175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6bd73-0cb8-4016-a3de-af37c532aa74 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:51.962968 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:51.984618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc6bd73-0cb8-4016-a3de-af37c532aa74 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:52.020342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1490f0-f1ba-47dc-88dc-453f5c773ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:52.021124 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1490f0-f1ba-47dc-88dc-453f5c773ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:52.021408 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1490f0-f1ba-47dc-88dc-453f5c773ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:52.021684 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1490f0-f1ba-47dc-88dc-453f5c773ae9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:52.031160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1490f0-f1ba-47dc-88dc-453f5c773ae9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:52.032627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1490f0-f1ba-47dc-88dc-453f5c773ae9 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:52.046996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-db1490f0-f1ba-47dc-88dc-453f5c773ae9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:19:52.046996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:52.046996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:52.046996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:52.046996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:52.046996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:52.046996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:52.046996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:52.046996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:52.046996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:52.046996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:52.046996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:52.046996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:19:52.046996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:19:52.046996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:19:52.048698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:19:52.048698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:52.048698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:52.048698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:52.048698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:52.048698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:52.048698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:52.048698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:52.048698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:52.048698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:52.048698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:52.048698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:52.048698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:52.048698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:52.048698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:52.048698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:52.048698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:52.049880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:19:52.049880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:19:52.049880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:19:52.049880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:19:52.049880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:19:52.049880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:19:52.049880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:19:52.049880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:19:52.051000 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 630/1244] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:19:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:52.054149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4014cd9-e32d-4165-b7eb-be90760541d1 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:52.157362 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4014cd9-e32d-4165-b7eb-be90760541d1 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:52.192369 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e572e1-0d73-41ed-b834-4dbc9b6097de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:52.193018 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e572e1-0d73-41ed-b834-4dbc9b6097de None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:52.193307 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e572e1-0d73-41ed-b834-4dbc9b6097de None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:52.193588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e572e1-0d73-41ed-b834-4dbc9b6097de None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:52.194451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e572e1-0d73-41ed-b834-4dbc9b6097de None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:52.194773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e572e1-0d73-41ed-b834-4dbc9b6097de None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:52.196245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e572e1-0d73-41ed-b834-4dbc9b6097de None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:52.209182 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 615/1245] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:19:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:52.215719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1490f0-f1ba-47dc-88dc-453f5c773ae9 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:52.318604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1490f0-f1ba-47dc-88dc-453f5c773ae9 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:52.352158 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e382d158-9a14-4824-adb3-0a86355e65fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:52.353368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382d158-9a14-4824-adb3-0a86355e65fe None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:52.353939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382d158-9a14-4824-adb3-0a86355e65fe None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:52.354397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e382d158-9a14-4824-adb3-0a86355e65fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:52.355076 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382d158-9a14-4824-adb3-0a86355e65fe None admin] RBAC: Adding query filter params (role.id=579726a957a7468abecab3fbdb4351a9, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=ad68d871464f4b5588c22070205f159e) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:52.355390 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382d158-9a14-4824-adb3-0a86355e65fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:52.356826 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e382d158-9a14-4824-adb3-0a86355e65fe None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:52.362779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 631/1246] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:19:52 2022] GET /identity/v3/role_assignments?user.id=ad68d871464f4b5588c22070205f159e&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=579726a957a7468abecab3fbdb4351a9 => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:54.460068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa940e-1a17-47f2-86f8-2e9a07119e84 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:54.460600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa940e-1a17-47f2-86f8-2e9a07119e84 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:54.460757 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aa940e-1a17-47f2-86f8-2e9a07119e84 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:54.462442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 616/1247] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:19:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:19:54.467964 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d6c34-2fe7-4143-8e6d-384d2aa4a2fc None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:54.468433 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d6c34-2fe7-4143-8e6d-384d2aa4a2fc None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:54.468599 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12d6c34-2fe7-4143-8e6d-384d2aa4a2fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:54.473658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:54.486345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d12d6c34-2fe7-4143-8e6d-384d2aa4a2fc None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:19:54.489882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d12d6c34-2fe7-4143-8e6d-384d2aa4a2fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:19:54.555185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 632/1248] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:19:54 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:19:54.579587 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa940e-1a17-47f2-86f8-2e9a07119e84 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:54.598103 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:54.681922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aa940e-1a17-47f2-86f8-2e9a07119e84 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:54.715838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefecc6f-535d-4dbd-93ea-599e7bfa06fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:54.716556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefecc6f-535d-4dbd-93ea-599e7bfa06fe None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:54.716840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefecc6f-535d-4dbd-93ea-599e7bfa06fe None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:54.717119 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefecc6f-535d-4dbd-93ea-599e7bfa06fe None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:54.728168 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefecc6f-535d-4dbd-93ea-599e7bfa06fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:19:54.735832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-fefecc6f-535d-4dbd-93ea-599e7bfa06fe None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:19:54.735832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:54.735832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:54.735832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:54.735832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:54.735832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:54.735832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:54.735832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:54.735832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:54.735832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:54.735832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:54.735832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:54.735832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:19:54.735832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:19:54.735832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:19:54.735832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:19:54.737100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:19:54.737100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:19:54.737100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:19:54.737100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:19:54.737100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:54.737100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:54.737100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:54.737100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:54.737100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:54.737100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:54.737100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:54.737100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:54.737100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:54.737100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:54.737100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:54.737100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:54.738314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:54.738314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:54.738314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:54.738314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:54.738314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:19:54.738314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:19:54.738314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:19:54.738314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:19:54.738314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:19:54.738314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:19:54.738314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:19:54.738314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:19:54.738314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 617/1249] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:19:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:54.748282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d6c34-2fe7-4143-8e6d-384d2aa4a2fc None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:54.842842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12d6c34-2fe7-4143-8e6d-384d2aa4a2fc None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:54.873874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:54.878771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166c379-3896-45c1-b876-8e71b087b3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:54.879447 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166c379-3896-45c1-b876-8e71b087b3bc None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:54.879728 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166c379-3896-45c1-b876-8e71b087b3bc None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:54.880004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3166c379-3896-45c1-b876-8e71b087b3bc None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:54.880748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166c379-3896-45c1-b876-8e71b087b3bc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:54.881056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166c379-3896-45c1-b876-8e71b087b3bc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:54.882724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3166c379-3896-45c1-b876-8e71b087b3bc None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:54.891726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 633/1250] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:19:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:54.897703 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefecc6f-535d-4dbd-93ea-599e7bfa06fe None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:54.982127 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:55.005827 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefecc6f-535d-4dbd-93ea-599e7bfa06fe None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:55.039427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f916c-aa24-40a1-a0d2-acbbc2a9fbd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:55.040243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f916c-aa24-40a1-a0d2-acbbc2a9fbd8 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:55.040520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f916c-aa24-40a1-a0d2-acbbc2a9fbd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:55.040798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b9f916c-aa24-40a1-a0d2-acbbc2a9fbd8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:55.051290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f916c-aa24-40a1-a0d2-acbbc2a9fbd8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:55.052733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b9f916c-aa24-40a1-a0d2-acbbc2a9fbd8 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:55.070279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-6b9f916c-aa24-40a1-a0d2-acbbc2a9fbd8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:55.070279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:55.070279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:55.070279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:55.070279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:55.070279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:55.070279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:55.070279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:55.070279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:55.070279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:55.070279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:55.070279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:55.070279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:19:55.070279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:19:55.070279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:19:55.071936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:19:55.071936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:55.071936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:55.071936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:55.071936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:55.071936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:55.071936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:55.071936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:55.071936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:55.071936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:55.071936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:55.071936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:55.071936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:55.071936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:55.071936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:55.071936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:55.071936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:55.072871 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:19:55.072871 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:19:55.072871 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:55.072871 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:19:55.077042 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 618/1251] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:19:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:55.078213 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166c379-3896-45c1-b876-8e71b087b3bc None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:55.181437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3166c379-3896-45c1-b876-8e71b087b3bc None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:55.216185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92dbf09-6601-481e-ae4b-dcbf226eba2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:55.216852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dbf09-6601-481e-ae4b-dcbf226eba2c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:55.217138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dbf09-6601-481e-ae4b-dcbf226eba2c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:55.217415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92dbf09-6601-481e-ae4b-dcbf226eba2c None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:55.218136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92dbf09-6601-481e-ae4b-dcbf226eba2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:55.218445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92dbf09-6601-481e-ae4b-dcbf226eba2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:55.219850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92dbf09-6601-481e-ae4b-dcbf226eba2c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:55.232801 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 634/1252] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:19:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:55.238475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f916c-aa24-40a1-a0d2-acbbc2a9fbd8 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:55.341190 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b9f916c-aa24-40a1-a0d2-acbbc2a9fbd8 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:55.368113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:55.376431 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fd18b-3e5b-4688-9e1c-e49d873a5ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:55.377284 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fd18b-3e5b-4688-9e1c-e49d873a5ff4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:55.377566 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fd18b-3e5b-4688-9e1c-e49d873a5ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:55.377840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-650fd18b-3e5b-4688-9e1c-e49d873a5ff4 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:55.385818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fd18b-3e5b-4688-9e1c-e49d873a5ff4 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:55.387388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-650fd18b-3e5b-4688-9e1c-e49d873a5ff4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:55.401915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-650fd18b-3e5b-4688-9e1c-e49d873a5ff4 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:19:55.401915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:55.401915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:55.401915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:55.401915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:55.401915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:55.401915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:55.401915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:55.401915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:55.401915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:55.401915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:55.401915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:55.401915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:19:55.401915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:19:55.401915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:19:55.401915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:55.403173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:55.404154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:55.404154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:55.404154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:19:55.404154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:19:55.404154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:19:55.404154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:19:55.404154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:19:55.404154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:19:55.404154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:19:55.404154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:19:55.404154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 619/1253] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:19:55 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:55.409268 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92dbf09-6601-481e-ae4b-dcbf226eba2c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:55.466106 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:55.512148 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92dbf09-6601-481e-ae4b-dcbf226eba2c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:55.547490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367d547-d69d-4fe2-bf38-3514b726d26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:55.548192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367d547-d69d-4fe2-bf38-3514b726d26f None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:55.548516 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367d547-d69d-4fe2-bf38-3514b726d26f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:55.548790 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f367d547-d69d-4fe2-bf38-3514b726d26f None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:55.549629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367d547-d69d-4fe2-bf38-3514b726d26f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:55.549941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367d547-d69d-4fe2-bf38-3514b726d26f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:55.551415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f367d547-d69d-4fe2-bf38-3514b726d26f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:55.569068 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 635/1254] 10.222.0.40 () {56 vars in 1143 bytes} [Fri Jul 15 19:19:55 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:55.575731 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fd18b-3e5b-4688-9e1c-e49d873a5ff4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:55.677810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-650fd18b-3e5b-4688-9e1c-e49d873a5ff4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:55.713334 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c6f36-397a-4181-87bf-65673073225b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:55.714014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c6f36-397a-4181-87bf-65673073225b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:55.714292 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c6f36-397a-4181-87bf-65673073225b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:55.714564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60c6f36-397a-4181-87bf-65673073225b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:55.772939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:55.785092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c6f36-397a-4181-87bf-65673073225b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:55.786634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60c6f36-397a-4181-87bf-65673073225b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:55.885466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 620/1255] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:19:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:19:55.891317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367d547-d69d-4fe2-bf38-3514b726d26f None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:55.991148 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f367d547-d69d-4fe2-bf38-3514b726d26f None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:56.004631 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:56.025971 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2db282-9585-44f5-a98c-3f43ac1f917c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:56.026690 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2db282-9585-44f5-a98c-3f43ac1f917c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:56.027011 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2db282-9585-44f5-a98c-3f43ac1f917c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:56.027288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2db282-9585-44f5-a98c-3f43ac1f917c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:56.037597 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2db282-9585-44f5-a98c-3f43ac1f917c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:56.039067 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e2db282-9585-44f5-a98c-3f43ac1f917c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:56.057780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-9e2db282-9585-44f5-a98c-3f43ac1f917c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:56.057780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:56.057780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:56.057780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:56.057780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:56.057780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:56.057780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:56.057780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:56.057780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:56.057780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:56.057780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:56.057780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:56.057780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:19:56.057780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:19:56.057780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:19:56.064528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:19:56.064528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:56.064528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:56.064528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:56.064528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:56.064528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:56.064528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:56.064528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:56.064528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:56.064528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:56.064528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:56.064528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:56.064528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:56.064528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:56.064528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:56.064528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:56.064528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:56.065522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:19:56.065522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:19:56.065522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:56.065522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:19:56.065522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 636/1256] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:19:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:56.065808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c6f36-397a-4181-87bf-65673073225b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:56.152286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:56.163875 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60c6f36-397a-4181-87bf-65673073225b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:56.199089 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9789f6-0893-4824-a19f-fd72bb9e6118 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:56.199738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9789f6-0893-4824-a19f-fd72bb9e6118 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:56.200017 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9789f6-0893-4824-a19f-fd72bb9e6118 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:56.200287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd9789f6-0893-4824-a19f-fd72bb9e6118 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:56.200994 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9789f6-0893-4824-a19f-fd72bb9e6118 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:56.201293 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9789f6-0893-4824-a19f-fd72bb9e6118 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:56.202639 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd9789f6-0893-4824-a19f-fd72bb9e6118 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:56.214352 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 621/1257] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:19:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:56.220004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2db282-9585-44f5-a98c-3f43ac1f917c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:56.320721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e2db282-9585-44f5-a98c-3f43ac1f917c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:56.354473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a30b71-7608-49b2-bc69-99c235a5de7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:56.355318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a30b71-7608-49b2-bc69-99c235a5de7e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:56.355597 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a30b71-7608-49b2-bc69-99c235a5de7e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:56.355872 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a30b71-7608-49b2-bc69-99c235a5de7e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:56.362415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a30b71-7608-49b2-bc69-99c235a5de7e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:56.363873 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a30b71-7608-49b2-bc69-99c235a5de7e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:56.377228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-79a30b71-7608-49b2-bc69-99c235a5de7e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:19:56.377228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:56.377228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:56.377228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:56.377228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:56.377228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:56.377228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:56.377228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:56.377228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:56.377228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:56.377228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:56.377228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:56.377228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:19:56.377228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:19:56.377228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:19:56.378308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:19:56.378308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:56.378308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:56.378308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:56.378308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:56.378308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:56.378308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:56.378308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:56.378308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:56.378308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:56.378308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:56.378308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:56.378308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:56.378308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:56.378308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:56.378308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:56.378308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:56.379312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:19:56.379312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:19:56.379312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:19:56.379312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:19:56.379312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:19:56.379312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:19:56.379312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:19:56.379312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:19:56.379312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 637/1258] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:19:56 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:56.384807 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9789f6-0893-4824-a19f-fd72bb9e6118 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:56.487295 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd9789f6-0893-4824-a19f-fd72bb9e6118 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:56.537409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43889a93-bc1e-4b18-8343-6eda1a7a9957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:56.538059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889a93-bc1e-4b18-8343-6eda1a7a9957 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:56.538342 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889a93-bc1e-4b18-8343-6eda1a7a9957 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:56.538612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43889a93-bc1e-4b18-8343-6eda1a7a9957 None admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:56.539424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43889a93-bc1e-4b18-8343-6eda1a7a9957 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:56.539732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43889a93-bc1e-4b18-8343-6eda1a7a9957 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:56.541709 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43889a93-bc1e-4b18-8343-6eda1a7a9957 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:56.553991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 622/1259] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:19:56 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:56.560402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a30b71-7608-49b2-bc69-99c235a5de7e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:56.587504 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:56.662567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a30b71-7608-49b2-bc69-99c235a5de7e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:56.696641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a257773b-359e-46c1-9435-9dcf77ffc46b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:56.697263 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257773b-359e-46c1-9435-9dcf77ffc46b None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:56.697552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257773b-359e-46c1-9435-9dcf77ffc46b None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:56.697793 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a257773b-359e-46c1-9435-9dcf77ffc46b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:56.698617 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257773b-359e-46c1-9435-9dcf77ffc46b None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=ad68d871464f4b5588c22070205f159e) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:56.698957 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257773b-359e-46c1-9435-9dcf77ffc46b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:56.700377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a257773b-359e-46c1-9435-9dcf77ffc46b None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:56.705862 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 638/1260] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:19:56 2022] GET /identity/v3/role_assignments?user.id=ad68d871464f4b5588c22070205f159e&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:58.697504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4c646-7616-4762-b30c-f0e75693b0b6 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:58.698114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4c646-7616-4762-b30c-f0e75693b0b6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:58.698114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd4c646-7616-4762-b30c-f0e75693b0b6 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:58.700849 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 623/1261] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:19:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:19:58.706046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d4cdf-1438-48bc-855a-f96cd7735f78 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:58.706462 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d4cdf-1438-48bc-855a-f96cd7735f78 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:58.706588 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83d4cdf-1438-48bc-855a-f96cd7735f78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:58.723452 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-b83d4cdf-1438-48bc-855a-f96cd7735f78 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:19:58.724625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b83d4cdf-1438-48bc-855a-f96cd7735f78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:19:58.792860 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 639/1262] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:19:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:19:58.815614 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4c646-7616-4762-b30c-f0e75693b0b6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:58.827819 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:58.918681 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd4c646-7616-4762-b30c-f0e75693b0b6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:58.953131 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1b9e9-1406-46fb-a4cc-cb15c976baea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:58.953821 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1b9e9-1406-46fb-a4cc-cb15c976baea None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:58.954191 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1b9e9-1406-46fb-a4cc-cb15c976baea None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:58.954357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b1b9e9-1406-46fb-a4cc-cb15c976baea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:58.964833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b1b9e9-1406-46fb-a4cc-cb15c976baea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:19:58.972396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-84b1b9e9-1406-46fb-a4cc-cb15c976baea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:19:58.972396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:58.972396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:58.972396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:58.972396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:58.972396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:58.972396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:58.972396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:58.972396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:58.972396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:58.972396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:58.972396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:58.972396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:19:58.972396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:19:58.972396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:19:58.972396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:19:58.976838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:19:58.976838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:19:58.976838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:19:58.976838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:19:58.976838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:58.976838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:58.976838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:58.976838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:58.976838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:58.976838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:58.976838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:58.976838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:58.976838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:58.976838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:58.976838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:58.976838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:58.978716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:58.978716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:58.978716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:58.978716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:58.978716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:19:58.978716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:19:58.978716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:19:58.978716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:19:58.978716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:19:58.978716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:19:58.978716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:19:58.978716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:19:58.978716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 624/1263] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:19:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:58.980554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d4cdf-1438-48bc-855a-f96cd7735f78 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:58.999880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:59.081920 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83d4cdf-1438-48bc-855a-f96cd7735f78 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:59.117199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16e5a0-10df-4a37-b4f2-d18aa7f34aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:59.117892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16e5a0-10df-4a37-b4f2-d18aa7f34aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:59.118818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16e5a0-10df-4a37-b4f2-d18aa7f34aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:59.119101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d16e5a0-10df-4a37-b4f2-d18aa7f34aa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:59.119876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16e5a0-10df-4a37-b4f2-d18aa7f34aa4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:59.120560 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16e5a0-10df-4a37-b4f2-d18aa7f34aa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:59.122276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d16e5a0-10df-4a37-b4f2-d18aa7f34aa4 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:59.131396 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 640/1264] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:19:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:59.137778 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1b9e9-1406-46fb-a4cc-cb15c976baea None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:59.206670 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:59.239880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b1b9e9-1406-46fb-a4cc-cb15c976baea None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:59.273243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4e43d-4410-4f66-b7f7-9dbfd45b4e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:59.274027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4e43d-4410-4f66-b7f7-9dbfd45b4e8b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:59.274856 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4e43d-4410-4f66-b7f7-9dbfd45b4e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:59.275133 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af4e43d-4410-4f66-b7f7-9dbfd45b4e8b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:59.286290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4e43d-4410-4f66-b7f7-9dbfd45b4e8b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:59.287782 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2af4e43d-4410-4f66-b7f7-9dbfd45b4e8b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:59.307310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-2af4e43d-4410-4f66-b7f7-9dbfd45b4e8b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:59.307310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:59.307310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:59.307310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:59.307310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:59.307310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:59.307310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:59.307310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:59.307310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:59.307310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:59.307310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:59.307310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:59.307310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:19:59.307310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:19:59.307310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:19:59.308265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:19:59.308265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:59.308265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:59.308265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:59.308265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:59.308265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:59.308265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:59.308265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:59.308265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:59.308265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:59.308265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:59.308265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:59.308265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:59.308265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:59.308265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:59.308265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:59.308265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:59.309234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:19:59.309234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:19:59.309234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:59.309234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:19:59.309234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 625/1265] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:59.314368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16e5a0-10df-4a37-b4f2-d18aa7f34aa4 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:59.397011 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:59.416114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d16e5a0-10df-4a37-b4f2-d18aa7f34aa4 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:59.451394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f19af-5608-4389-9c35-fea2378fb09a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:59.452061 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f19af-5608-4389-9c35-fea2378fb09a None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:59.452347 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f19af-5608-4389-9c35-fea2378fb09a None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:59.452625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514f19af-5608-4389-9c35-fea2378fb09a None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:59.453353 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f19af-5608-4389-9c35-fea2378fb09a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:59.453669 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f19af-5608-4389-9c35-fea2378fb09a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:59.455124 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514f19af-5608-4389-9c35-fea2378fb09a None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:59.466863 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 641/1266] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:59.472724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4e43d-4410-4f66-b7f7-9dbfd45b4e8b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:59.575560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af4e43d-4410-4f66-b7f7-9dbfd45b4e8b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:59.595669 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:59.610089 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6aa2d-f6d1-4354-b822-72577b8e8980 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:59.610907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6aa2d-f6d1-4354-b822-72577b8e8980 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:59.611195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6aa2d-f6d1-4354-b822-72577b8e8980 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:59.611473 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef6aa2d-f6d1-4354-b822-72577b8e8980 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:59.619323 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6aa2d-f6d1-4354-b822-72577b8e8980 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:59.620771 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef6aa2d-f6d1-4354-b822-72577b8e8980 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:59.635902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-4ef6aa2d-f6d1-4354-b822-72577b8e8980 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:19:59.635902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:59.635902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:59.635902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:59.635902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:59.635902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:59.635902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:59.635902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:59.635902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:59.635902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:59.635902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:59.635902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:59.635902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:19:59.635902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:19:59.635902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:19:59.635902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:59.637071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:59.638260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:59.638260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:59.638260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:19:59.638260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:19:59.638260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:19:59.638260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:19:59.638260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:19:59.638260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:19:59.638260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:19:59.638260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:19:59.638260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 626/1267] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:19:59 2022] GET /identity/v3/users/placement => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:59.654082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f19af-5608-4389-9c35-fea2378fb09a None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:59.747143 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514f19af-5608-4389-9c35-fea2378fb09a None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:59.782258 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32021ee-8105-423a-918a-3fb0b492e946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:59.782947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32021ee-8105-423a-918a-3fb0b492e946 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:59.783231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32021ee-8105-423a-918a-3fb0b492e946 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:59.783516 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32021ee-8105-423a-918a-3fb0b492e946 None admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:59.784346 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32021ee-8105-423a-918a-3fb0b492e946 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:19:59.784669 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32021ee-8105-423a-918a-3fb0b492e946 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:59.786088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32021ee-8105-423a-918a-3fb0b492e946 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:59.795422 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:19:59.803486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 642/1268] 10.222.0.40 () {56 vars in 1143 bytes} [Fri Jul 15 19:19:59 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:19:59.809884 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6aa2d-f6d1-4354-b822-72577b8e8980 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:19:59.914374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef6aa2d-f6d1-4354-b822-72577b8e8980 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:19:59.949432 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af81e8e-4e70-427b-b5dd-17726ceb5ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:19:59.950212 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af81e8e-4e70-427b-b5dd-17726ceb5ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:19:59.950538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af81e8e-4e70-427b-b5dd-17726ceb5ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:19:59.950853 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af81e8e-4e70-427b-b5dd-17726ceb5ed4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:19:59.973704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af81e8e-4e70-427b-b5dd-17726ceb5ed4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:19:59.973704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af81e8e-4e70-427b-b5dd-17726ceb5ed4 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:19:59.980658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-9af81e8e-4e70-427b-b5dd-17726ceb5ed4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:59.980658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:19:59.980658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:19:59.980658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:19:59.980658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:19:59.980658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:19:59.980658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:19:59.980658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:19:59.980658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:19:59.980658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:19:59.980658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:19:59.980658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:19:59.980658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:19:59.980658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:19:59.980658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:19:59.981719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:19:59.981719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:19:59.981719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:19:59.981719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:19:59.981719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:19:59.981719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:19:59.981719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:19:59.981719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:19:59.981719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:19:59.981719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:19:59.981719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:19:59.981719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:19:59.981719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:19:59.981719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:19:59.981719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:19:59.981719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:19:59.981719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:19:59.983056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:19:59.983056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:19:59.983056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:19:59.983056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:19:59.983056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 627/1269] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:19:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:19:59.987729 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32021ee-8105-423a-918a-3fb0b492e946 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:00.095137 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32021ee-8105-423a-918a-3fb0b492e946 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:00.128922 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f812ea-7466-4f53-9fe0-f23bc55fba58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:00.129576 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f812ea-7466-4f53-9fe0-f23bc55fba58 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:00.129859 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f812ea-7466-4f53-9fe0-f23bc55fba58 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:00.130147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f812ea-7466-4f53-9fe0-f23bc55fba58 None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:00.130883 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f812ea-7466-4f53-9fe0-f23bc55fba58 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:00.131192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f812ea-7466-4f53-9fe0-f23bc55fba58 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:00.132800 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f812ea-7466-4f53-9fe0-f23bc55fba58 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:00.144646 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 643/1270] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:19:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:00.150559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af81e8e-4e70-427b-b5dd-17726ceb5ed4 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:00.183781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:00.252263 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af81e8e-4e70-427b-b5dd-17726ceb5ed4 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:00.286506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea814f7-ba30-4cd4-9bda-8ef0c6dbf36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:00.287307 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea814f7-ba30-4cd4-9bda-8ef0c6dbf36b None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:00.287588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea814f7-ba30-4cd4-9bda-8ef0c6dbf36b None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:00.287866 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea814f7-ba30-4cd4-9bda-8ef0c6dbf36b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:00.294558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea814f7-ba30-4cd4-9bda-8ef0c6dbf36b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:00.296017 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea814f7-ba30-4cd4-9bda-8ef0c6dbf36b None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:00.310282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-5ea814f7-ba30-4cd4-9bda-8ef0c6dbf36b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:20:00.310282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:00.310282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:00.310282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:00.310282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:00.310282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:00.310282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:00.310282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:00.310282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:00.310282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:00.310282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:00.310282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:00.310282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:20:00.310282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:20:00.310282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:20:00.311518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:20:00.311518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:00.311518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:00.311518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:00.311518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:00.311518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:00.311518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:00.311518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:00.311518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:00.311518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:00.311518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:00.311518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:00.311518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:00.311518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:00.311518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:00.311518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:00.311518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:00.312615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:20:00.312615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:20:00.312615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:20:00.312615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:20:00.312615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:20:00.312615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:20:00.312615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:20:00.312615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:20:00.312615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 628/1271] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:20:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:00.317418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f812ea-7466-4f53-9fe0-f23bc55fba58 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:00.377728 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:00.419288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f812ea-7466-4f53-9fe0-f23bc55fba58 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:00.453234 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8aa5fd-7980-46a4-8d67-93328de2a58c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:00.453883 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8aa5fd-7980-46a4-8d67-93328de2a58c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:00.454170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8aa5fd-7980-46a4-8d67-93328de2a58c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:00.454442 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8aa5fd-7980-46a4-8d67-93328de2a58c None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:00.455268 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8aa5fd-7980-46a4-8d67-93328de2a58c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:00.455575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8aa5fd-7980-46a4-8d67-93328de2a58c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:00.457054 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8aa5fd-7980-46a4-8d67-93328de2a58c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:00.469286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 644/1272] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:20:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:00.475405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea814f7-ba30-4cd4-9bda-8ef0c6dbf36b None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:00.569249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:00.577991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea814f7-ba30-4cd4-9bda-8ef0c6dbf36b None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:00.612126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eca7c6-12dc-4b82-b58e-a0e882016e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:00.613014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eca7c6-12dc-4b82-b58e-a0e882016e35 None admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:00.613293 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eca7c6-12dc-4b82-b58e-a0e882016e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:00.613562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eca7c6-12dc-4b82-b58e-a0e882016e35 None admin] PATH_INFO: `/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/ad68d871464f4b5588c22070205f159e/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:00.615510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eca7c6-12dc-4b82-b58e-a0e882016e35 None admin] RBAC: Authorizing `identity:create_grant(project_id=861de78bbfe84bd991c3ab54e85573a7, user_id=ad68d871464f4b5588c22070205f159e, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:00.616924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eca7c6-12dc-4b82-b58e-a0e882016e35 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:00.736905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 629/1273] 10.222.0.40 () {58 vars in 1439 bytes} [Fri Jul 15 19:20:00 2022] PUT /identity/v3/projects/861de78bbfe84bd991c3ab54e85573a7/users/ad68d871464f4b5588c22070205f159e/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:20:02.785236 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a173e4d-8776-4a14-bd00-8d2351219a61 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:02.785791 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a173e4d-8776-4a14-bd00-8d2351219a61 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:02.785791 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a173e4d-8776-4a14-bd00-8d2351219a61 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:02.787205 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 645/1274] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:20:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:20:02.793580 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6acd46-88b8-4fa2-99d0-d6fd768275c0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:02.794088 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6acd46-88b8-4fa2-99d0-d6fd768275c0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:02.794204 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6acd46-88b8-4fa2-99d0-d6fd768275c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:02.811281 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0c6acd46-88b8-4fa2-99d0-d6fd768275c0 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:20:02.812472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0c6acd46-88b8-4fa2-99d0-d6fd768275c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:20:02.878740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 630/1275] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:20:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:20:02.902273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a173e4d-8776-4a14-bd00-8d2351219a61 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:03.004683 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a173e4d-8776-4a14-bd00-8d2351219a61 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:03.021602 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:03.038718 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a7a8b-2326-4e6b-a818-d5f2e62bee84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:03.039460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a7a8b-2326-4e6b-a818-d5f2e62bee84 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:03.039746 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a7a8b-2326-4e6b-a818-d5f2e62bee84 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:03.040722 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190a7a8b-2326-4e6b-a818-d5f2e62bee84 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:03.050675 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190a7a8b-2326-4e6b-a818-d5f2e62bee84 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 15 19:20:03.058953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-190a7a8b-2326-4e6b-a818-d5f2e62bee84 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:20:03.058953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:03.058953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:03.058953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:03.058953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:03.058953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:03.058953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:03.058953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:03.058953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:03.058953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:03.058953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:03.058953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:03.058953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 15 19:20:03.058953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 15 19:20:03.058953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 15 19:20:03.058953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 15 19:20:03.066384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 15 19:20:03.066384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 15 19:20:03.066384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 15 19:20:03.066384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 15 19:20:03.066384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:03.066384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:03.066384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:03.066384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:03.066384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:03.066384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:03.066384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:03.066384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:03.066384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:03.066384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:03.066384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:03.066384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:03.067487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:03.067487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:03.067487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:03.067487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:03.067487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 15 19:20:03.067487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 15 19:20:03.067487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 15 19:20:03.067487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 15 19:20:03.067487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 15 19:20:03.067487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 15 19:20:03.067487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 15 19:20:03.067487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:20:03.067487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 646/1276] 10.222.0.40 () {56 vars in 1096 bytes} [Fri Jul 15 19:20:02 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:03.068369 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6acd46-88b8-4fa2-99d0-d6fd768275c0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:03.177303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:03.177303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6acd46-88b8-4fa2-99d0-d6fd768275c0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:03.206959 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16a838-65f9-47f4-a8ca-a077e8fa978c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:03.207629 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16a838-65f9-47f4-a8ca-a077e8fa978c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:03.207945 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16a838-65f9-47f4-a8ca-a077e8fa978c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:03.208219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16a838-65f9-47f4-a8ca-a077e8fa978c None admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:03.208961 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16a838-65f9-47f4-a8ca-a077e8fa978c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:03.209269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16a838-65f9-47f4-a8ca-a077e8fa978c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:03.210627 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16a838-65f9-47f4-a8ca-a077e8fa978c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:03.219542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 631/1277] 10.222.0.40 () {56 vars in 1099 bytes} [Fri Jul 15 19:20:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:03.225401 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a7a8b-2326-4e6b-a818-d5f2e62bee84 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:03.326276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190a7a8b-2326-4e6b-a818-d5f2e62bee84 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:03.359648 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9160ffd-c41a-47f9-8dae-72caa7bfa540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:03.365824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9160ffd-c41a-47f9-8dae-72caa7bfa540 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:03.365824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9160ffd-c41a-47f9-8dae-72caa7bfa540 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:03.365824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9160ffd-c41a-47f9-8dae-72caa7bfa540 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:03.371617 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9160ffd-c41a-47f9-8dae-72caa7bfa540 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:03.373066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9160ffd-c41a-47f9-8dae-72caa7bfa540 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:03.390817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-e9160ffd-c41a-47f9-8dae-72caa7bfa540 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:03.390817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:03.390817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:03.390817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:03.390817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:03.390817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:03.390817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:03.390817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:03.390817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:03.390817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:03.390817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:03.390817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:03.390817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:20:03.390817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:20:03.390817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:20:03.395808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:20:03.395808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:03.395808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:03.395808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:03.395808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:03.395808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:03.395808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:03.395808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:03.395808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:03.395808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:03.395808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:03.395808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:03.395808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:03.395808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:03.395808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:03.395808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:03.395808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:03.396947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:20:03.396947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:20:03.396947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:03.396947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:20:03.396947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 647/1278] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:03.398152 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16a838-65f9-47f4-a8ca-a077e8fa978c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:03.499155 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16a838-65f9-47f4-a8ca-a077e8fa978c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:03.533988 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2631c-b847-4a89-87ee-2b4b59d67e25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:03.534677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2631c-b847-4a89-87ee-2b4b59d67e25 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:03.534988 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2631c-b847-4a89-87ee-2b4b59d67e25 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:03.535260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e2631c-b847-4a89-87ee-2b4b59d67e25 None admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:03.535985 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2631c-b847-4a89-87ee-2b4b59d67e25 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:03.536291 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2631c-b847-4a89-87ee-2b4b59d67e25 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:03.537662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e2631c-b847-4a89-87ee-2b4b59d67e25 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:03.549753 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 632/1279] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:20:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:03.555654 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9160ffd-c41a-47f9-8dae-72caa7bfa540 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:03.588864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:03.661348 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9160ffd-c41a-47f9-8dae-72caa7bfa540 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:03.698827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fefd2e-d077-4e5d-9604-9abab3337e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:03.699646 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fefd2e-d077-4e5d-9604-9abab3337e92 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:03.699926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fefd2e-d077-4e5d-9604-9abab3337e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:03.700198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fefd2e-d077-4e5d-9604-9abab3337e92 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:03.707326 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fefd2e-d077-4e5d-9604-9abab3337e92 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:03.708742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fefd2e-d077-4e5d-9604-9abab3337e92 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:03.723544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-65fefd2e-d077-4e5d-9604-9abab3337e92 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:20:03.723544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:03.723544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:03.723544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:03.723544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:03.723544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:03.723544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:03.723544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:03.723544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:03.723544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:03.723544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:03.723544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:03.723544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 15 19:20:03.723544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 15 19:20:03.723544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 15 19:20:03.723544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:03.724707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:03.725710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:03.725710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:03.725710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 15 19:20:03.725710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 15 19:20:03.725710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 15 19:20:03.725710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 15 19:20:03.725710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 15 19:20:03.725710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 15 19:20:03.725710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 15 19:20:03.725710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:20:03.725710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 648/1280] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:03 2022] GET /identity/v3/users/placement => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:03.730832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2631c-b847-4a89-87ee-2b4b59d67e25 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:03.734772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:03.836995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e2631c-b847-4a89-87ee-2b4b59d67e25 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:03.871704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ab9af-4afd-435f-8244-9bd4e3cf429c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:03.872358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ab9af-4afd-435f-8244-9bd4e3cf429c None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:03.872688 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ab9af-4afd-435f-8244-9bd4e3cf429c None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:03.872970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4ab9af-4afd-435f-8244-9bd4e3cf429c None admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:03.873822 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ab9af-4afd-435f-8244-9bd4e3cf429c None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:03.874134 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ab9af-4afd-435f-8244-9bd4e3cf429c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:03.875666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4ab9af-4afd-435f-8244-9bd4e3cf429c None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:03.894813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 633/1281] 10.222.0.40 () {56 vars in 1143 bytes} [Fri Jul 15 19:20:03 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:03.900873 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fefd2e-d077-4e5d-9604-9abab3337e92 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:03.992736 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:04.002546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fefd2e-d077-4e5d-9604-9abab3337e92 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:04.036952 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de301a-9662-4412-b277-a8f8a4479965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:04.037618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de301a-9662-4412-b277-a8f8a4479965 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:04.037915 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de301a-9662-4412-b277-a8f8a4479965 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:04.038191 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94de301a-9662-4412-b277-a8f8a4479965 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:04.108946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de301a-9662-4412-b277-a8f8a4479965 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:04.110383 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94de301a-9662-4412-b277-a8f8a4479965 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:04.198536 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:04.208456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 649/1282] 10.222.0.40 () {58 vars in 1282 bytes} [Fri Jul 15 19:20:03 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 15 19:20:04.214346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ab9af-4afd-435f-8244-9bd4e3cf429c None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:04.275442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:04.313852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4ab9af-4afd-435f-8244-9bd4e3cf429c None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:04.345444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e1cc9-bf2c-44de-8f4b-c6cb523d344a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:04.346214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e1cc9-bf2c-44de-8f4b-c6cb523d344a None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:04.346491 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e1cc9-bf2c-44de-8f4b-c6cb523d344a None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:04.346784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01e1cc9-bf2c-44de-8f4b-c6cb523d344a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:04.357858 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e1cc9-bf2c-44de-8f4b-c6cb523d344a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:04.359345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f01e1cc9-bf2c-44de-8f4b-c6cb523d344a None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:04.376775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-f01e1cc9-bf2c-44de-8f4b-c6cb523d344a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:04.376775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:04.376775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:04.376775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:04.376775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:04.376775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:04.376775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:04.376775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:04.376775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:04.376775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:04.376775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:04.376775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:04.376775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 15 19:20:04.376775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 15 19:20:04.376775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 15 19:20:04.378052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 15 19:20:04.378052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:04.378052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:04.378052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:04.378052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:04.378052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:04.378052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:04.378052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:04.378052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:04.378052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:04.378052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:04.378052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:04.378052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:04.378052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:04.378052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:04.378052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:04.378052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:04.379155 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 15 19:20:04.379155 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 15 19:20:04.379155 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 15 19:20:04.379155 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:20:04.379155 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 634/1283] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:20:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:04.384090 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de301a-9662-4412-b277-a8f8a4479965 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:04.482963 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94de301a-9662-4412-b277-a8f8a4479965 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:04.516211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a797942-842e-424a-aee3-5f5b2a6c146e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:04.517359 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a797942-842e-424a-aee3-5f5b2a6c146e None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:04.517359 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a797942-842e-424a-aee3-5f5b2a6c146e None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:04.517629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a797942-842e-424a-aee3-5f5b2a6c146e None admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:04.518122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a797942-842e-424a-aee3-5f5b2a6c146e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:04.518429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a797942-842e-424a-aee3-5f5b2a6c146e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:04.519810 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a797942-842e-424a-aee3-5f5b2a6c146e None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:04.531544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 650/1284] 10.222.0.40 () {56 vars in 1109 bytes} [Fri Jul 15 19:20:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:04.537269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e1cc9-bf2c-44de-8f4b-c6cb523d344a None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:04.636364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f01e1cc9-bf2c-44de-8f4b-c6cb523d344a None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:04.649466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:04.671366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b6271-090f-4df2-9379-f4142b95dd03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:04.672153 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b6271-090f-4df2-9379-f4142b95dd03 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:04.672437 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b6271-090f-4df2-9379-f4142b95dd03 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:04.672761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987b6271-090f-4df2-9379-f4142b95dd03 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:04.679462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b6271-090f-4df2-9379-f4142b95dd03 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:04.681229 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987b6271-090f-4df2-9379-f4142b95dd03 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:04.695370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application [None req-987b6271-090f-4df2-9379-f4142b95dd03 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:20:04.695370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:04.695370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:04.695370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:04.695370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:04.695370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:04.695370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:04.695370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:04.695370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:04.695370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:04.695370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:04.695370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:04.695370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 15 19:20:04.695370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 15 19:20:04.695370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 15 19:20:04.696528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 15 19:20:04.696528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:04.696528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:04.696528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:04.696528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:04.696528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:04.696528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:04.696528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:04.696528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:04.696528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:04.696528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:04.696528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:04.696528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:04.696528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:04.696528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:04.696528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:04.696528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:04.698030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 15 19:20:04.698030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 15 19:20:04.698030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 15 19:20:04.698030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 15 19:20:04.698030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 15 19:20:04.698030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 15 19:20:04.698030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 15 19:20:04.698030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: ERROR keystone.server.flask.application Jul 15 19:20:04.698030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 635/1285] 10.222.0.40 () {56 vars in 1111 bytes} [Fri Jul 15 19:20:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 15 19:20:04.702560 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a797942-842e-424a-aee3-5f5b2a6c146e None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:04.752777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:04.803500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a797942-842e-424a-aee3-5f5b2a6c146e None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:04.836578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b155e-d533-42f4-b59e-5703dac472d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:04.837907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b155e-d533-42f4-b59e-5703dac472d2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:04.838415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b155e-d533-42f4-b59e-5703dac472d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:04.838704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b155e-d533-42f4-b59e-5703dac472d2 None admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:04.839585 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b155e-d533-42f4-b59e-5703dac472d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:04.839894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b155e-d533-42f4-b59e-5703dac472d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:04.841314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b155e-d533-42f4-b59e-5703dac472d2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:04.853125 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 651/1286] 10.222.0.40 () {56 vars in 1148 bytes} [Fri Jul 15 19:20:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:04.859166 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b6271-090f-4df2-9379-f4142b95dd03 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:04.966055 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987b6271-090f-4df2-9379-f4142b95dd03 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:04.998877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0085709a-936c-46cc-9349-697eb66d82d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:04.999662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085709a-936c-46cc-9349-697eb66d82d3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:04.999942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085709a-936c-46cc-9349-697eb66d82d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:05.000217 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0085709a-936c-46cc-9349-697eb66d82d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:05.001032 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085709a-936c-46cc-9349-697eb66d82d3 None admin] RBAC: Adding query filter params (role.id=af24d7fdf6044033afe14451ae6aa3c7, scope.project.id=861de78bbfe84bd991c3ab54e85573a7, user.id=ad68d871464f4b5588c22070205f159e) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:05.001340 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085709a-936c-46cc-9349-697eb66d82d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:05.002768 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0085709a-936c-46cc-9349-697eb66d82d3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:05.008789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 636/1287] 10.222.0.40 () {56 vars in 1374 bytes} [Fri Jul 15 19:20:04 2022] GET /identity/v3/role_assignments?user.id=ad68d871464f4b5588c22070205f159e&scope.project.id=861de78bbfe84bd991c3ab54e85573a7&role.id=af24d7fdf6044033afe14451ae6aa3c7 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:07.044733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201846d5-b7d1-4225-8206-4016332043b5 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:07.045294 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201846d5-b7d1-4225-8206-4016332043b5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:07.045294 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201846d5-b7d1-4225-8206-4016332043b5 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:07.046647 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 652/1288] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:20:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:20:07.051767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f8363-500f-413c-bfb3-be6c0348f2a8 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:07.052216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f8363-500f-413c-bfb3-be6c0348f2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:07.052353 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88f8363-500f-413c-bfb3-be6c0348f2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:07.069517 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f88f8363-500f-413c-bfb3-be6c0348f2a8 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:20:07.070712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f88f8363-500f-413c-bfb3-be6c0348f2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:20:07.101512 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:07.139938 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 637/1289] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:20:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:20:07.162407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201846d5-b7d1-4225-8206-4016332043b5 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:07.266279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201846d5-b7d1-4225-8206-4016332043b5 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:07.277929 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:07.302503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e2cf8-75f3-4cb2-b031-b7f49d663d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:07.303320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e2cf8-75f3-4cb2-b031-b7f49d663d3c None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:07.303602 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e2cf8-75f3-4cb2-b031-b7f49d663d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:07.303874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0e2cf8-75f3-4cb2-b031-b7f49d663d3c None admin] PATH_INFO: `/v3/services/placement` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:07.304529 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e2cf8-75f3-4cb2-b031-b7f49d663d3c None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:07.305885 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0e2cf8-75f3-4cb2-b031-b7f49d663d3c None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:07.318160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-ba0e2cf8-75f3-4cb2-b031-b7f49d663d3c None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:20:07.318160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:07.318160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:20:07.318160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:20:07.318160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:20:07.318160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:20:07.318160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:20:07.318160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:20:07.318160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:20:07.318160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:20:07.318160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:20:07.318160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:20:07.318160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:07.318160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:07.318160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:07.318160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:07.318160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:07.328960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:07.328960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:07.328960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:07.328960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:07.328960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:07.328960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:07.328960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:20:07.328960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:20:07.328960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:20:07.328960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:20:07.328960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:07.328960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:07.328960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:07.328960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:07.328960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:07.328960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:07.330031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:07.330031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:07.330031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:07.330031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:07.330031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:07.330031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:07.330031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:07.330031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:07.330031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:07.330031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:07.330031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:20:07.330031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:20:07.330031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:20:07.330031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:20:07.330031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 653/1290] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Jul 15 19:20:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:07.331071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f8363-500f-413c-bfb3-be6c0348f2a8 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:07.425161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88f8363-500f-413c-bfb3-be6c0348f2a8 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:07.459309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a05640-71de-45ba-9688-f8a770afa3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:07.459975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a05640-71de-45ba-9688-f8a770afa3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:07.460260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a05640-71de-45ba-9688-f8a770afa3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:07.460540 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a05640-71de-45ba-9688-f8a770afa3d3 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:07.461364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a05640-71de-45ba-9688-f8a770afa3d3 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:07.461680 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a05640-71de-45ba-9688-f8a770afa3d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:07.463643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a05640-71de-45ba-9688-f8a770afa3d3 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:07.473813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 638/1291] 10.222.0.40 () {56 vars in 1116 bytes} [Fri Jul 15 19:20:07 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:07.475101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e2cf8-75f3-4cb2-b031-b7f49d663d3c None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:07.580118 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0e2cf8-75f3-4cb2-b031-b7f49d663d3c None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:07.614534 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa653e-1f8d-4165-9132-a38d0de1f4c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:07.615218 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa653e-1f8d-4165-9132-a38d0de1f4c7 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:07.615507 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa653e-1f8d-4165-9132-a38d0de1f4c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:07.615786 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa653e-1f8d-4165-9132-a38d0de1f4c7 None admin] PATH_INFO: `/v3/services` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:07.616494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa653e-1f8d-4165-9132-a38d0de1f4c7 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:07.616802 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa653e-1f8d-4165-9132-a38d0de1f4c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:07.618242 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa653e-1f8d-4165-9132-a38d0de1f4c7 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:07.622708 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 654/1292] 10.222.0.40 () {56 vars in 1116 bytes} [Fri Jul 15 19:20:07 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:09.622591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2304ae-e024-46c1-86ec-b20955608dc7 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:09.623170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2304ae-e024-46c1-86ec-b20955608dc7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:09.623170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2304ae-e024-46c1-86ec-b20955608dc7 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:09.624540 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 639/1293] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:20:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:20:09.629644 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906ce2c-362d-41bd-a491-162bbdd39bbb None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:09.630071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906ce2c-362d-41bd-a491-162bbdd39bbb None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:09.630206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e906ce2c-362d-41bd-a491-162bbdd39bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:09.648086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-e906ce2c-362d-41bd-a491-162bbdd39bbb None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:20:09.649272 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e906ce2c-362d-41bd-a491-162bbdd39bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:20:09.679531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:09.718587 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 655/1294] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:20:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:20:09.743009 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2304ae-e024-46c1-86ec-b20955608dc7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:09.775575 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:09.847666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2304ae-e024-46c1-86ec-b20955608dc7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:09.882387 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-934c0c45-76ba-4a95-ac37-9a17a12bc95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:09.883241 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c0c45-76ba-4a95-ac37-9a17a12bc95f None admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:09.883518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c0c45-76ba-4a95-ac37-9a17a12bc95f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:09.883787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-934c0c45-76ba-4a95-ac37-9a17a12bc95f None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:09.885141 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c0c45-76ba-4a95-ac37-9a17a12bc95f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:09.886514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-934c0c45-76ba-4a95-ac37-9a17a12bc95f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:10.069492 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 640/1295] 10.222.0.40 () {60 vars in 1141 bytes} [Fri Jul 15 19:20:09 2022] POST /identity/v3/services => generated 246 bytes in 327 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:20:12.113777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c0c0c-0219-4040-adde-bffd20a287dc None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:12.114340 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c0c0c-0219-4040-adde-bffd20a287dc None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:12.114544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8c0c0c-0219-4040-adde-bffd20a287dc None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:12.115919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 656/1296] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:20:12.121958 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331bb31-4efa-4975-a499-7944a396edf2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:12.122351 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331bb31-4efa-4975-a499-7944a396edf2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:12.122512 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c331bb31-4efa-4975-a499-7944a396edf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:12.140442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c331bb31-4efa-4975-a499-7944a396edf2 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:20:12.141642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c331bb31-4efa-4975-a499-7944a396edf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:20:12.218672 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 641/1297] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:20:12 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 15 19:20:12.241218 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c0c0c-0219-4040-adde-bffd20a287dc None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:12.347485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8c0c0c-0219-4040-adde-bffd20a287dc None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:12.382251 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f1c0e-9740-4c47-966a-7a7cc6df37dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:12.383101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f1c0e-9740-4c47-966a-7a7cc6df37dc None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:12.383665 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f1c0e-9740-4c47-966a-7a7cc6df37dc None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:12.383942 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a6f1c0e-9740-4c47-966a-7a7cc6df37dc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:12.384649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f1c0e-9740-4c47-966a-7a7cc6df37dc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:12.386021 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a6f1c0e-9740-4c47-966a-7a7cc6df37dc None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:12.397939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-2a6f1c0e-9740-4c47-966a-7a7cc6df37dc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:20:12.397939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:12.397939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:20:12.397939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:20:12.397939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:20:12.397939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:20:12.397939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:20:12.397939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:20:12.397939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:20:12.397939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:20:12.397939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:20:12.397939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:20:12.397939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:12.397939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:12.397939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:12.397939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:12.397939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:12.399134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:12.399134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:12.399134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:12.399134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:12.399134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:12.399134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:12.399134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:20:12.399134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:20:12.399134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:20:12.399134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:20:12.399134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:12.399134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:12.399134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:12.399134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:12.399134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:12.399134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:12.400200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:12.400200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:12.400200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:12.400200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:12.400200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:12.400200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:12.400200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:12.400200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:12.400200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:12.400200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:12.400200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:20:12.400200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:20:12.400200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:20:12.400200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:20:12.400200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 657/1298] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Jul 15 19:20:12 2022] GET /identity/v3/services/placement => generated 90 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:12.405994 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331bb31-4efa-4975-a499-7944a396edf2 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:12.424937 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:12.504815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c331bb31-4efa-4975-a499-7944a396edf2 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:12.539125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf12bb-b5ed-4c04-b68e-211d14094f38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:12.539784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf12bb-b5ed-4c04-b68e-211d14094f38 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:12.540066 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf12bb-b5ed-4c04-b68e-211d14094f38 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:12.540347 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bf12bb-b5ed-4c04-b68e-211d14094f38 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:12.541611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf12bb-b5ed-4c04-b68e-211d14094f38 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:12.541918 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf12bb-b5ed-4c04-b68e-211d14094f38 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:12.543324 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bf12bb-b5ed-4c04-b68e-211d14094f38 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:12.548731 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 642/1299] 10.222.0.40 () {56 vars in 1116 bytes} [Fri Jul 15 19:20:12 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:12.554950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f1c0e-9740-4c47-966a-7a7cc6df37dc None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:12.586868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:12.655373 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a6f1c0e-9740-4c47-966a-7a7cc6df37dc None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:12.689490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbeb5cc-211b-4ad6-a16e-27e4b9db8a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:12.690449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbeb5cc-211b-4ad6-a16e-27e4b9db8a79 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:12.690449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbeb5cc-211b-4ad6-a16e-27e4b9db8a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:12.690677 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbeb5cc-211b-4ad6-a16e-27e4b9db8a79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:12.691471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbeb5cc-211b-4ad6-a16e-27e4b9db8a79 None admin] RBAC: Adding query filter params (interface=public, service_id=2ab3346c4f2b4d21a74d1a14ca15704b, region_id=RegionOne) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:12.691773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbeb5cc-211b-4ad6-a16e-27e4b9db8a79 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:12.693187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbeb5cc-211b-4ad6-a16e-27e4b9db8a79 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:12.698099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 658/1300] 10.222.0.40 () {56 vars in 1251 bytes} [Fri Jul 15 19:20:12 2022] GET /identity/v3/endpoints?service_id=2ab3346c4f2b4d21a74d1a14ca15704b&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:12.704050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf12bb-b5ed-4c04-b68e-211d14094f38 None admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:12.786545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:12.804591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bf12bb-b5ed-4c04-b68e-211d14094f38 None admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:12.836798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760b8ee-6772-496e-bbb9-5fc58667d891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:12.837445 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760b8ee-6772-496e-bbb9-5fc58667d891 None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:12.838288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760b8ee-6772-496e-bbb9-5fc58667d891 None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:12.838564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760b8ee-6772-496e-bbb9-5fc58667d891 None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:12.839270 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760b8ee-6772-496e-bbb9-5fc58667d891 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:12.840617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760b8ee-6772-496e-bbb9-5fc58667d891 None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:12.847474 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 643/1301] 10.222.0.40 () {56 vars in 1087 bytes} [Fri Jul 15 19:20:12 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:20:14.884784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28467f0d-5115-4794-9998-d3e31da25080 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:14.885363 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28467f0d-5115-4794-9998-d3e31da25080 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:14.885485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28467f0d-5115-4794-9998-d3e31da25080 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:14.886798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 659/1302] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:20:14.894242 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50092bbe-e7cc-4442-9ae3-7c96d7589750 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:14.894836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50092bbe-e7cc-4442-9ae3-7c96d7589750 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:14.895793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50092bbe-e7cc-4442-9ae3-7c96d7589750 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:14.923790 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-50092bbe-e7cc-4442-9ae3-7c96d7589750 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:20:14.925739 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-50092bbe-e7cc-4442-9ae3-7c96d7589750 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:20:15.042137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 644/1303] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:20:14 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 15 19:20:15.065305 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28467f0d-5115-4794-9998-d3e31da25080 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:15.180149 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:15.188072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28467f0d-5115-4794-9998-d3e31da25080 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:15.227484 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdcbcf-9548-4894-b1e1-a914fa1ffee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:15.228437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdcbcf-9548-4894-b1e1-a914fa1ffee2 None admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:15.229209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdcbcf-9548-4894-b1e1-a914fa1ffee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:15.229482 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3cdcbcf-9548-4894-b1e1-a914fa1ffee2 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:15.230147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdcbcf-9548-4894-b1e1-a914fa1ffee2 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:15.231671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3cdcbcf-9548-4894-b1e1-a914fa1ffee2 None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:15.244773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application [None req-c3cdcbcf-9548-4894-b1e1-a914fa1ffee2 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:20:15.244773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:15.244773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 15 19:20:15.244773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 15 19:20:15.244773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 15 19:20:15.244773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 15 19:20:15.244773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 15 19:20:15.244773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:20:15.244773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:20:15.244773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:20:15.244773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 15 19:20:15.244773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:20:15.244773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 15 19:20:15.244773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 15 19:20:15.244773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 15 19:20:15.244773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 15 19:20:15.244773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 15 19:20:15.249707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 15 19:20:15.249707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 15 19:20:15.249707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 15 19:20:15.249707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 15 19:20:15.249707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 15 19:20:15.249707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 15 19:20:15.249707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 15 19:20:15.249707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 15 19:20:15.249707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 15 19:20:15.249707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 15 19:20:15.249707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 15 19:20:15.249707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 15 19:20:15.249707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 15 19:20:15.249707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 15 19:20:15.249707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 15 19:20:15.249707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.get_or_create( Jul 15 19:20:15.250926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 15 19:20:15.250926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application with Lock( Jul 15 19:20:15.250926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 15 19:20:15.250926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self._enter() Jul 15 19:20:15.250926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 15 19:20:15.250926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 15 19:20:15.250926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 15 19:20:15.250926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application return self.creator() Jul 15 19:20:15.250926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 15 19:20:15.250926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application created_value = creator( Jul 15 19:20:15.250926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 15 19:20:15.250926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 15 19:20:15.250926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 15 19:20:15.250926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: ERROR keystone.server.flask.application Jul 15 19:20:15.250926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 660/1304] 10.222.0.40 () {56 vars in 1117 bytes} [Fri Jul 15 19:20:15 2022] GET /identity/v3/services/placement => generated 90 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 15 19:20:15.253302 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50092bbe-e7cc-4442-9ae3-7c96d7589750 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:15.359353 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:15.390015 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50092bbe-e7cc-4442-9ae3-7c96d7589750 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:15.442193 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcf3d2f-25bb-4af0-8bad-31321ba9c09f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:15.443261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf3d2f-25bb-4af0-8bad-31321ba9c09f None admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:15.443767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf3d2f-25bb-4af0-8bad-31321ba9c09f None admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:15.444141 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcf3d2f-25bb-4af0-8bad-31321ba9c09f None admin] PATH_INFO: `/v3/services` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:15.444982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf3d2f-25bb-4af0-8bad-31321ba9c09f None admin] RBAC: Adding query filter params (name=placement) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:20:15.445386 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf3d2f-25bb-4af0-8bad-31321ba9c09f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:15.447068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcf3d2f-25bb-4af0-8bad-31321ba9c09f None admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:15.454433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 645/1305] 10.222.0.40 () {56 vars in 1116 bytes} [Fri Jul 15 19:20:15 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:20:15.461979 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdcbcf-9548-4894-b1e1-a914fa1ffee2 None admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:20:15.582782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3cdcbcf-9548-4894-b1e1-a914fa1ffee2 None admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:20:15.623784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f0698-67ef-40f4-abcc-28e358732e1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:20:15.624455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f0698-67ef-40f4-abcc-28e358732e1f None admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:20:15.624735 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f0698-67ef-40f4-abcc-28e358732e1f None admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:20:15.625012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f0698-67ef-40f4-abcc-28e358732e1f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:20:15.625777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f0698-67ef-40f4-abcc-28e358732e1f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:20:15.627198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f0698-67ef-40f4-abcc-28e358732e1f None admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:20:15.758343 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 661/1306] 10.222.0.40 () {60 vars in 1144 bytes} [Fri Jul 15 19:20:15 2022] POST /identity/v3/endpoints => generated 331 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:20:25.450700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=30 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:20:25.753514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:14.144349 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd0b1-573b-4dfb-a770-6e04f6eb6e9b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:14.144349 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd0b1-573b-4dfb-a770-6e04f6eb6e9b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:14.144349 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3abd0b1-573b-4dfb-a770-6e04f6eb6e9b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:14.144349 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 646/1307] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:28:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:14.145202 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae8d16-8948-4141-a103-2839bfee91c6 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:14.145202 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae8d16-8948-4141-a103-2839bfee91c6 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:14.145202 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ae8d16-8948-4141-a103-2839bfee91c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:14.236733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-61ae8d16-8948-4141-a103-2839bfee91c6 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:14.237964 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-61ae8d16-8948-4141-a103-2839bfee91c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:14.379235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 662/1308] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:28:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:28:14.421509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa073c61-5840-4398-a4f4-04912300a73f None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:14.421509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa073c61-5840-4398-a4f4-04912300a73f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:14.421509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa073c61-5840-4398-a4f4-04912300a73f None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:14.426774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 647/1309] 10.222.0.40 () {54 vars in 964 bytes} [Fri Jul 15 19:28:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:14.434355 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7ead8-8b26-47f0-b7ea-f4a5be509579 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:14.435223 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7ead8-8b26-47f0-b7ea-f4a5be509579 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:14.435877 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c7ead8-8b26-47f0-b7ea-f4a5be509579 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:14.536955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f5c7ead8-8b26-47f0-b7ea-f4a5be509579 None None] MFA Rules not processed for user `c99418232a0848a1b7a1a73966928769`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:14.538212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f5c7ead8-8b26-47f0-b7ea-f4a5be509579 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:14.572888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:14.636267 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 663/1310] 10.222.0.40 () {58 vars in 1061 bytes} [Fri Jul 15 19:28:14 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:28:14.645254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa073c61-5840-4398-a4f4-04912300a73f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:14.647109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fa073c61-5840-4398-a4f4-04912300a73f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:14.805096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa073c61-5840-4398-a4f4-04912300a73f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:14.896240 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebd9855-8550-4405-8c37-a43a9372f999 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:14.896825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd9855-8550-4405-8c37-a43a9372f999 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:14.897110 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd9855-8550-4405-8c37-a43a9372f999 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:14.897388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebd9855-8550-4405-8c37-a43a9372f999 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:14.899203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9ebd9855-8550-4405-8c37-a43a9372f999 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:14.967667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:15.031173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd9855-8550-4405-8c37-a43a9372f999 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:15.032622 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebd9855-8550-4405-8c37-a43a9372f999 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:15.064500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 648/1311] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 420 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:28:17.508921 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb53a0-7e91-4fcb-b3a9-c304881eff8a None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:17.509679 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb53a0-7e91-4fcb-b3a9-c304881eff8a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:17.509679 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6eb53a0-7e91-4fcb-b3a9-c304881eff8a None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:17.510940 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 664/1312] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:28:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:17.516256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787393a9-ff74-4f26-b53a-ba0b983e5235 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:17.516735 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787393a9-ff74-4f26-b53a-ba0b983e5235 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:17.516833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787393a9-ff74-4f26-b53a-ba0b983e5235 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:17.598172 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-787393a9-ff74-4f26-b53a-ba0b983e5235 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:17.599407 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-787393a9-ff74-4f26-b53a-ba0b983e5235 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:17.714919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 649/1313] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:28:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:28:17.752085 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb53a0-7e91-4fcb-b3a9-c304881eff8a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:17.753769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a6eb53a0-7e91-4fcb-b3a9-c304881eff8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:17.872723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6eb53a0-7e91-4fcb-b3a9-c304881eff8a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:17.956905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:17.959805 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a012dd-b198-4428-8bb6-101df0564820 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:17.960468 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a012dd-b198-4428-8bb6-101df0564820 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:17.960746 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a012dd-b198-4428-8bb6-101df0564820 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:17.961015 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a012dd-b198-4428-8bb6-101df0564820 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:17.963297 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f5a012dd-b198-4428-8bb6-101df0564820 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:18.085489 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a012dd-b198-4428-8bb6-101df0564820 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:18.087585 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a012dd-b198-4428-8bb6-101df0564820 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:18.107117 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 665/1314] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:28:20.647724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e059e2a-7d32-4a05-8722-140716c364d0 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:20.648296 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e059e2a-7d32-4a05-8722-140716c364d0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:20.648296 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e059e2a-7d32-4a05-8722-140716c364d0 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:20.649774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 650/1315] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:20.657035 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41af8d-0978-4e9d-be96-a48d161c0dbe None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:20.657552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41af8d-0978-4e9d-be96-a48d161c0dbe None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:20.657665 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac41af8d-0978-4e9d-be96-a48d161c0dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:20.724828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-ac41af8d-0978-4e9d-be96-a48d161c0dbe None None] MFA Rules not processed for user `75fc1f3e3ac14ba7b551d2a7fb2ab8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:20.726047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ac41af8d-0978-4e9d-be96-a48d161c0dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:20.780913 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:20.828488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 666/1316] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:28:20 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:28:20.883820 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973ad97-5c78-4140-86c9-75dd8496480b None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:20.884202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973ad97-5c78-4140-86c9-75dd8496480b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:20.884485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2973ad97-5c78-4140-86c9-75dd8496480b None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:20.885924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 651/1317] 10.222.0.40 () {54 vars in 964 bytes} [Fri Jul 15 19:28:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:20.891826 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3020e22-616a-4fc9-abd6-ea30bd240001 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:20.892119 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3020e22-616a-4fc9-abd6-ea30bd240001 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:20.892399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3020e22-616a-4fc9-abd6-ea30bd240001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:20.969555 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-e3020e22-616a-4fc9-abd6-ea30bd240001 None None] MFA Rules not processed for user `c99418232a0848a1b7a1a73966928769`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:20.970800 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e3020e22-616a-4fc9-abd6-ea30bd240001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:21.048099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 667/1318] 10.222.0.40 () {58 vars in 1061 bytes} [Fri Jul 15 19:28:20 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:28:21.057247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973ad97-5c78-4140-86c9-75dd8496480b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:21.058863 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2973ad97-5c78-4140-86c9-75dd8496480b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:21.069878 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:21.166442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2973ad97-5c78-4140-86c9-75dd8496480b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:21.239795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5155df93-c131-44a8-958a-dc72de60f817 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:21.240351 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155df93-c131-44a8-958a-dc72de60f817 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:21.240630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155df93-c131-44a8-958a-dc72de60f817 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:21.240901 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5155df93-c131-44a8-958a-dc72de60f817 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:21.242584 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5155df93-c131-44a8-958a-dc72de60f817 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:21.304502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:21.351845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155df93-c131-44a8-958a-dc72de60f817 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:21.353434 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5155df93-c131-44a8-958a-dc72de60f817 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:21.372607 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 652/1319] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:21 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:28:24.959009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6abef-f814-445b-b840-6faf2b02a215 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:24.959585 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6abef-f814-445b-b840-6faf2b02a215 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:24.959585 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6abef-f814-445b-b840-6faf2b02a215 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:24.960956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 668/1320] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:28:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:24.966567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e020e-3af9-409c-b38a-56aa9a52eb43 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:24.967055 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e020e-3af9-409c-b38a-56aa9a52eb43 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:24.967170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663e020e-3af9-409c-b38a-56aa9a52eb43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:25.033858 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-663e020e-3af9-409c-b38a-56aa9a52eb43 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:25.035097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-663e020e-3af9-409c-b38a-56aa9a52eb43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:25.132260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 653/1321] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:28:24 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:28:25.171101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6abef-f814-445b-b840-6faf2b02a215 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:25.172642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-aad6abef-f814-445b-b840-6faf2b02a215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:25.223123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:25.279524 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6abef-f814-445b-b840-6faf2b02a215 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:25.352726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b13034-7a96-41b9-9c55-a2a192db7058 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:25.353368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b13034-7a96-41b9-9c55-a2a192db7058 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:25.353646 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b13034-7a96-41b9-9c55-a2a192db7058 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:25.353918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b13034-7a96-41b9-9c55-a2a192db7058 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:25.355592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-00b13034-7a96-41b9-9c55-a2a192db7058 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:25.452452 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:25.466687 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b13034-7a96-41b9-9c55-a2a192db7058 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:25.472083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b13034-7a96-41b9-9c55-a2a192db7058 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:25.487303 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 669/1322] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:25 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:28:28.854808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5536-6d2d-4f98-aeb5-5e22539c633d None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:28.855354 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5536-6d2d-4f98-aeb5-5e22539c633d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:28.855354 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935b5536-6d2d-4f98-aeb5-5e22539c633d None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:28.856757 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 654/1323] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:28:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:28.862466 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a3fe4-a1ee-4984-aa7a-6c0ef031eb99 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:28.862936 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a3fe4-a1ee-4984-aa7a-6c0ef031eb99 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:28.863053 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e97a3fe4-a1ee-4984-aa7a-6c0ef031eb99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:28.934990 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-e97a3fe4-a1ee-4984-aa7a-6c0ef031eb99 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:28.936260 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e97a3fe4-a1ee-4984-aa7a-6c0ef031eb99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:29.040066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 670/1324] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:28:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:28:29.076941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b5536-6d2d-4f98-aeb5-5e22539c633d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:29.078491 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-935b5536-6d2d-4f98-aeb5-5e22539c633d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:29.100124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:29.197344 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935b5536-6d2d-4f98-aeb5-5e22539c633d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:29.281357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0519649c-9005-4b1f-91c7-5d14a9e19f74 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:29.282138 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519649c-9005-4b1f-91c7-5d14a9e19f74 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:29.282424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519649c-9005-4b1f-91c7-5d14a9e19f74 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:29.282700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0519649c-9005-4b1f-91c7-5d14a9e19f74 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:29.284471 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0519649c-9005-4b1f-91c7-5d14a9e19f74 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:29.361376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:29.401133 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519649c-9005-4b1f-91c7-5d14a9e19f74 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:29.402640 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0519649c-9005-4b1f-91c7-5d14a9e19f74 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:29.421702 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 655/1325] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:28:31.585312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b37e-f1e6-4c68-b23f-fcb475832d71 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:31.585854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b37e-f1e6-4c68-b23f-fcb475832d71 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:31.586584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1530b37e-f1e6-4c68-b23f-fcb475832d71 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:31.588156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 671/1326] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:28:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:31.594573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef533b1-fc0a-412d-9ec7-107f610a546a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:31.595199 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef533b1-fc0a-412d-9ec7-107f610a546a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:31.595573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef533b1-fc0a-412d-9ec7-107f610a546a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:31.671057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6ef533b1-fc0a-412d-9ec7-107f610a546a None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:31.672261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6ef533b1-fc0a-412d-9ec7-107f610a546a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:31.779621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 656/1327] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:28:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:28:31.815357 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530b37e-f1e6-4c68-b23f-fcb475832d71 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:31.816894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1530b37e-f1e6-4c68-b23f-fcb475832d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:31.878905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:31.924039 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1530b37e-f1e6-4c68-b23f-fcb475832d71 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:32.004077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34935e6e-89c2-492a-b486-7494b2ee8ac6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:32.004752 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34935e6e-89c2-492a-b486-7494b2ee8ac6 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:32.005037 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34935e6e-89c2-492a-b486-7494b2ee8ac6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:32.005312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34935e6e-89c2-492a-b486-7494b2ee8ac6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:32.007078 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-34935e6e-89c2-492a-b486-7494b2ee8ac6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:32.126165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:32.128932 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34935e6e-89c2-492a-b486-7494b2ee8ac6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:32.130375 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34935e6e-89c2-492a-b486-7494b2ee8ac6 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:32.150604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 672/1328] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:28:34.245502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94fe6c-5cbe-4aa9-9e84-7096955ba288 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:34.246070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94fe6c-5cbe-4aa9-9e84-7096955ba288 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:34.246070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc94fe6c-5cbe-4aa9-9e84-7096955ba288 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:34.247484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 657/1329] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:28:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:34.252936 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2a480-38f0-4f3f-9e4f-4a1acb5d1343 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:34.253381 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2a480-38f0-4f3f-9e4f-4a1acb5d1343 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:34.253496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b2a480-38f0-4f3f-9e4f-4a1acb5d1343 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:34.322216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d4b2a480-38f0-4f3f-9e4f-4a1acb5d1343 None None] MFA Rules not processed for user `75fc1f3e3ac14ba7b551d2a7fb2ab8a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:34.323514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d4b2a480-38f0-4f3f-9e4f-4a1acb5d1343 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:34.433725 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 673/1330] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:28:34 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:28:34.473139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94fe6c-5cbe-4aa9-9e84-7096955ba288 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:34.474949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bc94fe6c-5cbe-4aa9-9e84-7096955ba288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:34.509346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:34.584880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc94fe6c-5cbe-4aa9-9e84-7096955ba288 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:34.663708 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ab3c72-a2fc-4372-a5d3-6ddb93ae2a2e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:34.665069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab3c72-a2fc-4372-a5d3-6ddb93ae2a2e service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:34.665356 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab3c72-a2fc-4372-a5d3-6ddb93ae2a2e service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:34.665633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ab3c72-a2fc-4372-a5d3-6ddb93ae2a2e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:34.667336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a1ab3c72-a2fc-4372-a5d3-6ddb93ae2a2e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:34.750025 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:34.781835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab3c72-a2fc-4372-a5d3-6ddb93ae2a2e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:34.783329 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ab3c72-a2fc-4372-a5d3-6ddb93ae2a2e service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:34.802594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 658/1331] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:34 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:28:37.319846 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f24bc-b1e2-47b7-8694-dd6f48c87a00 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:37.321074 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f24bc-b1e2-47b7-8694-dd6f48c87a00 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:37.321074 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1f24bc-b1e2-47b7-8694-dd6f48c87a00 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:37.322367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 674/1332] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:28:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:37.327634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5219c-f692-432c-8aac-ffb2389b9556 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:37.328086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5219c-f692-432c-8aac-ffb2389b9556 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:37.328201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d5219c-f692-432c-8aac-ffb2389b9556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:37.393278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c8d5219c-f692-432c-8aac-ffb2389b9556 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:37.394506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c8d5219c-f692-432c-8aac-ffb2389b9556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:37.492587 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 659/1333] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:28:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:28:37.529281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f24bc-b1e2-47b7-8694-dd6f48c87a00 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:37.530859 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6b1f24bc-b1e2-47b7-8694-dd6f48c87a00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:37.598960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:37.631553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1f24bc-b1e2-47b7-8694-dd6f48c87a00 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:37.707154 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b900f8d-61f4-49eb-ab4d-380023eb94dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:37.707798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b900f8d-61f4-49eb-ab4d-380023eb94dc service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:37.708076 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b900f8d-61f4-49eb-ab4d-380023eb94dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:37.708354 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b900f8d-61f4-49eb-ab4d-380023eb94dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:37.710020 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5b900f8d-61f4-49eb-ab4d-380023eb94dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:37.822011 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b900f8d-61f4-49eb-ab4d-380023eb94dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:37.823471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b900f8d-61f4-49eb-ab4d-380023eb94dc service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:37.833400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:37.841720 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 675/1334] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:28:39.903114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae4047-52d9-4a36-ba76-b4224f6315a1 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:39.903666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae4047-52d9-4a36-ba76-b4224f6315a1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:39.903766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ae4047-52d9-4a36-ba76-b4224f6315a1 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:39.905134 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 660/1335] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:28:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:39.910671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9911c8-40c6-4f9c-ab02-d049ea1adcc3 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:39.911146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9911c8-40c6-4f9c-ab02-d049ea1adcc3 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:39.911254 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9911c8-40c6-4f9c-ab02-d049ea1adcc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:39.979147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-4c9911c8-40c6-4f9c-ab02-d049ea1adcc3 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:39.980360 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4c9911c8-40c6-4f9c-ab02-d049ea1adcc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:40.078168 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 676/1336] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:28:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:28:40.119485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae4047-52d9-4a36-ba76-b4224f6315a1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:40.121041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-87ae4047-52d9-4a36-ba76-b4224f6315a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:40.160681 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:40.227827 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ae4047-52d9-4a36-ba76-b4224f6315a1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:40.302167 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fc3cec-60d3-45d8-8d6e-afe5f2dbce93 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:40.302843 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc3cec-60d3-45d8-8d6e-afe5f2dbce93 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:40.303130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc3cec-60d3-45d8-8d6e-afe5f2dbce93 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:40.303411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fc3cec-60d3-45d8-8d6e-afe5f2dbce93 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:40.305629 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a7fc3cec-60d3-45d8-8d6e-afe5f2dbce93 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:40.387565 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:40.414490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc3cec-60d3-45d8-8d6e-afe5f2dbce93 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:40.415981 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fc3cec-60d3-45d8-8d6e-afe5f2dbce93 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:40.435869 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 661/1337] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:28:43.084830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39e099-f06e-4a0e-a1ac-44a071b26e08 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:43.085363 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39e099-f06e-4a0e-a1ac-44a071b26e08 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:43.085470 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb39e099-f06e-4a0e-a1ac-44a071b26e08 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:43.087107 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 677/1338] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:28:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:43.092477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1446d-fa36-457c-9041-13acf320ece5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:43.092952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1446d-fa36-457c-9041-13acf320ece5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:43.093062 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc1446d-fa36-457c-9041-13acf320ece5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:43.156089 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ffc1446d-fa36-457c-9041-13acf320ece5 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:43.157280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ffc1446d-fa36-457c-9041-13acf320ece5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:43.255380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 662/1339] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:28:43 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:28:43.292288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39e099-f06e-4a0e-a1ac-44a071b26e08 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:43.293977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-cb39e099-f06e-4a0e-a1ac-44a071b26e08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:43.372894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:43.401508 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb39e099-f06e-4a0e-a1ac-44a071b26e08 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:43.476299 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d44e97-88bd-4a78-848e-2998b1ec4d4b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:43.478044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d44e97-88bd-4a78-848e-2998b1ec4d4b service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:43.478597 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d44e97-88bd-4a78-848e-2998b1ec4d4b service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:43.478967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d44e97-88bd-4a78-848e-2998b1ec4d4b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:43.481478 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-46d44e97-88bd-4a78-848e-2998b1ec4d4b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:43.593418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d44e97-88bd-4a78-848e-2998b1ec4d4b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:43.594870 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d44e97-88bd-4a78-848e-2998b1ec4d4b service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:43.612950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 678/1340] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:43 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:28:47.806069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3252ba-3ece-4a59-b618-888cf72c26a5 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:47.806590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3252ba-3ece-4a59-b618-888cf72c26a5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:47.806590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3252ba-3ece-4a59-b618-888cf72c26a5 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:47.809441 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 663/1341] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:28:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:47.813494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e2fa-7741-43ff-bdfe-9e3293226fe6 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:47.813995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e2fa-7741-43ff-bdfe-9e3293226fe6 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:47.814094 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2834e2fa-7741-43ff-bdfe-9e3293226fe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:47.818266 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:47.887985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-2834e2fa-7741-43ff-bdfe-9e3293226fe6 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:47.889690 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2834e2fa-7741-43ff-bdfe-9e3293226fe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:48.003868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 679/1342] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:28:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:28:48.044262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3252ba-3ece-4a59-b618-888cf72c26a5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:48.045794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6a3252ba-3ece-4a59-b618-888cf72c26a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:48.100386 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:48.158663 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3252ba-3ece-4a59-b618-888cf72c26a5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:48.236461 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f13f935-0fd1-4b59-b346-6322713a108a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:48.237027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13f935-0fd1-4b59-b346-6322713a108a service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:48.237301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13f935-0fd1-4b59-b346-6322713a108a service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:48.237568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f13f935-0fd1-4b59-b346-6322713a108a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:48.239303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3f13f935-0fd1-4b59-b346-6322713a108a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:48.338857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:48.356357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13f935-0fd1-4b59-b346-6322713a108a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:48.357794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f13f935-0fd1-4b59-b346-6322713a108a service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:48.378359 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 664/1343] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:28:51.295947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a47df9-9744-45d5-a33a-5ea12aec2919 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:51.296526 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a47df9-9744-45d5-a33a-5ea12aec2919 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:51.296526 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a47df9-9744-45d5-a33a-5ea12aec2919 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:51.297898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 680/1344] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:28:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:51.303941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5499eb-e2c4-40ad-bdb7-e460be83993a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:51.305123 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5499eb-e2c4-40ad-bdb7-e460be83993a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:51.305246 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5499eb-e2c4-40ad-bdb7-e460be83993a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:51.379989 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-bd5499eb-e2c4-40ad-bdb7-e460be83993a None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:51.381257 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bd5499eb-e2c4-40ad-bdb7-e460be83993a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:51.482256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 665/1345] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:28:51 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:28:51.520360 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a47df9-9744-45d5-a33a-5ea12aec2919 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:51.521902 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d2a47df9-9744-45d5-a33a-5ea12aec2919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:51.614582 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:51.632943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a47df9-9744-45d5-a33a-5ea12aec2919 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:51.719992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52022262-1daf-49d2-bb89-1a4210c2f5f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:51.720661 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52022262-1daf-49d2-bb89-1a4210c2f5f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:51.720945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52022262-1daf-49d2-bb89-1a4210c2f5f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:51.721219 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52022262-1daf-49d2-bb89-1a4210c2f5f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:51.722943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-52022262-1daf-49d2-bb89-1a4210c2f5f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:51.842804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52022262-1daf-49d2-bb89-1a4210c2f5f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:51.844259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52022262-1daf-49d2-bb89-1a4210c2f5f1 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:51.864506 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 681/1346] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:51 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:28:56.286535 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4b212-ba5a-4db0-a846-cc321f7c3e92 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:56.289113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4b212-ba5a-4db0-a846-cc321f7c3e92 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:56.289113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4b212-ba5a-4db0-a846-cc321f7c3e92 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:56.290415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 666/1347] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:28:56 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:28:56.295980 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362be11-4d33-41db-b3d4-d5ad83697f44 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:56.296550 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362be11-4d33-41db-b3d4-d5ad83697f44 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:56.296550 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5362be11-4d33-41db-b3d4-d5ad83697f44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:56.312310 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:56.375407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5362be11-4d33-41db-b3d4-d5ad83697f44 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:28:56.376650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5362be11-4d33-41db-b3d4-d5ad83697f44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:56.490367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 682/1348] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:28:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:28:56.530294 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4b212-ba5a-4db0-a846-cc321f7c3e92 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:28:56.531873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c4b4b212-ba5a-4db0-a846-cc321f7c3e92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:56.598173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:56.656404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4b212-ba5a-4db0-a846-cc321f7c3e92 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:28:56.740944 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f05a547-23a4-4ce3-9ba0-e358229d1cf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:28:56.742275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05a547-23a4-4ce3-9ba0-e358229d1cf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:28:56.742562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05a547-23a4-4ce3-9ba0-e358229d1cf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:28:56.742866 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f05a547-23a4-4ce3-9ba0-e358229d1cf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:28:56.744592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9f05a547-23a4-4ce3-9ba0-e358229d1cf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:28:56.863933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:28:56.867965 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05a547-23a4-4ce3-9ba0-e358229d1cf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:28:56.869527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f05a547-23a4-4ce3-9ba0-e358229d1cf5 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:28:56.891473 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 667/1349] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:28:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:29:02.025822 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5051a-145a-4bad-ad1c-661b9037b77a None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:02.026347 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5051a-145a-4bad-ad1c-661b9037b77a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:02.026587 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a5051a-145a-4bad-ad1c-661b9037b77a None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:02.028392 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 683/1350] 10.222.0.40 () {54 vars in 921 bytes} [Fri Jul 15 19:29:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:02.033895 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b4535-ca7f-4979-88fa-eb5ed84b716a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:02.034364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b4535-ca7f-4979-88fa-eb5ed84b716a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:02.034482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62b4535-ca7f-4979-88fa-eb5ed84b716a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:02.175893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f62b4535-ca7f-4979-88fa-eb5ed84b716a None None] MFA Rules not processed for user `ad68d871464f4b5588c22070205f159e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:02.177239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f62b4535-ca7f-4979-88fa-eb5ed84b716a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:02.326971 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 668/1351] 10.222.0.40 () {58 vars in 1018 bytes} [Fri Jul 15 19:29:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 294 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:06.488485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=59 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:06.896275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b81bf6-d64f-43a6-b300-8430488eb88a None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:06.896466 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b81bf6-d64f-43a6-b300-8430488eb88a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:06.896782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b81bf6-d64f-43a6-b300-8430488eb88a None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:06.898410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 684/1352] 10.222.0.40 () {54 vars in 921 bytes} [Fri Jul 15 19:29:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:06.903467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5ceb3-d7d5-438c-bdbd-7fbc75b8019d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:06.903979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5ceb3-d7d5-438c-bdbd-7fbc75b8019d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:06.904850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb5ceb3-d7d5-438c-bdbd-7fbc75b8019d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:06.963966 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:06.999015 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-abb5ceb3-d7d5-438c-bdbd-7fbc75b8019d None None] MFA Rules not processed for user `ad68d871464f4b5588c22070205f159e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:07.001375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-abb5ceb3-d7d5-438c-bdbd-7fbc75b8019d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:07.151281 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 669/1353] 10.222.0.40 () {58 vars in 1018 bytes} [Fri Jul 15 19:29:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:08.448796 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4958915-0a99-459b-8912-211ba5e74e11 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:08.449331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4958915-0a99-459b-8912-211ba5e74e11 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:08.449331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4958915-0a99-459b-8912-211ba5e74e11 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:08.450900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 685/1354] 10.222.0.40 () {54 vars in 921 bytes} [Fri Jul 15 19:29:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:08.456259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d187230-4564-4d17-88c2-296ae0bab25a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:08.457099 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d187230-4564-4d17-88c2-296ae0bab25a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:08.457099 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d187230-4564-4d17-88c2-296ae0bab25a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:08.544846 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4d187230-4564-4d17-88c2-296ae0bab25a None None] MFA Rules not processed for user `ad68d871464f4b5588c22070205f159e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:08.546098 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4d187230-4564-4d17-88c2-296ae0bab25a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:08.594166 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:08.684109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 670/1355] 10.222.0.40 () {58 vars in 1018 bytes} [Fri Jul 15 19:29:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:12.113061 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323cd9b-1213-42e1-98cb-6e208050e440 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:12.113495 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323cd9b-1213-42e1-98cb-6e208050e440 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:12.113495 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2323cd9b-1213-42e1-98cb-6e208050e440 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:12.114856 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 686/1356] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:29:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:12.120663 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cebd7d-dcb1-43ef-b3d7-790bb8d08afb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:12.121183 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cebd7d-dcb1-43ef-b3d7-790bb8d08afb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:12.121288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cebd7d-dcb1-43ef-b3d7-790bb8d08afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:12.240756 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a0cebd7d-dcb1-43ef-b3d7-790bb8d08afb None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:12.243692 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a0cebd7d-dcb1-43ef-b3d7-790bb8d08afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:12.430141 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 671/1357] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:29:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:12.489503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94bac2-2267-4e21-90df-0dd0fd02ee08 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:12.489799 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94bac2-2267-4e21-90df-0dd0fd02ee08 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:12.490044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d94bac2-2267-4e21-90df-0dd0fd02ee08 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:12.492731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 687/1358] 10.222.0.40 () {54 vars in 961 bytes} [Fri Jul 15 19:29:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:12.503666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e1ab3-9b0e-4203-9053-0e93af26441d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:12.504482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e1ab3-9b0e-4203-9053-0e93af26441d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:12.504908 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5e1ab3-9b0e-4203-9053-0e93af26441d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:12.526121 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:12.602612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0f5e1ab3-9b0e-4203-9053-0e93af26441d None None] MFA Rules not processed for user `850a32e590154968bfbbfc404450b70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:12.604827 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0f5e1ab3-9b0e-4203-9053-0e93af26441d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:12.766649 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 672/1359] 10.222.0.40 () {58 vars in 1058 bytes} [Fri Jul 15 19:29:12 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:12.779112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94bac2-2267-4e21-90df-0dd0fd02ee08 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:12.782287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2d94bac2-2267-4e21-90df-0dd0fd02ee08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:13.030537 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d94bac2-2267-4e21-90df-0dd0fd02ee08 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:13.124008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:13.179594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f916dbe6-6dda-44af-88dc-e933f00ff771 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:13.180382 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916dbe6-6dda-44af-88dc-e933f00ff771 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:13.181096 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916dbe6-6dda-44af-88dc-e933f00ff771 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:13.181374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f916dbe6-6dda-44af-88dc-e933f00ff771 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:13.183175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f916dbe6-6dda-44af-88dc-e933f00ff771 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:13.325023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916dbe6-6dda-44af-88dc-e933f00ff771 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:13.328519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f916dbe6-6dda-44af-88dc-e933f00ff771 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:13.349157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 688/1360] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:29:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 571 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:29:15.725338 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7200154-c482-47c4-b15b-97f258d42f68 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:15.725338 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7200154-c482-47c4-b15b-97f258d42f68 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:15.726027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7200154-c482-47c4-b15b-97f258d42f68 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:15.727022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 673/1361] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:29:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:15.734682 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed9a19-5d0c-47ff-ae82-644f3b4693bd None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:15.735772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed9a19-5d0c-47ff-ae82-644f3b4693bd None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:15.735772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed9a19-5d0c-47ff-ae82-644f3b4693bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:15.833951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5aed9a19-5d0c-47ff-ae82-644f3b4693bd None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:15.835836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5aed9a19-5d0c-47ff-ae82-644f3b4693bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:15.889176 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:16.015477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 689/1362] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:29:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 283 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:16.087291 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7200154-c482-47c4-b15b-97f258d42f68 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:16.087291 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b7200154-c482-47c4-b15b-97f258d42f68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:16.191635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:16.304002 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7200154-c482-47c4-b15b-97f258d42f68 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:16.489536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b31415-a7ca-4c57-be9b-ceb4b89fdfbf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:16.490290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b31415-a7ca-4c57-be9b-ceb4b89fdfbf service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:16.490652 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b31415-a7ca-4c57-be9b-ceb4b89fdfbf service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:16.491805 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b31415-a7ca-4c57-be9b-ceb4b89fdfbf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:16.493919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a9b31415-a7ca-4c57-be9b-ceb4b89fdfbf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:16.525160 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:16.604040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b31415-a7ca-4c57-be9b-ceb4b89fdfbf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:16.605996 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9b31415-a7ca-4c57-be9b-ceb4b89fdfbf service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:16.634977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 674/1363] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:29:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 551 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:29:19.507791 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e787a-76b4-4282-b07d-b238ad962ac5 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:19.508893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e787a-76b4-4282-b07d-b238ad962ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:19.509287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900e787a-76b4-4282-b07d-b238ad962ac5 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:19.511156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 690/1364] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:29:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:19.517239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09772513-7b68-4755-8581-2b83d04bc8d2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:19.517962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09772513-7b68-4755-8581-2b83d04bc8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:19.517962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09772513-7b68-4755-8581-2b83d04bc8d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:19.614464 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-09772513-7b68-4755-8581-2b83d04bc8d2 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:19.616893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-09772513-7b68-4755-8581-2b83d04bc8d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:19.819121 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:19.831109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 675/1365] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:29:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:19.905488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c2d4b-820c-4be2-b8d3-c685e5dd56a7 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:19.907025 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c2d4b-820c-4be2-b8d3-c685e5dd56a7 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:19.907633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2c2d4b-820c-4be2-b8d3-c685e5dd56a7 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:19.910106 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 691/1366] 10.222.0.40 () {54 vars in 961 bytes} [Fri Jul 15 19:29:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:19.920544 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b12149-48fa-4a41-af5c-87f0806f1d61 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:19.921060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b12149-48fa-4a41-af5c-87f0806f1d61 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:19.921355 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b12149-48fa-4a41-af5c-87f0806f1d61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:20.038106 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-47b12149-48fa-4a41-af5c-87f0806f1d61 None None] MFA Rules not processed for user `850a32e590154968bfbbfc404450b70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:20.039867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-47b12149-48fa-4a41-af5c-87f0806f1d61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:20.244515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 676/1367] 10.222.0.40 () {58 vars in 1058 bytes} [Fri Jul 15 19:29:19 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:20.253005 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c2d4b-820c-4be2-b8d3-c685e5dd56a7 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:20.255741 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-fa2c2d4b-820c-4be2-b8d3-c685e5dd56a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:20.461268 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2c2d4b-820c-4be2-b8d3-c685e5dd56a7 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:20.488960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:20.616943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae06d5b9-8974-4d5b-b570-dbc2d0873f59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:20.619614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06d5b9-8974-4d5b-b570-dbc2d0873f59 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:20.619614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06d5b9-8974-4d5b-b570-dbc2d0873f59 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:20.619614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae06d5b9-8974-4d5b-b570-dbc2d0873f59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:20.622136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ae06d5b9-8974-4d5b-b570-dbc2d0873f59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:20.748580 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06d5b9-8974-4d5b-b570-dbc2d0873f59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:20.751005 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae06d5b9-8974-4d5b-b570-dbc2d0873f59 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:20.782872 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 692/1368] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:29:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:29:21.614818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dd0d7-64ed-42bf-8a55-ec4bd0e8686e None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:21.616924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dd0d7-64ed-42bf-8a55-ec4bd0e8686e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:21.616924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40dd0d7-64ed-42bf-8a55-ec4bd0e8686e None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:21.617781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 677/1369] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:29:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:29:21.623897 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d56f9-d5cb-4ed4-82af-973a5d98d0e7 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:21.624603 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d56f9-d5cb-4ed4-82af-973a5d98d0e7 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:21.624603 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-678d56f9-d5cb-4ed4-82af-973a5d98d0e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:21.660728 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:21.707062 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-678d56f9-d5cb-4ed4-82af-973a5d98d0e7 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:21.708955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-678d56f9-d5cb-4ed4-82af-973a5d98d0e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:21.849782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 693/1370] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:29:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:22.225223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12f783-b101-446b-80d5-c19c59a19afa None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:22.225586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12f783-b101-446b-80d5-c19c59a19afa None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:22.226007 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab12f783-b101-446b-80d5-c19c59a19afa None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:22.227713 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 678/1371] 10.222.0.40 () {54 vars in 963 bytes} [Fri Jul 15 19:29:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:22.233390 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5a5f5-8597-4a27-abdd-7b9d67e5006a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:22.233688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5a5f5-8597-4a27-abdd-7b9d67e5006a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:22.233952 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c5a5f5-8597-4a27-abdd-7b9d67e5006a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:22.372774 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-53c5a5f5-8597-4a27-abdd-7b9d67e5006a None None] MFA Rules not processed for user `4776b70a88a04be7bfe6729e16c16647`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:22.374298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-53c5a5f5-8597-4a27-abdd-7b9d67e5006a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:22.445152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:22.484507 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 694/1372] 10.222.0.40 () {58 vars in 1060 bytes} [Fri Jul 15 19:29:22 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:22.493783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12f783-b101-446b-80d5-c19c59a19afa None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:22.495374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ab12f783-b101-446b-80d5-c19c59a19afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:22.577009 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:22.687649 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab12f783-b101-446b-80d5-c19c59a19afa None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:22.837782 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010f53c1-2cde-4ee8-9fe0-714272599a01 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:22.837782 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f53c1-2cde-4ee8-9fe0-714272599a01 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:22.837782 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f53c1-2cde-4ee8-9fe0-714272599a01 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:22.837782 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010f53c1-2cde-4ee8-9fe0-714272599a01 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:22.839828 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-010f53c1-2cde-4ee8-9fe0-714272599a01 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:22.968610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:22.986615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f53c1-2cde-4ee8-9fe0-714272599a01 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:22.987885 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-010f53c1-2cde-4ee8-9fe0-714272599a01 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:23.013944 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 679/1373] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:29:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:29:23.271246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e89f8f-26fc-4994-ac42-c92491aa8137 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:23.282630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e89f8f-26fc-4994-ac42-c92491aa8137 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:23.282630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e89f8f-26fc-4994-ac42-c92491aa8137 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:23.282630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 695/1374] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:29:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:23.283548 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f00b06-932a-4638-aa22-e03f77c2d752 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:23.283548 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f00b06-932a-4638-aa22-e03f77c2d752 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:23.283548 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f00b06-932a-4638-aa22-e03f77c2d752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:23.393528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-25f00b06-932a-4638-aa22-e03f77c2d752 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:23.395215 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-25f00b06-932a-4638-aa22-e03f77c2d752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:23.511836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 680/1375] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:29:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:29:23.562867 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e89f8f-26fc-4994-ac42-c92491aa8137 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:23.564591 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-52e89f8f-26fc-4994-ac42-c92491aa8137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:23.801493 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e89f8f-26fc-4994-ac42-c92491aa8137 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:23.869798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:23.945273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26553d58-9784-472b-8671-3be5f5f1c072 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:23.945933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553d58-9784-472b-8671-3be5f5f1c072 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:23.946217 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553d58-9784-472b-8671-3be5f5f1c072 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:23.946495 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26553d58-9784-472b-8671-3be5f5f1c072 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:23.948281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-26553d58-9784-472b-8671-3be5f5f1c072 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:24.056729 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26553d58-9784-472b-8671-3be5f5f1c072 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:24.059671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26553d58-9784-472b-8671-3be5f5f1c072 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:24.087935 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 696/1376] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:29:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:29:26.406723 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ce864-17bf-496d-8457-bef2c7492816 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:26.407290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ce864-17bf-496d-8457-bef2c7492816 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:26.407290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ce864-17bf-496d-8457-bef2c7492816 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:26.408679 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 681/1377] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:29:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:26.414803 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded33572-dcfd-4594-a295-55baf498b3d2 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:26.415301 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded33572-dcfd-4594-a295-55baf498b3d2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:26.415787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded33572-dcfd-4594-a295-55baf498b3d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:26.510123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-ded33572-dcfd-4594-a295-55baf498b3d2 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:26.511517 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ded33572-dcfd-4594-a295-55baf498b3d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:26.520208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:26.642630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 697/1378] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:29:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:29:26.690063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ce864-17bf-496d-8457-bef2c7492816 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:26.691694 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6b6ce864-17bf-496d-8457-bef2c7492816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:26.762927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:26.896298 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ce864-17bf-496d-8457-bef2c7492816 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:27.118663 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eec0282-d84c-4870-86d8-f86e36de3f71 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:27.119353 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec0282-d84c-4870-86d8-f86e36de3f71 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:27.119632 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec0282-d84c-4870-86d8-f86e36de3f71 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:27.119902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eec0282-d84c-4870-86d8-f86e36de3f71 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:27.121633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0eec0282-d84c-4870-86d8-f86e36de3f71 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:27.146466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:27.258852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec0282-d84c-4870-86d8-f86e36de3f71 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:27.260511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eec0282-d84c-4870-86d8-f86e36de3f71 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:27.281612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 682/1379] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:29:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:29:29.707216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc2c05-ef83-4eab-a8c2-fa7a203252c2 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:29.708053 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc2c05-ef83-4eab-a8c2-fa7a203252c2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:29.708053 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dc2c05-ef83-4eab-a8c2-fa7a203252c2 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:29.710041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 698/1380] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:29:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:29:29.715771 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef470cd9-ae5a-4f8e-a78a-5f16b512f9d4 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:29.716574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef470cd9-ae5a-4f8e-a78a-5f16b512f9d4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:29.716574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef470cd9-ae5a-4f8e-a78a-5f16b512f9d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:29.798978 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ef470cd9-ae5a-4f8e-a78a-5f16b512f9d4 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:29.801113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ef470cd9-ae5a-4f8e-a78a-5f16b512f9d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:29.935882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:29.946813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 683/1381] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:29:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:29:30.026514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc2c05-ef83-4eab-a8c2-fa7a203252c2 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:30.029048 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b4dc2c05-ef83-4eab-a8c2-fa7a203252c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:30.216214 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:30.228636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4dc2c05-ef83-4eab-a8c2-fa7a203252c2 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:30.372069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70bda56-d0f6-4aa3-a890-ecd9508466c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:30.372793 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bda56-d0f6-4aa3-a890-ecd9508466c3 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:30.373071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bda56-d0f6-4aa3-a890-ecd9508466c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:30.373342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70bda56-d0f6-4aa3-a890-ecd9508466c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:30.375077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b70bda56-d0f6-4aa3-a890-ecd9508466c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:30.484368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70bda56-d0f6-4aa3-a890-ecd9508466c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:30.485970 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70bda56-d0f6-4aa3-a890-ecd9508466c3 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:30.498898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:30.508923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 699/1382] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:29:32.796600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d35028-5949-42e9-b719-d65e5fc562fa None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:32.797167 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d35028-5949-42e9-b719-d65e5fc562fa None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:32.797167 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d35028-5949-42e9-b719-d65e5fc562fa None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:32.798573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 684/1383] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 15 19:29:32.804230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a85de-91fd-448f-91b4-fb3fb192171d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:32.804746 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a85de-91fd-448f-91b4-fb3fb192171d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:32.804973 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2a85de-91fd-448f-91b4-fb3fb192171d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:32.882063 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-df2a85de-91fd-448f-91b4-fb3fb192171d None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:32.883737 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-df2a85de-91fd-448f-91b4-fb3fb192171d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:33.002302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 700/1384] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:33.047591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d35028-5949-42e9-b719-d65e5fc562fa None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:33.049136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b4d35028-5949-42e9-b719-d65e5fc562fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:33.242271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d35028-5949-42e9-b719-d65e5fc562fa None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:33.335528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:33.398588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266087cc-780f-438b-8ecd-1527db3e9464 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:33.399495 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266087cc-780f-438b-8ecd-1527db3e9464 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:33.399787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266087cc-780f-438b-8ecd-1527db3e9464 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:33.400571 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266087cc-780f-438b-8ecd-1527db3e9464 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:33.402683 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-266087cc-780f-438b-8ecd-1527db3e9464 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:33.507911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266087cc-780f-438b-8ecd-1527db3e9464 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:33.509552 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266087cc-780f-438b-8ecd-1527db3e9464 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:33.529056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 685/1385] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 482 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:29:36.196472 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1c8c2-ac1b-4b7d-84e7-662e9672c8fa None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:36.197039 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1c8c2-ac1b-4b7d-84e7-662e9672c8fa None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:36.197039 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf1c8c2-ac1b-4b7d-84e7-662e9672c8fa None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:36.198430 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 701/1386] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:36.205784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f95819-389e-429a-a7f6-e61464ec8ec4 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:36.206308 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f95819-389e-429a-a7f6-e61464ec8ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:36.206543 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f95819-389e-429a-a7f6-e61464ec8ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:36.297667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-41f95819-389e-429a-a7f6-e61464ec8ec4 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:36.299259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-41f95819-389e-429a-a7f6-e61464ec8ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:36.345033 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:36.431555 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 686/1387] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:36.478656 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1c8c2-ac1b-4b7d-84e7-662e9672c8fa None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:36.480276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-dbf1c8c2-ac1b-4b7d-84e7-662e9672c8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:36.564305 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:36.647920 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbf1c8c2-ac1b-4b7d-84e7-662e9672c8fa None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:36.796256 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b16bbd-13cc-4968-86f8-c362df4cecbe service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:36.797469 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b16bbd-13cc-4968-86f8-c362df4cecbe service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:36.798008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b16bbd-13cc-4968-86f8-c362df4cecbe service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:36.798557 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b16bbd-13cc-4968-86f8-c362df4cecbe service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:36.802081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-75b16bbd-13cc-4968-86f8-c362df4cecbe service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:36.862134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:36.929541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b16bbd-13cc-4968-86f8-c362df4cecbe service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:36.931279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b16bbd-13cc-4968-86f8-c362df4cecbe service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:36.951465 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 702/1388] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:29:38.939519 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7e28e-e08e-41c7-afea-6ae835479300 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:38.940310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7e28e-e08e-41c7-afea-6ae835479300 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:38.940310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa7e28e-e08e-41c7-afea-6ae835479300 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:38.941515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 687/1389] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:29:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:38.948007 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f516d-6373-45d1-a824-9d63539c69f1 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:38.948807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f516d-6373-45d1-a824-9d63539c69f1 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:38.948807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f516d-6373-45d1-a824-9d63539c69f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:39.020751 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-538f516d-6373-45d1-a824-9d63539c69f1 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:39.022025 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-538f516d-6373-45d1-a824-9d63539c69f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:39.145856 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 703/1390] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:39.163306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c217d3-9e3a-44bc-8561-5ccf7b2dab87 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:39.163547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c217d3-9e3a-44bc-8561-5ccf7b2dab87 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:39.163821 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c217d3-9e3a-44bc-8561-5ccf7b2dab87 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:39.165222 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 688/1391] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:29:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:39.171088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847e835-e67d-4be5-a237-b7e4af07d703 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:39.171378 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847e835-e67d-4be5-a237-b7e4af07d703 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:39.171657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b847e835-e67d-4be5-a237-b7e4af07d703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:39.196001 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:39.217740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f174edc-c6be-47b3-8fd2-d7e2f39984fd None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:39.218024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f174edc-c6be-47b3-8fd2-d7e2f39984fd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:39.218364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f174edc-c6be-47b3-8fd2-d7e2f39984fd None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:39.219947 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 689/1392] 10.222.0.40 () {54 vars in 960 bytes} [Fri Jul 15 19:29:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:39.225643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f8f41-902b-48c3-8a27-eac24230c953 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:39.225929 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f8f41-902b-48c3-8a27-eac24230c953 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:39.226209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871f8f41-902b-48c3-8a27-eac24230c953 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:39.256911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-b847e835-e67d-4be5-a237-b7e4af07d703 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:39.258167 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b847e835-e67d-4be5-a237-b7e4af07d703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:39.388044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 704/1393] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:29:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:39.436576 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847e835-e67d-4be5-a237-b7e4af07d703 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:39.437798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b847e835-e67d-4be5-a237-b7e4af07d703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:39.439762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-871f8f41-902b-48c3-8a27-eac24230c953 None None] MFA Rules not processed for user `2352b5c2aa664bf0a7e321ff3a5038fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:39.441028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-871f8f41-902b-48c3-8a27-eac24230c953 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:39.527258 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 690/1394] 10.222.0.40 () {58 vars in 1057 bytes} [Fri Jul 15 19:29:39 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:29:39.534893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f8f41-902b-48c3-8a27-eac24230c953 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:39.543245 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:39.543510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871f8f41-902b-48c3-8a27-eac24230c953 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:39.567668 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:39.571143 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b847e835-e67d-4be5-a237-b7e4af07d703 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:39.626166 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff848749-e953-4077-abac-450d4ddc903d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2352b5c2aa664bf0a7e321ff3a5038fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:39.626868 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff848749-e953-4077-abac-450d4ddc903d service glance] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:39.627185 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff848749-e953-4077-abac-450d4ddc903d service glance] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:39.627462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff848749-e953-4077-abac-450d4ddc903d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:39.629140 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ff848749-e953-4077-abac-450d4ddc903d service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:39.700097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e292c8a-36a5-4242-ab20-99013153b3c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:39.700654 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e292c8a-36a5-4242-ab20-99013153b3c3 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:39.700935 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e292c8a-36a5-4242-ab20-99013153b3c3 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:39.701211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e292c8a-36a5-4242-ab20-99013153b3c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:39.702909 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3e292c8a-36a5-4242-ab20-99013153b3c3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:39.751038 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff848749-e953-4077-abac-450d4ddc903d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:39.752477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff848749-e953-4077-abac-450d4ddc903d service glance] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:39.773909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 691/1395] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:29:39.801466 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:39.804796 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e292c8a-36a5-4242-ab20-99013153b3c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:39.806465 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e292c8a-36a5-4242-ab20-99013153b3c3 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:39.827395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 705/1396] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:29:40.677269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1838c-a41b-4677-9548-d75979d2b89f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:40.677269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1838c-a41b-4677-9548-d75979d2b89f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:40.677269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d1838c-a41b-4677-9548-d75979d2b89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:40.747331 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-37d1838c-a41b-4677-9548-d75979d2b89f None None] MFA Rules not processed for user `deed55901c264b8da58e57c21840c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:40.748938 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-37d1838c-a41b-4677-9548-d75979d2b89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:40.751217 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:40.844444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 692/1397] 10.222.0.40 () {58 vars in 1009 bytes} [Fri Jul 15 19:29:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:40.887917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b19701-dc18-4b26-8427-9bf5b2db4f3c None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:40.888432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b19701-dc18-4b26-8427-9bf5b2db4f3c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:40.888546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b19701-dc18-4b26-8427-9bf5b2db4f3c None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:40.889853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 706/1398] 10.222.0.40 () {54 vars in 942 bytes} [Fri Jul 15 19:29:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:40.897726 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce85fe4-6748-4fa1-b82c-ffa5ef86909f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:40.898016 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce85fe4-6748-4fa1-b82c-ffa5ef86909f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:40.898287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce85fe4-6748-4fa1-b82c-ffa5ef86909f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:40.993304 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-bce85fe4-6748-4fa1-b82c-ffa5ef86909f None None] MFA Rules not processed for user `0402e1bd20b042cdbdcb890616b22726`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:40.994498 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bce85fe4-6748-4fa1-b82c-ffa5ef86909f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:41.089290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:41.124875 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 693/1399] 10.222.0.40 () {58 vars in 1039 bytes} [Fri Jul 15 19:29:40 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:41.135164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b19701-dc18-4b26-8427-9bf5b2db4f3c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:41.136713 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-80b19701-dc18-4b26-8427-9bf5b2db4f3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:41.292298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b19701-dc18-4b26-8427-9bf5b2db4f3c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:41.381963 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:41.417507 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1ad811-c532-4859-ba8c-cef49089a7e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0402e1bd20b042cdbdcb890616b22726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:41.418041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ad811-c532-4859-ba8c-cef49089a7e5 service swift] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:41.418325 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ad811-c532-4859-ba8c-cef49089a7e5 service swift] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:41.418676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1ad811-c532-4859-ba8c-cef49089a7e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:41.420335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-cf1ad811-c532-4859-ba8c-cef49089a7e5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:41.512399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ad811-c532-4859-ba8c-cef49089a7e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:41.514180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1ad811-c532-4859-ba8c-cef49089a7e5 service swift] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:41.523657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 707/1400] 10.222.0.40 () {60 vars in 1384 bytes} [Fri Jul 15 19:29:41 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:29:42.115592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357e85d-34f5-4098-9847-8adf4f619469 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:42.116247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357e85d-34f5-4098-9847-8adf4f619469 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:42.116247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1357e85d-34f5-4098-9847-8adf4f619469 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:42.118697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 694/1401] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:29:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:42.123910 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0555fe9-6ffe-4736-ac33-4cd85ffa7a46 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:42.124438 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0555fe9-6ffe-4736-ac33-4cd85ffa7a46 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:42.124817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0555fe9-6ffe-4736-ac33-4cd85ffa7a46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:42.211090 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f0555fe9-6ffe-4736-ac33-4cd85ffa7a46 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:42.212323 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f0555fe9-6ffe-4736-ac33-4cd85ffa7a46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:42.287453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:42.362141 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 708/1402] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:29:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:42.412593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357e85d-34f5-4098-9847-8adf4f619469 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:42.416737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1357e85d-34f5-4098-9847-8adf4f619469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:42.587641 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1357e85d-34f5-4098-9847-8adf4f619469 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:42.665219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:42.756690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f92b055a-336e-4a1e-9752-015296ea77d8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:42.757535 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b055a-336e-4a1e-9752-015296ea77d8 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:42.757898 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b055a-336e-4a1e-9752-015296ea77d8 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:42.758245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f92b055a-336e-4a1e-9752-015296ea77d8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:42.760263 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f92b055a-336e-4a1e-9752-015296ea77d8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:42.920993 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b055a-336e-4a1e-9752-015296ea77d8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:42.923884 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f92b055a-336e-4a1e-9752-015296ea77d8 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:42.949507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 695/1403] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:29:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:29:45.945230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b281a4-4905-420e-bc7f-4ba2a87c42ab None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:45.945835 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b281a4-4905-420e-bc7f-4ba2a87c42ab None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:45.945835 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b281a4-4905-420e-bc7f-4ba2a87c42ab None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:45.951089 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 709/1404] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:29:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:45.952786 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ce3cd-9485-4535-bfd8-ea2edc76aeb6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:45.953247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ce3cd-9485-4535-bfd8-ea2edc76aeb6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:45.953341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78ce3cd-9485-4535-bfd8-ea2edc76aeb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:46.035533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e78ce3cd-9485-4535-bfd8-ea2edc76aeb6 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:46.038794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e78ce3cd-9485-4535-bfd8-ea2edc76aeb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:46.066512 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:46.186795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 696/1405] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:29:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:29:46.229875 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b281a4-4905-420e-bc7f-4ba2a87c42ab None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:46.231452 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e3b281a4-4905-420e-bc7f-4ba2a87c42ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:46.421782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b281a4-4905-420e-bc7f-4ba2a87c42ab None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:46.478343 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:46.560272 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed9c680-722d-439e-80fc-cae3bdcbb729 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:46.561351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9c680-722d-439e-80fc-cae3bdcbb729 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:46.561637 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9c680-722d-439e-80fc-cae3bdcbb729 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:46.561916 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed9c680-722d-439e-80fc-cae3bdcbb729 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:46.563824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1ed9c680-722d-439e-80fc-cae3bdcbb729 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:46.675645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9c680-722d-439e-80fc-cae3bdcbb729 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:46.677651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed9c680-722d-439e-80fc-cae3bdcbb729 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:46.698175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 710/1406] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:29:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:29:48.939285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c421ac-d447-4cc6-a419-93de1b2099d5 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:48.939884 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c421ac-d447-4cc6-a419-93de1b2099d5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:48.939884 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c421ac-d447-4cc6-a419-93de1b2099d5 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:48.941205 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 697/1407] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:29:48.953230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165ae68-91df-45cd-9e77-cd24376b5057 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:48.954311 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165ae68-91df-45cd-9e77-cd24376b5057 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:48.954662 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9165ae68-91df-45cd-9e77-cd24376b5057 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:49.034864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:49.038411 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-9165ae68-91df-45cd-9e77-cd24376b5057 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:29:49.045439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9165ae68-91df-45cd-9e77-cd24376b5057 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:49.204317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 711/1408] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:29:49.267026 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c421ac-d447-4cc6-a419-93de1b2099d5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:29:49.268561 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-91c421ac-d447-4cc6-a419-93de1b2099d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:49.449701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:49.456205 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c421ac-d447-4cc6-a419-93de1b2099d5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:29:49.590495 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd28e87-ba6a-4bf9-bfdb-6a1b5f1e59d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:29:49.591202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd28e87-ba6a-4bf9-bfdb-6a1b5f1e59d4 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:29:49.591486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd28e87-ba6a-4bf9-bfdb-6a1b5f1e59d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:29:49.591762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd28e87-ba6a-4bf9-bfdb-6a1b5f1e59d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:29:49.593464 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2bd28e87-ba6a-4bf9-bfdb-6a1b5f1e59d4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:29:49.695960 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd28e87-ba6a-4bf9-bfdb-6a1b5f1e59d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:29:49.697580 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd28e87-ba6a-4bf9-bfdb-6a1b5f1e59d4 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:29:49.715992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:29:49.719459 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 698/1409] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:29:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 453 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:29:59.373577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=43 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:05.726057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de96f80-fa70-4e6b-998d-97506ab24491 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:05.726763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de96f80-fa70-4e6b-998d-97506ab24491 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:05.726763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de96f80-fa70-4e6b-998d-97506ab24491 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:05.728015 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 712/1410] 10.222.0.40 () {54 vars in 918 bytes} [Fri Jul 15 19:30:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:05.733595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5449e-825a-4f89-a9b8-f44f8914b5ad None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:05.734063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5449e-825a-4f89-a9b8-f44f8914b5ad None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:05.734169 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c5449e-825a-4f89-a9b8-f44f8914b5ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:05.809280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d2c5449e-825a-4f89-a9b8-f44f8914b5ad None None] MFA Rules not processed for user `ad68d871464f4b5588c22070205f159e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:05.810502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d2c5449e-825a-4f89-a9b8-f44f8914b5ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:05.917882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 699/1411] 10.222.0.40 () {58 vars in 1015 bytes} [Fri Jul 15 19:30:05 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:05.934722 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5869fb-d4b7-4b5e-a77b-7887442f18d3 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:05.935032 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5869fb-d4b7-4b5e-a77b-7887442f18d3 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:05.935312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5869fb-d4b7-4b5e-a77b-7887442f18d3 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:05.936668 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 713/1412] 10.222.0.40 () {54 vars in 918 bytes} [Fri Jul 15 19:30:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:05.941514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647609f-f872-4017-bf73-e7925e2aae60 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:05.941810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647609f-f872-4017-bf73-e7925e2aae60 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:05.942091 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c647609f-f872-4017-bf73-e7925e2aae60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:06.014050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:06.017024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c647609f-f872-4017-bf73-e7925e2aae60 None None] MFA Rules not processed for user `850a32e590154968bfbbfc404450b70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:06.018245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c647609f-f872-4017-bf73-e7925e2aae60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:06.138170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 700/1413] 10.222.0.40 () {58 vars in 1015 bytes} [Fri Jul 15 19:30:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:08.636308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e6913-0ec1-43d3-9a8f-2afd550e4e47 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:08.636875 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e6913-0ec1-43d3-9a8f-2afd550e4e47 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:08.636875 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426e6913-0ec1-43d3-9a8f-2afd550e4e47 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:08.638199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 714/1414] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:30:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:08.643774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc9f9-83b4-46f1-ae30-121fbd38fa42 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:08.644206 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc9f9-83b4-46f1-ae30-121fbd38fa42 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:08.644337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fadc9f9-83b4-46f1-ae30-121fbd38fa42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:08.710954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9fadc9f9-83b4-46f1-ae30-121fbd38fa42 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:08.712170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9fadc9f9-83b4-46f1-ae30-121fbd38fa42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:08.767454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:08.809255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 701/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:30:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:08.854692 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e6913-0ec1-43d3-9a8f-2afd550e4e47 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:08.856237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-426e6913-0ec1-43d3-9a8f-2afd550e4e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:09.007743 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426e6913-0ec1-43d3-9a8f-2afd550e4e47 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:09.083500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:09.124305 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3916fe-966d-4bed-bb35-7ebcddac8b62 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:09.124950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3916fe-966d-4bed-bb35-7ebcddac8b62 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:09.125234 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3916fe-966d-4bed-bb35-7ebcddac8b62 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:09.125509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3916fe-966d-4bed-bb35-7ebcddac8b62 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:09.127215 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5c3916fe-966d-4bed-bb35-7ebcddac8b62 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:09.217264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3916fe-966d-4bed-bb35-7ebcddac8b62 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:09.218889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3916fe-966d-4bed-bb35-7ebcddac8b62 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:09.236916 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 715/1416] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:10.147166 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec65be9-99c8-4ea4-9dd9-868db241f903 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:10.147704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec65be9-99c8-4ea4-9dd9-868db241f903 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:10.147704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec65be9-99c8-4ea4-9dd9-868db241f903 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:10.149115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 702/1417] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:30:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:10.154420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931efa2-8704-4797-b40e-d51ac7293da0 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:10.154876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931efa2-8704-4797-b40e-d51ac7293da0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:10.155033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8931efa2-8704-4797-b40e-d51ac7293da0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:10.233768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-8931efa2-8704-4797-b40e-d51ac7293da0 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:10.235036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8931efa2-8704-4797-b40e-d51ac7293da0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:10.261694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:10.332223 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 716/1418] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:30:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:10.483524 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec65be9-99c8-4ea4-9dd9-868db241f903 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:10.485054 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9ec65be9-99c8-4ea4-9dd9-868db241f903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:10.628553 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec65be9-99c8-4ea4-9dd9-868db241f903 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:10.671683 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:10.745782 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6763a5d8-a0dd-423d-996a-5ba1234d95fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:10.746453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763a5d8-a0dd-423d-996a-5ba1234d95fb service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:10.746736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763a5d8-a0dd-423d-996a-5ba1234d95fb service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:10.747040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6763a5d8-a0dd-423d-996a-5ba1234d95fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:10.748690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6763a5d8-a0dd-423d-996a-5ba1234d95fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:10.838608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763a5d8-a0dd-423d-996a-5ba1234d95fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:10.840246 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6763a5d8-a0dd-423d-996a-5ba1234d95fb service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:10.859296 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 703/1419] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:11.754201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b1b38-b5a8-4bd4-80c9-3ce690d6d963 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:11.755514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b1b38-b5a8-4bd4-80c9-3ce690d6d963 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:11.755514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41b1b38-b5a8-4bd4-80c9-3ce690d6d963 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:11.756906 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 717/1420] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:30:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:11.761731 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0b6b4-2b3d-40a6-a1fa-edd0296e9467 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:11.762135 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0b6b4-2b3d-40a6-a1fa-edd0296e9467 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:11.762352 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae0b6b4-2b3d-40a6-a1fa-edd0296e9467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:11.828924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:11.859226 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8ae0b6b4-2b3d-40a6-a1fa-edd0296e9467 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:11.861209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8ae0b6b4-2b3d-40a6-a1fa-edd0296e9467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:11.968188 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 704/1421] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:12.121023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b1b38-b5a8-4bd4-80c9-3ce690d6d963 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:12.122532 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c41b1b38-b5a8-4bd4-80c9-3ce690d6d963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:12.276793 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41b1b38-b5a8-4bd4-80c9-3ce690d6d963 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:12.290042 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:12.399079 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27ce0db8-8812-467b-a372-71e76cdb1fc1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:12.399660 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce0db8-8812-467b-a372-71e76cdb1fc1 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:12.399945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce0db8-8812-467b-a372-71e76cdb1fc1 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:12.400217 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ce0db8-8812-467b-a372-71e76cdb1fc1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:12.401871 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-27ce0db8-8812-467b-a372-71e76cdb1fc1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:12.505211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce0db8-8812-467b-a372-71e76cdb1fc1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:12.508110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27ce0db8-8812-467b-a372-71e76cdb1fc1 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:12.531176 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 718/1422] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:13.432693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d74232-eeec-44ea-a9cd-626c4d3f78ec None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:13.433224 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d74232-eeec-44ea-a9cd-626c4d3f78ec None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:13.433224 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d74232-eeec-44ea-a9cd-626c4d3f78ec None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:13.434618 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 705/1423] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:13.439881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce7ec2-d403-4715-a043-c80dd04b1085 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:13.440448 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce7ec2-d403-4715-a043-c80dd04b1085 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:13.440448 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ce7ec2-d403-4715-a043-c80dd04b1085 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:13.460243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:13.523144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-40ce7ec2-d403-4715-a043-c80dd04b1085 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:13.524461 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-40ce7ec2-d403-4715-a043-c80dd04b1085 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:13.624109 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 719/1424] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:13.776378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d74232-eeec-44ea-a9cd-626c4d3f78ec None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:13.777842 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-51d74232-eeec-44ea-a9cd-626c4d3f78ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:13.890191 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:13.927451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d74232-eeec-44ea-a9cd-626c4d3f78ec None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:14.048071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f9c0abf-e13c-4025-ac08-069bc0cc9ac5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:14.048636 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c0abf-e13c-4025-ac08-069bc0cc9ac5 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:14.048949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c0abf-e13c-4025-ac08-069bc0cc9ac5 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:14.049225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f9c0abf-e13c-4025-ac08-069bc0cc9ac5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:14.050924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4f9c0abf-e13c-4025-ac08-069bc0cc9ac5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:14.135478 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:14.150244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c0abf-e13c-4025-ac08-069bc0cc9ac5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:14.151337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f9c0abf-e13c-4025-ac08-069bc0cc9ac5 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:14.170372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 706/1425] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:15.053556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dc130-c814-4b13-83e8-3c8a37b00552 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:15.054139 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dc130-c814-4b13-83e8-3c8a37b00552 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:15.054139 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519dc130-c814-4b13-83e8-3c8a37b00552 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:15.055493 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 720/1426] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:30:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:15.060515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c654ef9-e618-4241-9c74-126d4ecb2447 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:15.060985 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c654ef9-e618-4241-9c74-126d4ecb2447 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:15.061085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c654ef9-e618-4241-9c74-126d4ecb2447 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:15.150368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1c654ef9-e618-4241-9c74-126d4ecb2447 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:15.151542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1c654ef9-e618-4241-9c74-126d4ecb2447 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:15.248612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 707/1427] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:15.404048 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519dc130-c814-4b13-83e8-3c8a37b00552 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:15.405601 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-519dc130-c814-4b13-83e8-3c8a37b00552 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:15.491899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:15.554815 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519dc130-c814-4b13-83e8-3c8a37b00552 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:15.667672 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25b8078-5973-46eb-a099-db4af57e3927 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:15.668244 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b8078-5973-46eb-a099-db4af57e3927 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:15.668526 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b8078-5973-46eb-a099-db4af57e3927 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:15.668799 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25b8078-5973-46eb-a099-db4af57e3927 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:15.670446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c25b8078-5973-46eb-a099-db4af57e3927 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:15.721949 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:15.763695 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b8078-5973-46eb-a099-db4af57e3927 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:15.765294 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25b8078-5973-46eb-a099-db4af57e3927 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:15.784641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 721/1428] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 381 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:16.727287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698b08e-c5d7-4aad-8d22-7de48bfbfca1 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:16.727850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698b08e-c5d7-4aad-8d22-7de48bfbfca1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:16.727850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8698b08e-c5d7-4aad-8d22-7de48bfbfca1 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:16.729186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 708/1429] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:30:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:16.734757 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a582dc-c721-4539-bdfb-f6853797f7e3 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:16.735310 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a582dc-c721-4539-bdfb-f6853797f7e3 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:16.735601 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a582dc-c721-4539-bdfb-f6853797f7e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:16.815051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-74a582dc-c721-4539-bdfb-f6853797f7e3 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:16.816182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-74a582dc-c721-4539-bdfb-f6853797f7e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:16.915237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 722/1430] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:17.067514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698b08e-c5d7-4aad-8d22-7de48bfbfca1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:17.069117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8698b08e-c5d7-4aad-8d22-7de48bfbfca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:17.118902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:17.230397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8698b08e-c5d7-4aad-8d22-7de48bfbfca1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:17.345418 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17bbad1a-4b60-4c54-93e2-b8f7ae4a5b70 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:17.345982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbad1a-4b60-4c54-93e2-b8f7ae4a5b70 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:17.346270 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbad1a-4b60-4c54-93e2-b8f7ae4a5b70 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:17.346552 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17bbad1a-4b60-4c54-93e2-b8f7ae4a5b70 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:17.348823 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-17bbad1a-4b60-4c54-93e2-b8f7ae4a5b70 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:17.355848 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:17.442350 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbad1a-4b60-4c54-93e2-b8f7ae4a5b70 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:17.443983 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17bbad1a-4b60-4c54-93e2-b8f7ae4a5b70 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:17.462287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 709/1431] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:18.359046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cd9ea-09bf-435b-9311-c8cb9089c3f8 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:18.359566 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cd9ea-09bf-435b-9311-c8cb9089c3f8 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:18.359566 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-883cd9ea-09bf-435b-9311-c8cb9089c3f8 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:18.360882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 723/1432] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:30:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:18.366857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc4fe7-510d-49c1-a103-e1fbd89d71fd None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:18.367433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc4fe7-510d-49c1-a103-e1fbd89d71fd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:18.367433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cc4fe7-510d-49c1-a103-e1fbd89d71fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:18.445795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d4cc4fe7-510d-49c1-a103-e1fbd89d71fd None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:18.447089 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d4cc4fe7-510d-49c1-a103-e1fbd89d71fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:18.519297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:18.549839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 710/1433] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:30:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:18.705381 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cd9ea-09bf-435b-9311-c8cb9089c3f8 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:18.706940 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-883cd9ea-09bf-435b-9311-c8cb9089c3f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:18.726630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:18.857308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-883cd9ea-09bf-435b-9311-c8cb9089c3f8 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:18.953485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:18.979039 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9a196-17b3-4415-a455-611005481f3c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:18.979675 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a196-17b3-4415-a455-611005481f3c service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:18.979953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a196-17b3-4415-a455-611005481f3c service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:18.980223 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9a196-17b3-4415-a455-611005481f3c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:18.981854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a8d9a196-17b3-4415-a455-611005481f3c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:19.073160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9a196-17b3-4415-a455-611005481f3c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:19.074586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9a196-17b3-4415-a455-611005481f3c service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:19.100447 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 724/1434] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:20.019795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7a393-3169-4b00-b643-78243b464cbf None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:20.020537 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7a393-3169-4b00-b643-78243b464cbf None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:20.020537 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb7a393-3169-4b00-b643-78243b464cbf None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:20.021729 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 711/1435] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:30:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:20.027009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65d2cf-a47d-46f9-a6e4-e05abb87ab34 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:20.027426 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65d2cf-a47d-46f9-a6e4-e05abb87ab34 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:20.027731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c65d2cf-a47d-46f9-a6e4-e05abb87ab34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:20.106071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-7c65d2cf-a47d-46f9-a6e4-e05abb87ab34 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:20.107324 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-7c65d2cf-a47d-46f9-a6e4-e05abb87ab34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:20.150556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:20.207116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 725/1436] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:20.357814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7a393-3169-4b00-b643-78243b464cbf None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:20.359292 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9cb7a393-3169-4b00-b643-78243b464cbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:20.508762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb7a393-3169-4b00-b643-78243b464cbf None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:20.564127 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:20.623616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7baed02c-80fe-451b-b783-2cbaf1c4c6f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:20.624184 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baed02c-80fe-451b-b783-2cbaf1c4c6f0 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:20.624494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baed02c-80fe-451b-b783-2cbaf1c4c6f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:20.624799 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7baed02c-80fe-451b-b783-2cbaf1c4c6f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:20.626472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7baed02c-80fe-451b-b783-2cbaf1c4c6f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:20.717237 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baed02c-80fe-451b-b783-2cbaf1c4c6f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:20.718875 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7baed02c-80fe-451b-b783-2cbaf1c4c6f0 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:20.736993 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 712/1437] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:21.676464 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdd4b7-27b7-4405-b05d-9b34186dc576 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:21.677007 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdd4b7-27b7-4405-b05d-9b34186dc576 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:21.677007 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccdd4b7-27b7-4405-b05d-9b34186dc576 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:21.678415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 726/1438] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:30:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:21.683386 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10110b3-b518-4ac6-acbe-307760b7a730 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:21.683815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10110b3-b518-4ac6-acbe-307760b7a730 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:21.683947 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10110b3-b518-4ac6-acbe-307760b7a730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:21.759534 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c10110b3-b518-4ac6-acbe-307760b7a730 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:21.760752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c10110b3-b518-4ac6-acbe-307760b7a730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:21.762900 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:21.861898 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 713/1439] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:30:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:22.014410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdd4b7-27b7-4405-b05d-9b34186dc576 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:22.016170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-cccdd4b7-27b7-4405-b05d-9b34186dc576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:22.167021 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccdd4b7-27b7-4405-b05d-9b34186dc576 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:22.196536 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:22.284471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b286370-6b05-4aaa-acb8-629fbbf7175a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:22.285038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b286370-6b05-4aaa-acb8-629fbbf7175a service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:22.285377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b286370-6b05-4aaa-acb8-629fbbf7175a service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:22.285655 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b286370-6b05-4aaa-acb8-629fbbf7175a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:22.287357 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-7b286370-6b05-4aaa-acb8-629fbbf7175a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:22.377462 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b286370-6b05-4aaa-acb8-629fbbf7175a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:22.380025 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b286370-6b05-4aaa-acb8-629fbbf7175a service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:22.399388 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 727/1440] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:24.355425 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a0a2f-0ca1-4793-886c-711109904e47 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:24.356033 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a0a2f-0ca1-4793-886c-711109904e47 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:24.356033 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673a0a2f-0ca1-4793-886c-711109904e47 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:24.357334 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 714/1441] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:30:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:24.362596 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5921fd-1bd8-4471-8cfa-69848148341a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:24.363050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5921fd-1bd8-4471-8cfa-69848148341a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:24.363189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5921fd-1bd8-4471-8cfa-69848148341a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:24.404424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:24.431063 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-3b5921fd-1bd8-4471-8cfa-69848148341a None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:24.432384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3b5921fd-1bd8-4471-8cfa-69848148341a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:24.529153 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 728/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:24.569072 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a0a2f-0ca1-4793-886c-711109904e47 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:24.570537 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-673a0a2f-0ca1-4793-886c-711109904e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:24.683412 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673a0a2f-0ca1-4793-886c-711109904e47 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:24.716392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:24.759291 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3385e39b-a503-4828-9cef-5cd999a933f9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:24.759934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385e39b-a503-4828-9cef-5cd999a933f9 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:24.760220 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385e39b-a503-4828-9cef-5cd999a933f9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:24.760518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3385e39b-a503-4828-9cef-5cd999a933f9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:24.762160 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3385e39b-a503-4828-9cef-5cd999a933f9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:24.872799 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385e39b-a503-4828-9cef-5cd999a933f9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:24.874236 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3385e39b-a503-4828-9cef-5cd999a933f9 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:24.893318 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 715/1443] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:27.086085 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a00e-0e47-4b06-9588-67688640b1b9 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:27.086628 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a00e-0e47-4b06-9588-67688640b1b9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:27.086628 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b3a00e-0e47-4b06-9588-67688640b1b9 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:27.088031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 729/1444] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:30:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:27.093525 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6bfc5-e730-4d37-9b91-6201c72ce7f5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:27.094026 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6bfc5-e730-4d37-9b91-6201c72ce7f5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:27.094130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df6bfc5-e730-4d37-9b91-6201c72ce7f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:27.159728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7df6bfc5-e730-4d37-9b91-6201c72ce7f5 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:27.161520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7df6bfc5-e730-4d37-9b91-6201c72ce7f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:27.174078 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:27.260127 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 716/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:30:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:27.299400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a00e-0e47-4b06-9588-67688640b1b9 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:27.300551 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d9b3a00e-0e47-4b06-9588-67688640b1b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:27.408915 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b3a00e-0e47-4b06-9588-67688640b1b9 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:27.422764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:27.490846 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cd7595-8b53-4c14-a74f-5a5920bbbe5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:27.491498 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7595-8b53-4c14-a74f-5a5920bbbe5f service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:27.491784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7595-8b53-4c14-a74f-5a5920bbbe5f service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:27.492062 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cd7595-8b53-4c14-a74f-5a5920bbbe5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:27.493712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-12cd7595-8b53-4c14-a74f-5a5920bbbe5f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:27.624272 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd7595-8b53-4c14-a74f-5a5920bbbe5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:27.625708 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cd7595-8b53-4c14-a74f-5a5920bbbe5f service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:27.645720 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 730/1446] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:30.167206 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d01ce-4930-47ef-b273-cf606555c6f6 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:30.167651 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d01ce-4930-47ef-b273-cf606555c6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:30.167761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-643d01ce-4930-47ef-b273-cf606555c6f6 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:30.169141 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 717/1447] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:30:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:30.174601 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c27408-8991-4458-873f-d221ba4854eb None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:30.175102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c27408-8991-4458-873f-d221ba4854eb None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:30.175243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c27408-8991-4458-873f-d221ba4854eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:30.226550 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:30.249880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-34c27408-8991-4458-873f-d221ba4854eb None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:30.251237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-34c27408-8991-4458-873f-d221ba4854eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:30.364286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 731/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:30:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:30.404264 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d01ce-4930-47ef-b273-cf606555c6f6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:30.405975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-643d01ce-4930-47ef-b273-cf606555c6f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:30.521493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-643d01ce-4930-47ef-b273-cf606555c6f6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:30.563766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:30.599791 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7ab618-426c-448f-b8a6-361943de7090 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:30.600867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ab618-426c-448f-b8a6-361943de7090 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:30.601368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ab618-426c-448f-b8a6-361943de7090 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:30.601860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7ab618-426c-448f-b8a6-361943de7090 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:30.605098 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9d7ab618-426c-448f-b8a6-361943de7090 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:30.729967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ab618-426c-448f-b8a6-361943de7090 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:30.731463 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7ab618-426c-448f-b8a6-361943de7090 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:30.751582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 718/1449] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:32.940726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65e842-7213-4282-ae4d-f353211f94cc None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:32.941323 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65e842-7213-4282-ae4d-f353211f94cc None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:32.942071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da65e842-7213-4282-ae4d-f353211f94cc None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:32.943626 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 732/1450] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:30:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:32.949635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75143492-7bec-4290-a751-f77bec951baa None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:32.950126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75143492-7bec-4290-a751-f77bec951baa None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:32.950235 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75143492-7bec-4290-a751-f77bec951baa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:33.020899 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-75143492-7bec-4290-a751-f77bec951baa None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:33.022124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-75143492-7bec-4290-a751-f77bec951baa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:33.043780 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:33.128358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 719/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:33.168083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65e842-7213-4282-ae4d-f353211f94cc None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:33.169634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-da65e842-7213-4282-ae4d-f353211f94cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:33.287744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da65e842-7213-4282-ae4d-f353211f94cc None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:33.310101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:33.366383 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c4e5ee-3585-4309-8a16-2c90b87db37f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:33.367073 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4e5ee-3585-4309-8a16-2c90b87db37f service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:33.367351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4e5ee-3585-4309-8a16-2c90b87db37f service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:33.367628 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c4e5ee-3585-4309-8a16-2c90b87db37f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:33.369344 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-73c4e5ee-3585-4309-8a16-2c90b87db37f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:33.486248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4e5ee-3585-4309-8a16-2c90b87db37f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:33.487769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c4e5ee-3585-4309-8a16-2c90b87db37f service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:33.508526 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 733/1452] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:35.690131 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab01ae-5068-4386-8cc7-a20d037fbf56 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:35.690677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab01ae-5068-4386-8cc7-a20d037fbf56 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:35.690677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecab01ae-5068-4386-8cc7-a20d037fbf56 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:35.692622 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 720/1453] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:30:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:35.698057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ec980-91bc-47cd-9bf6-3ff0e68f91f8 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:35.698492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ec980-91bc-47cd-9bf6-3ff0e68f91f8 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:35.698627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641ec980-91bc-47cd-9bf6-3ff0e68f91f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:35.763168 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:35.766171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-641ec980-91bc-47cd-9bf6-3ff0e68f91f8 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:35.767423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-641ec980-91bc-47cd-9bf6-3ff0e68f91f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:35.863989 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 734/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:30:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:35.902784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab01ae-5068-4386-8cc7-a20d037fbf56 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:35.904402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ecab01ae-5068-4386-8cc7-a20d037fbf56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:36.008848 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecab01ae-5068-4386-8cc7-a20d037fbf56 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:36.058240 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:36.084542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a0e0da-6b42-42ed-bf12-28e291971746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:36.085268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0e0da-6b42-42ed-bf12-28e291971746 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:36.085565 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0e0da-6b42-42ed-bf12-28e291971746 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:36.086038 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a0e0da-6b42-42ed-bf12-28e291971746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:36.088312 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-38a0e0da-6b42-42ed-bf12-28e291971746 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:36.200757 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0e0da-6b42-42ed-bf12-28e291971746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:36.202207 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a0e0da-6b42-42ed-bf12-28e291971746 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:36.221429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 721/1455] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:38.323230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d60bb-cb81-4581-bdae-7a2b54497a4d None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:38.323852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d60bb-cb81-4581-bdae-7a2b54497a4d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:38.323852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866d60bb-cb81-4581-bdae-7a2b54497a4d None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:38.325167 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 735/1456] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:30:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:38.330403 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66780a51-0ec1-4b40-bfd5-91aab92070cd None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:38.330882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66780a51-0ec1-4b40-bfd5-91aab92070cd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:38.330986 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66780a51-0ec1-4b40-bfd5-91aab92070cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:38.396034 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-66780a51-0ec1-4b40-bfd5-91aab92070cd None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:38.397264 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-66780a51-0ec1-4b40-bfd5-91aab92070cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:38.428147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:38.498305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 722/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:38.536793 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d60bb-cb81-4581-bdae-7a2b54497a4d None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:38.538340 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-866d60bb-cb81-4581-bdae-7a2b54497a4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:38.647704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866d60bb-cb81-4581-bdae-7a2b54497a4d None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:38.677886 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:38.724459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a68d883-8b69-4e41-a12f-728e7aa3c1f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:38.725107 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68d883-8b69-4e41-a12f-728e7aa3c1f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:38.725391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68d883-8b69-4e41-a12f-728e7aa3c1f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:38.725666 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a68d883-8b69-4e41-a12f-728e7aa3c1f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:38.727370 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4a68d883-8b69-4e41-a12f-728e7aa3c1f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:38.836003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68d883-8b69-4e41-a12f-728e7aa3c1f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:38.837438 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a68d883-8b69-4e41-a12f-728e7aa3c1f0 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:38.856725 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 736/1458] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:40.991962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a9e6e-19f2-4529-b8b3-0aabe088790d None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:40.992538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a9e6e-19f2-4529-b8b3-0aabe088790d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:40.992538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9a9e6e-19f2-4529-b8b3-0aabe088790d None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:40.993880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 723/1459] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:30:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:40.999546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ba842-0995-4d06-ba08-b72826907344 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:41.000017 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ba842-0995-4d06-ba08-b72826907344 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:41.000124 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6ba842-0995-4d06-ba08-b72826907344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:41.070885 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5e6ba842-0995-4d06-ba08-b72826907344 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:41.072149 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5e6ba842-0995-4d06-ba08-b72826907344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:41.081061 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:41.171704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 737/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:41.210200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a9e6e-19f2-4529-b8b3-0aabe088790d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:41.211770 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ab9a9e6e-19f2-4529-b8b3-0aabe088790d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:41.315688 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9a9e6e-19f2-4529-b8b3-0aabe088790d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:41.370513 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:41.389318 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f970d7-cc5a-4bd7-baf2-8c70ad44a975 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:41.389956 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f970d7-cc5a-4bd7-baf2-8c70ad44a975 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:41.390485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f970d7-cc5a-4bd7-baf2-8c70ad44a975 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:41.390774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f970d7-cc5a-4bd7-baf2-8c70ad44a975 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:41.392432 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-29f970d7-cc5a-4bd7-baf2-8c70ad44a975 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:41.501262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f970d7-cc5a-4bd7-baf2-8c70ad44a975 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:41.502619 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f970d7-cc5a-4bd7-baf2-8c70ad44a975 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:41.522331 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 724/1461] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:43.605263 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731337f-1071-444d-b184-5f12ad98f018 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:43.605777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731337f-1071-444d-b184-5f12ad98f018 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:43.605907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a731337f-1071-444d-b184-5f12ad98f018 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:43.607253 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 738/1462] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:30:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:43.613196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0622e-96d2-4591-9ddd-006ce7b28441 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:43.613715 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0622e-96d2-4591-9ddd-006ce7b28441 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:43.613826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0622e-96d2-4591-9ddd-006ce7b28441 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:43.680538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9ca0622e-96d2-4591-9ddd-006ce7b28441 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:43.681773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9ca0622e-96d2-4591-9ddd-006ce7b28441 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:43.719524 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:43.779129 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 725/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:30:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:43.817090 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731337f-1071-444d-b184-5f12ad98f018 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:43.818639 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a731337f-1071-444d-b184-5f12ad98f018 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:43.923992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a731337f-1071-444d-b184-5f12ad98f018 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:43.963057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:44.000890 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6edd1032-8504-4692-86d0-d7358f046868 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:44.001531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd1032-8504-4692-86d0-d7358f046868 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:44.001810 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd1032-8504-4692-86d0-d7358f046868 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:44.002082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6edd1032-8504-4692-86d0-d7358f046868 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:44.004140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6edd1032-8504-4692-86d0-d7358f046868 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:44.117570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd1032-8504-4692-86d0-d7358f046868 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:44.119032 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6edd1032-8504-4692-86d0-d7358f046868 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:44.138047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 739/1464] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:46.181829 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4bcd3-d0cb-4877-b3d0-bb141631ab58 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:46.182549 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4bcd3-d0cb-4877-b3d0-bb141631ab58 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:46.182549 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1b4bcd3-d0cb-4877-b3d0-bb141631ab58 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:46.183822 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 726/1465] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:30:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:46.189224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824c0b1-b5d6-4a24-95de-ab3d8774a553 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:46.189688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824c0b1-b5d6-4a24-95de-ab3d8774a553 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:46.189801 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5824c0b1-b5d6-4a24-95de-ab3d8774a553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:46.258534 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5824c0b1-b5d6-4a24-95de-ab3d8774a553 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:46.259789 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5824c0b1-b5d6-4a24-95de-ab3d8774a553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:46.280949 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:46.361026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 740/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:30:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:46.398845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4bcd3-d0cb-4877-b3d0-bb141631ab58 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:46.400391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a1b4bcd3-d0cb-4877-b3d0-bb141631ab58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:46.509750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1b4bcd3-d0cb-4877-b3d0-bb141631ab58 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:46.582342 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:46.589948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca836c6-9383-491c-bafe-49ee7b80a751 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:46.590604 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca836c6-9383-491c-bafe-49ee7b80a751 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:46.590920 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca836c6-9383-491c-bafe-49ee7b80a751 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:46.591197 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca836c6-9383-491c-bafe-49ee7b80a751 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:46.592924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2ca836c6-9383-491c-bafe-49ee7b80a751 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:46.717328 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca836c6-9383-491c-bafe-49ee7b80a751 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:46.718826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca836c6-9383-491c-bafe-49ee7b80a751 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:46.739589 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 727/1467] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:48.806586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f63f6-1666-4d10-a629-d6af7febcb34 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.807192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f63f6-1666-4d10-a629-d6af7febcb34 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.807310 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22f63f6-1666-4d10-a629-d6af7febcb34 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.808610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 741/1468] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:30:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:30:48.813975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3cf52-1ea0-40c6-a424-4f48e0df2e27 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:48.814391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3cf52-1ea0-40c6-a424-4f48e0df2e27 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:48.814554 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df3cf52-1ea0-40c6-a424-4f48e0df2e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:48.880932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6df3cf52-1ea0-40c6-a424-4f48e0df2e27 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:30:48.882158 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6df3cf52-1ea0-40c6-a424-4f48e0df2e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:48.930932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:48.980525 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 728/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:30:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:30:49.017265 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f63f6-1666-4d10-a629-d6af7febcb34 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:30:49.019458 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d22f63f6-1666-4d10-a629-d6af7febcb34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:49.134780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22f63f6-1666-4d10-a629-d6af7febcb34 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:30:49.183014 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:49.209763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2beac6e3-d761-4b46-8ba1-3be836526bd4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:30:49.210417 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beac6e3-d761-4b46-8ba1-3be836526bd4 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:30:49.210730 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beac6e3-d761-4b46-8ba1-3be836526bd4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:30:49.211064 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2beac6e3-d761-4b46-8ba1-3be836526bd4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:30:49.213556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2beac6e3-d761-4b46-8ba1-3be836526bd4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:30:49.327361 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beac6e3-d761-4b46-8ba1-3be836526bd4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:30:49.328720 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2beac6e3-d761-4b46-8ba1-3be836526bd4 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:30:49.347013 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 742/1470] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:30:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:30:58.978587 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=22 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:30:59.344954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=66 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:09.134439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e88a6-96e8-4d5e-984f-ceb8e237d57f None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:09.135069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e88a6-96e8-4d5e-984f-ceb8e237d57f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:09.135069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5e88a6-96e8-4d5e-984f-ceb8e237d57f None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:09.136463 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 729/1471] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:31:09.141985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4172364-0133-470e-a189-f07d66dcdf75 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:09.142414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4172364-0133-470e-a189-f07d66dcdf75 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:09.142548 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4172364-0133-470e-a189-f07d66dcdf75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:09.210894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-e4172364-0133-470e-a189-f07d66dcdf75 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:09.212123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e4172364-0133-470e-a189-f07d66dcdf75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:09.310876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 743/1472] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:31:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:09.359508 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c18e2-1458-41b5-b209-b9ccfa9babbf None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:09.359794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c18e2-1458-41b5-b209-b9ccfa9babbf None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:09.360071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9c18e2-1458-41b5-b209-b9ccfa9babbf None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:09.361456 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 730/1473] 10.222.0.40 () {54 vars in 960 bytes} [Fri Jul 15 19:31:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:31:09.367106 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69303e-dc57-4c6b-ba71-f615f916d338 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:09.367397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69303e-dc57-4c6b-ba71-f615f916d338 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:09.367676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c69303e-dc57-4c6b-ba71-f615f916d338 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:09.442941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-1c69303e-dc57-4c6b-ba71-f615f916d338 None None] MFA Rules not processed for user `2352b5c2aa664bf0a7e321ff3a5038fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:09.444153 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1c69303e-dc57-4c6b-ba71-f615f916d338 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:09.464320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:09.522246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 744/1474] 10.222.0.40 () {58 vars in 1057 bytes} [Fri Jul 15 19:31:09 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:09.529814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c18e2-1458-41b5-b209-b9ccfa9babbf None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:09.531419 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1f9c18e2-1458-41b5-b209-b9ccfa9babbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:09.635843 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9c18e2-1458-41b5-b209-b9ccfa9babbf None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:09.709665 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4833f2f8-4b70-483d-8659-8f141651d433 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2352b5c2aa664bf0a7e321ff3a5038fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:09.710311 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833f2f8-4b70-483d-8659-8f141651d433 service glance] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:09.710596 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833f2f8-4b70-483d-8659-8f141651d433 service glance] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:09.710911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4833f2f8-4b70-483d-8659-8f141651d433 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:09.712569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4833f2f8-4b70-483d-8659-8f141651d433 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:09.772297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:09.831955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833f2f8-4b70-483d-8659-8f141651d433 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:09.833391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4833f2f8-4b70-483d-8659-8f141651d433 service glance] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:09.851916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 731/1475] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:12.008554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e4fab-2836-49e7-9130-3c6f0427d0b4 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:12.009157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e4fab-2836-49e7-9130-3c6f0427d0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:12.009157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-860e4fab-2836-49e7-9130-3c6f0427d0b4 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:12.010448 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 745/1476] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:31:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:31:12.015917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cda73a-7a8a-4ca2-af9b-5fb752ad063e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:12.016330 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cda73a-7a8a-4ca2-af9b-5fb752ad063e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:12.016493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47cda73a-7a8a-4ca2-af9b-5fb752ad063e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:12.083212 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-47cda73a-7a8a-4ca2-af9b-5fb752ad063e None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:12.084441 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-47cda73a-7a8a-4ca2-af9b-5fb752ad063e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:12.181574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 732/1477] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:31:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:12.204951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e4fab-2836-49e7-9130-3c6f0427d0b4 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:12.206873 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-860e4fab-2836-49e7-9130-3c6f0427d0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:12.452004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-860e4fab-2836-49e7-9130-3c6f0427d0b4 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:12.503666 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:12.548011 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d7831-abc3-45d3-8745-f5004837ce63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:12.548671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d7831-abc3-45d3-8745-f5004837ce63 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:12.549482 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d7831-abc3-45d3-8745-f5004837ce63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:12.549768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d7831-abc3-45d3-8745-f5004837ce63 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:12.550499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d7831-abc3-45d3-8745-f5004837ce63 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:12.552292 dv-cinder-799871-34-smb devstack@keystone.service[80361]: WARNING py.warnings [None req-6a0d7831-abc3-45d3-8745-f5004837ce63 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:31:12.552292 dv-cinder-799871-34-smb devstack@keystone.service[80361]: warnings.warn(msg) Jul 15 19:31:12.552292 dv-cinder-799871-34-smb devstack@keystone.service[80361]: Jul 15 19:31:12.553475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d7831-abc3-45d3-8745-f5004837ce63 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:12.573089 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 746/1478] 10.222.0.40 () {56 vars in 1108 bytes} [Fri Jul 15 19:31:12 2022] GET /identity/v3/projects => generated 2553 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:31:14.644869 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be4731-564d-46cc-8a99-7071b25cbfb7 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:14.645427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be4731-564d-46cc-8a99-7071b25cbfb7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:14.645427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64be4731-564d-46cc-8a99-7071b25cbfb7 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:14.646830 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 733/1479] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:31:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:31:14.652160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dda69-675a-4b97-b10c-8583758f92e3 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:14.652590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dda69-675a-4b97-b10c-8583758f92e3 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:14.652743 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15dda69-675a-4b97-b10c-8583758f92e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:14.718651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a15dda69-675a-4b97-b10c-8583758f92e3 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:14.719942 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a15dda69-675a-4b97-b10c-8583758f92e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:14.818677 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 747/1480] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:31:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:14.861066 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be4731-564d-46cc-8a99-7071b25cbfb7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:14.863244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-64be4731-564d-46cc-8a99-7071b25cbfb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:14.873139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:15.018148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64be4731-564d-46cc-8a99-7071b25cbfb7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:15.097946 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:15.131536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e84523-170d-435c-a98a-1b86618e5a12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:15.132178 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e84523-170d-435c-a98a-1b86618e5a12 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:15.132461 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e84523-170d-435c-a98a-1b86618e5a12 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:15.132735 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e84523-170d-435c-a98a-1b86618e5a12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:15.134400 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-17e84523-170d-435c-a98a-1b86618e5a12 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:15.222878 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e84523-170d-435c-a98a-1b86618e5a12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:15.229893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e84523-170d-435c-a98a-1b86618e5a12 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:15.243495 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 734/1481] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:17.454003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327a92b-9576-41f7-b156-c17761d22ab3 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:17.454577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327a92b-9576-41f7-b156-c17761d22ab3 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:17.454577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0327a92b-9576-41f7-b156-c17761d22ab3 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:17.456584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 748/1482] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:31:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:31:17.461967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a1b3c-24a2-4ff2-87ac-e4a82dff708a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:17.462422 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a1b3c-24a2-4ff2-87ac-e4a82dff708a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:17.462557 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939a1b3c-24a2-4ff2-87ac-e4a82dff708a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:17.528430 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-939a1b3c-24a2-4ff2-87ac-e4a82dff708a None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:17.529649 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-939a1b3c-24a2-4ff2-87ac-e4a82dff708a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:17.579699 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:17.631542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 735/1483] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:17.668314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327a92b-9576-41f7-b156-c17761d22ab3 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:17.669904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0327a92b-9576-41f7-b156-c17761d22ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:17.693864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:17.776542 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0327a92b-9576-41f7-b156-c17761d22ab3 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:17.852112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bc2324-e9ff-4bbf-a73b-f7bf9cb03eac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:17.852758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc2324-e9ff-4bbf-a73b-f7bf9cb03eac service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:17.853038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc2324-e9ff-4bbf-a73b-f7bf9cb03eac service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:17.853310 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bc2324-e9ff-4bbf-a73b-f7bf9cb03eac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:17.855418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-54bc2324-e9ff-4bbf-a73b-f7bf9cb03eac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:17.933787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:17.966271 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc2324-e9ff-4bbf-a73b-f7bf9cb03eac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:17.967760 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bc2324-e9ff-4bbf-a73b-f7bf9cb03eac service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:17.986610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 749/1484] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:20.070895 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687bc85-4c35-4207-b588-a495d41a2ee4 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:20.071427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687bc85-4c35-4207-b588-a495d41a2ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:20.071547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2687bc85-4c35-4207-b588-a495d41a2ee4 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:20.072864 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 736/1485] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:31:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:31:20.078259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35734353-37be-4bad-82ee-da52276b3ca2 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:20.078680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35734353-37be-4bad-82ee-da52276b3ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:20.078850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35734353-37be-4bad-82ee-da52276b3ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:20.145786 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-35734353-37be-4bad-82ee-da52276b3ca2 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:20.146932 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-35734353-37be-4bad-82ee-da52276b3ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:20.243890 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 750/1486] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:20.282536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687bc85-4c35-4207-b588-a495d41a2ee4 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:20.285171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2687bc85-4c35-4207-b588-a495d41a2ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:20.389135 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2687bc85-4c35-4207-b588-a495d41a2ee4 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:20.464116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:20.465992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b9ca63-dc3e-42c2-baf8-5d9a46140673 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:20.466641 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9ca63-dc3e-42c2-baf8-5d9a46140673 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:20.466956 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9ca63-dc3e-42c2-baf8-5d9a46140673 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:20.467232 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b9ca63-dc3e-42c2-baf8-5d9a46140673 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:20.468893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-28b9ca63-dc3e-42c2-baf8-5d9a46140673 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:20.581319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9ca63-dc3e-42c2-baf8-5d9a46140673 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:20.582799 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b9ca63-dc3e-42c2-baf8-5d9a46140673 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:20.601173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 737/1487] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:22.849833 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f511cd-a178-4eaa-b0ea-6935a0492f4e None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:22.850437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f511cd-a178-4eaa-b0ea-6935a0492f4e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:22.850437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f511cd-a178-4eaa-b0ea-6935a0492f4e None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:22.851848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 751/1488] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:31:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:31:22.857238 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bce6a-4bbe-449a-9fca-2aa99b8c18fc None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:22.857656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bce6a-4bbe-449a-9fca-2aa99b8c18fc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:22.857824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34bce6a-4bbe-449a-9fca-2aa99b8c18fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:22.922979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d34bce6a-4bbe-449a-9fca-2aa99b8c18fc None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:22.924707 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d34bce6a-4bbe-449a-9fca-2aa99b8c18fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:22.977788 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:23.022674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 738/1489] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:31:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:23.062742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f511cd-a178-4eaa-b0ea-6935a0492f4e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:23.064991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-73f511cd-a178-4eaa-b0ea-6935a0492f4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:23.104048 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:23.173199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73f511cd-a178-4eaa-b0ea-6935a0492f4e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:23.250365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe1c9b-9b66-4a85-8287-29d8db2e0e00 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:23.251058 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe1c9b-9b66-4a85-8287-29d8db2e0e00 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:23.251340 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe1c9b-9b66-4a85-8287-29d8db2e0e00 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:23.251613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe1c9b-9b66-4a85-8287-29d8db2e0e00 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:23.254270 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2ebe1c9b-9b66-4a85-8287-29d8db2e0e00 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:23.337307 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:23.367345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe1c9b-9b66-4a85-8287-29d8db2e0e00 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:23.368700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe1c9b-9b66-4a85-8287-29d8db2e0e00 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:23.388376 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 752/1490] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:25.895249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877162d-359b-4cd2-b002-1ee1d69daa03 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:25.895828 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877162d-359b-4cd2-b002-1ee1d69daa03 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:25.895828 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0877162d-359b-4cd2-b002-1ee1d69daa03 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:25.897195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 739/1491] 10.222.0.40 () {54 vars in 926 bytes} [Fri Jul 15 19:31:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:31:25.902645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6a77d-d5e6-4ed8-9af2-553f9814252c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:25.903094 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6a77d-d5e6-4ed8-9af2-553f9814252c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:25.903204 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b6a77d-d5e6-4ed8-9af2-553f9814252c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:25.970420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f8b6a77d-d5e6-4ed8-9af2-553f9814252c None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:31:25.971753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f8b6a77d-d5e6-4ed8-9af2-553f9814252c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:26.072087 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 753/1492] 10.222.0.40 () {58 vars in 1023 bytes} [Fri Jul 15 19:31:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:31:26.113109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877162d-359b-4cd2-b002-1ee1d69daa03 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:31:26.114642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0877162d-359b-4cd2-b002-1ee1d69daa03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:26.223420 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0877162d-359b-4cd2-b002-1ee1d69daa03 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:31:26.297795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea191168-5c3f-4574-b6d8-6d300f28ecf5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:31:26.298986 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea191168-5c3f-4574-b6d8-6d300f28ecf5 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:31:26.299271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea191168-5c3f-4574-b6d8-6d300f28ecf5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:31:26.299551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea191168-5c3f-4574-b6d8-6d300f28ecf5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:31:26.301229 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ea191168-5c3f-4574-b6d8-6d300f28ecf5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:31:26.310647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:26.415579 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea191168-5c3f-4574-b6d8-6d300f28ecf5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:31:26.417494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea191168-5c3f-4574-b6d8-6d300f28ecf5 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:31:26.437081 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 740/1493] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:31:36.069303 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=82 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:31:36.434519 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=50 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:04.748864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e1b4c-57ec-4e92-a6bf-5cc814e57681 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:04.749626 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e1b4c-57ec-4e92-a6bf-5cc814e57681 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:04.749626 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2e1b4c-57ec-4e92-a6bf-5cc814e57681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:04.824365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-7a2e1b4c-57ec-4e92-a6bf-5cc814e57681 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:04.825586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-7a2e1b4c-57ec-4e92-a6bf-5cc814e57681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:04.924680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 754/1494] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:33:04.932811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f901-1d63-4626-a296-8fdbfb6abe22 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:04.933355 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f901-1d63-4626-a296-8fdbfb6abe22 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:04.933355 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1701f901-1d63-4626-a296-8fdbfb6abe22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:05.008071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1701f901-1d63-4626-a296-8fdbfb6abe22 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:05.009217 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1701f901-1d63-4626-a296-8fdbfb6abe22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:05.107033 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 741/1495] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:33:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:33:05.111951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e1b4c-57ec-4e92-a6bf-5cc814e57681 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:05.113150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-7a2e1b4c-57ec-4e92-a6bf-5cc814e57681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:05.125102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2e1b4c-57ec-4e92-a6bf-5cc814e57681 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:05.188116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:05.222299 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd5c3a-487b-4422-a144-d0d150a255e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:05.222997 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd5c3a-487b-4422-a144-d0d150a255e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:05.223281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd5c3a-487b-4422-a144-d0d150a255e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:05.223554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cd5c3a-487b-4422-a144-d0d150a255e9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:05.224273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd5c3a-487b-4422-a144-d0d150a255e9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:33:05.224579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd5c3a-487b-4422-a144-d0d150a255e9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:05.225584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: WARNING py.warnings [None req-d3cd5c3a-487b-4422-a144-d0d150a255e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:33:05.225584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: warnings.warn(msg) Jul 15 19:33:05.225584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: Jul 15 19:33:05.226470 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cd5c3a-487b-4422-a144-d0d150a255e9 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:05.238963 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 755/1496] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:33:05.247246 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701f901-1d63-4626-a296-8fdbfb6abe22 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:05.257018 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1701f901-1d63-4626-a296-8fdbfb6abe22 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:05.319700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:05.353255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6db037-bd1d-4f3e-96eb-89f1e2c991d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:05.353904 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6db037-bd1d-4f3e-96eb-89f1e2c991d3 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:05.354186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6db037-bd1d-4f3e-96eb-89f1e2c991d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:05.354457 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6db037-bd1d-4f3e-96eb-89f1e2c991d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:05.355182 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6db037-bd1d-4f3e-96eb-89f1e2c991d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:05.356907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-3b6db037-bd1d-4f3e-96eb-89f1e2c991d3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:33:05.356907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 15 19:33:05.356907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: Jul 15 19:33:05.358132 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6db037-bd1d-4f3e-96eb-89f1e2c991d3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:05.487244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 742/1497] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:33:05 2022] POST /identity/v3/projects => generated 377 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:33:05.491464 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd5c3a-487b-4422-a144-d0d150a255e9 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:05.492961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d3cd5c3a-487b-4422-a144-d0d150a255e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:05.526579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cd5c3a-487b-4422-a144-d0d150a255e9 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:05.620208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abe6e5-a511-4b45-b326-77adcd610237 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:05.620790 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abe6e5-a511-4b45-b326-77adcd610237 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:05.621074 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abe6e5-a511-4b45-b326-77adcd610237 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:05.621348 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41abe6e5-a511-4b45-b326-77adcd610237 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:05.622052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abe6e5-a511-4b45-b326-77adcd610237 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:05.623098 dv-cinder-799871-34-smb devstack@keystone.service[80361]: WARNING py.warnings [None req-41abe6e5-a511-4b45-b326-77adcd610237 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:33:05.623098 dv-cinder-799871-34-smb devstack@keystone.service[80361]: warnings.warn(msg) Jul 15 19:33:05.623098 dv-cinder-799871-34-smb devstack@keystone.service[80361]: Jul 15 19:33:05.624313 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41abe6e5-a511-4b45-b326-77adcd610237 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:05.771677 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 756/1498] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:33:05 2022] POST /identity/v3/users => generated 289 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:33:05.776023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6db037-bd1d-4f3e-96eb-89f1e2c991d3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:05.777590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3b6db037-bd1d-4f3e-96eb-89f1e2c991d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:05.841588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6db037-bd1d-4f3e-96eb-89f1e2c991d3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:05.925585 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:05.937201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0a87d-2cfd-40dc-97cf-c0e7879bcb83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:05.937947 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0a87d-2cfd-40dc-97cf-c0e7879bcb83 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:05.938176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0a87d-2cfd-40dc-97cf-c0e7879bcb83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:05.938447 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a0a87d-2cfd-40dc-97cf-c0e7879bcb83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:05.939240 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0a87d-2cfd-40dc-97cf-c0e7879bcb83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:05.940262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-36a0a87d-2cfd-40dc-97cf-c0e7879bcb83 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:33:05.940262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 15 19:33:05.940262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: Jul 15 19:33:05.941152 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a0a87d-2cfd-40dc-97cf-c0e7879bcb83 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:05.954617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 743/1499] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:33:05.963597 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abe6e5-a511-4b45-b326-77adcd610237 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:05.965104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-41abe6e5-a511-4b45-b326-77adcd610237 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:05.976757 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41abe6e5-a511-4b45-b326-77adcd610237 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:06.002770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:06.073037 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc43f548-4718-493b-b437-3ff4b4ca1001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:06.073870 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f548-4718-493b-b437-3ff4b4ca1001 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:06.073983 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f548-4718-493b-b437-3ff4b4ca1001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:06.074216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc43f548-4718-493b-b437-3ff4b4ca1001 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:06.074974 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43f548-4718-493b-b437-3ff4b4ca1001 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:06.075972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: WARNING py.warnings [None req-cc43f548-4718-493b-b437-3ff4b4ca1001 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:33:06.075972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: warnings.warn(msg) Jul 15 19:33:06.075972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: Jul 15 19:33:06.076912 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc43f548-4718-493b-b437-3ff4b4ca1001 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:06.090112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 757/1500] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:33:05 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:33:06.094626 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0a87d-2cfd-40dc-97cf-c0e7879bcb83 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:06.096184 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-36a0a87d-2cfd-40dc-97cf-c0e7879bcb83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:06.129934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a0a87d-2cfd-40dc-97cf-c0e7879bcb83 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:06.236502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37409068-5a7a-4a3d-a65a-d7d2ff9cfca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:06.236502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37409068-5a7a-4a3d-a65a-d7d2ff9cfca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:06.236502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37409068-5a7a-4a3d-a65a-d7d2ff9cfca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:06.236502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37409068-5a7a-4a3d-a65a-d7d2ff9cfca2 admin admin] PATH_INFO: `/v3/projects/387ac039831f44039159d281a84c480c/users/f51341b8b4ca436d8a57240fb569b1d6/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:06.247370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37409068-5a7a-4a3d-a65a-d7d2ff9cfca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=387ac039831f44039159d281a84c480c, user_id=f51341b8b4ca436d8a57240fb569b1d6, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:06.248245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-37409068-5a7a-4a3d-a65a-d7d2ff9cfca2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:33:06.248245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 15 19:33:06.248245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: Jul 15 19:33:06.250772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37409068-5a7a-4a3d-a65a-d7d2ff9cfca2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:06.366056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 744/1501] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:33:06 2022] PUT /identity/v3/projects/387ac039831f44039159d281a84c480c/users/f51341b8b4ca436d8a57240fb569b1d6/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:33:06.378497 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65503184-b735-4460-9f9a-e8b90d920f17 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:06.378835 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65503184-b735-4460-9f9a-e8b90d920f17 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:06.379116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65503184-b735-4460-9f9a-e8b90d920f17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:06.434865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-65503184-b735-4460-9f9a-e8b90d920f17 None None] MFA Rules not processed for user `f51341b8b4ca436d8a57240fb569b1d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:06.436134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-65503184-b735-4460-9f9a-e8b90d920f17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:06.514264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 758/1502] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:33:06 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:33:06.527775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfdd6d-7de6-4648-9b44-32e0f78bba4e None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:06.528057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfdd6d-7de6-4648-9b44-32e0f78bba4e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:06.528336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cfdd6d-7de6-4648-9b44-32e0f78bba4e None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:06.529722 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 745/1503] 10.222.0.40 () {54 vars in 963 bytes} [Fri Jul 15 19:33:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:33:06.535233 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bba54a-80a3-4530-9635-5c40e6737c85 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:06.535566 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bba54a-80a3-4530-9635-5c40e6737c85 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:06.535847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bba54a-80a3-4530-9635-5c40e6737c85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:06.565899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:06.610917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c7bba54a-80a3-4530-9635-5c40e6737c85 None None] MFA Rules not processed for user `4776b70a88a04be7bfe6729e16c16647`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:06.612126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c7bba54a-80a3-4530-9635-5c40e6737c85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:06.688231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 759/1504] 10.222.0.40 () {58 vars in 1060 bytes} [Fri Jul 15 19:33:06 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:33:06.695792 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfdd6d-7de6-4648-9b44-32e0f78bba4e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:06.697290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-16cfdd6d-7de6-4648-9b44-32e0f78bba4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:06.748437 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:06.804067 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cfdd6d-7de6-4648-9b44-32e0f78bba4e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:06.878522 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e1b57-20b8-4310-ad0f-01e084615a87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:06.879191 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e1b57-20b8-4310-ad0f-01e084615a87 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:06.879479 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e1b57-20b8-4310-ad0f-01e084615a87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:06.879750 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50e1b57-20b8-4310-ad0f-01e084615a87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:06.881391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d50e1b57-20b8-4310-ad0f-01e084615a87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:06.983905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e1b57-20b8-4310-ad0f-01e084615a87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:06.985420 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50e1b57-20b8-4310-ad0f-01e084615a87 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:06.989150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:07.004358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 746/1505] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:33:06 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:33:07.047410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb22df-943d-422d-9ddd-fca53e632ea6 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:07.047823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb22df-943d-422d-9ddd-fca53e632ea6 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:07.047967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb22df-943d-422d-9ddd-fca53e632ea6 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:07.049238 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 760/1506] 10.222.0.40 () {52 vars in 829 bytes} [Fri Jul 15 19:33:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:33:07.052898 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e1b57-20b8-4310-ad0f-01e084615a87 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:07.054150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d50e1b57-20b8-4310-ad0f-01e084615a87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:07.154721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50e1b57-20b8-4310-ad0f-01e084615a87 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:07.249887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac071557-dc80-4ef4-982f-fb0440d623c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:07.250774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac071557-dc80-4ef4-982f-fb0440d623c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:07.251070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac071557-dc80-4ef4-982f-fb0440d623c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:07.251348 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac071557-dc80-4ef4-982f-fb0440d623c6 admin admin] PATH_INFO: `/v3/users/f51341b8b4ca436d8a57240fb569b1d6` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:07.264333 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac071557-dc80-4ef4-982f-fb0440d623c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f51341b8b4ca436d8a57240fb569b1d6)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:07.265578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-ac071557-dc80-4ef4-982f-fb0440d623c6 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:33:07.265578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 15 19:33:07.265578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: Jul 15 19:33:07.266836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac071557-dc80-4ef4-982f-fb0440d623c6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:07.277196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:07.450662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac071557-dc80-4ef4-982f-fb0440d623c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f51341b8b4ca436d8a57240fb569b1d6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:07.469928 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac071557-dc80-4ef4-982f-fb0440d623c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f51341b8b4ca436d8a57240fb569b1d6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:07.470500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac071557-dc80-4ef4-982f-fb0440d623c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f51341b8b4ca436d8a57240fb569b1d6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:07.470955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac071557-dc80-4ef4-982f-fb0440d623c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f51341b8b4ca436d8a57240fb569b1d6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:07.483906 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ac071557-dc80-4ef4-982f-fb0440d623c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f51341b8b4ca436d8a57240fb569b1d6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:07.557504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 747/1507] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:33:07 2022] DELETE /identity/v3/users/f51341b8b4ca436d8a57240fb569b1d6 => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:33:07.562648 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4f109-9f68-40e4-9673-a09a58c42e00 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:07.562964 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4f109-9f68-40e4-9673-a09a58c42e00 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:07.563241 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c4f109-9f68-40e4-9673-a09a58c42e00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:07.620009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a9c4f109-9f68-40e4-9673-a09a58c42e00 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:33:07.621223 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a9c4f109-9f68-40e4-9673-a09a58c42e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:07.700231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:07.714130 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 761/1508] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:33:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:33:07.722560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac071557-dc80-4ef4-982f-fb0440d623c6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:07.723862 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ac071557-dc80-4ef4-982f-fb0440d623c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:07.824852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac071557-dc80-4ef4-982f-fb0440d623c6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:07.881667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:07.901028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a9c421-4468-42c1-897c-00a1efc60362 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:07.905724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9c421-4468-42c1-897c-00a1efc60362 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:07.905724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9c421-4468-42c1-897c-00a1efc60362 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:07.905724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9c421-4468-42c1-897c-00a1efc60362 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:07.905724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-86a9c421-4468-42c1-897c-00a1efc60362 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:08.017017 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9c421-4468-42c1-897c-00a1efc60362 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:08.018385 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a9c421-4468-42c1-897c-00a1efc60362 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:08.037503 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 748/1509] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:33:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:33:08.480276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4f109-9f68-40e4-9673-a09a58c42e00 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:33:08.481544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a9c4f109-9f68-40e4-9673-a09a58c42e00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:33:08.495395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c4f109-9f68-40e4-9673-a09a58c42e00 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:33:08.589832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edf9ea69-5157-4042-890b-e64876bec097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:33:08.590608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9ea69-5157-4042-890b-e64876bec097 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:33:08.590921 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9ea69-5157-4042-890b-e64876bec097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:33:08.591201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edf9ea69-5157-4042-890b-e64876bec097 admin admin] PATH_INFO: `/v3/projects/387ac039831f44039159d281a84c480c` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:33:08.601741 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9ea69-5157-4042-890b-e64876bec097 admin admin] RBAC: Authorizing `identity:delete_project(project_id=387ac039831f44039159d281a84c480c)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:33:08.602776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: WARNING py.warnings [None req-edf9ea69-5157-4042-890b-e64876bec097 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:33:08.602776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: warnings.warn(msg) Jul 15 19:33:08.602776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: Jul 15 19:33:08.603991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edf9ea69-5157-4042-890b-e64876bec097 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:33:08.723347 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-edf9ea69-5157-4042-890b-e64876bec097 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '387ac039831f44039159d281a84c480c', 'request_id': 'req-edf9ea69-5157-4042-890b-e64876bec097'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:08.785552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-edf9ea69-5157-4042-890b-e64876bec097 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '387ac039831f44039159d281a84c480c', 'request_id': 'req-edf9ea69-5157-4042-890b-e64876bec097'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:08.799759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-edf9ea69-5157-4042-890b-e64876bec097 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '387ac039831f44039159d281a84c480c', 'request_id': 'req-edf9ea69-5157-4042-890b-e64876bec097'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:08.823011 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-edf9ea69-5157-4042-890b-e64876bec097 admin admin] The token cache is being invalidate because project 387ac039831f44039159d281a84c480c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:33:08.823299 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-edf9ea69-5157-4042-890b-e64876bec097 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:08.823730 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-edf9ea69-5157-4042-890b-e64876bec097 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:33:08.825186 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 762/1510] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:33:08 2022] DELETE /identity/v3/projects/387ac039831f44039159d281a84c480c => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:33:18.039041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=62 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:33:18.821072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:34:54.725565 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85801bc-266b-4f05-83d4-f015d2c2804d None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:54.726205 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85801bc-266b-4f05-83d4-f015d2c2804d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:54.726317 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85801bc-266b-4f05-83d4-f015d2c2804d None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:54.728251 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 749/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:34:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:34:54.733295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f22442-08d8-4409-bb38-3c2db88954b4 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:54.733724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f22442-08d8-4409-bb38-3c2db88954b4 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:54.733850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f22442-08d8-4409-bb38-3c2db88954b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:54.815142 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-52f22442-08d8-4409-bb38-3c2db88954b4 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:34:54.816341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-52f22442-08d8-4409-bb38-3c2db88954b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:54.922553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 763/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:34:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:34:55.082804 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85801bc-266b-4f05-83d4-f015d2c2804d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:34:55.087244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a85801bc-266b-4f05-83d4-f015d2c2804d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:55.206182 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85801bc-266b-4f05-83d4-f015d2c2804d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:34:55.211809 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceddc1fc-bbb7-473c-98c7-cab619ee5e78 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:34:55.212453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddc1fc-bbb7-473c-98c7-cab619ee5e78 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:55.212740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddc1fc-bbb7-473c-98c7-cab619ee5e78 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:55.213040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceddc1fc-bbb7-473c-98c7-cab619ee5e78 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:55.221420 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddc1fc-bbb7-473c-98c7-cab619ee5e78 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:34:55.223038 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceddc1fc-bbb7-473c-98c7-cab619ee5e78 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:34:55.233299 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 750/1513] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:34:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:34:56.097341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158adb85-9417-4531-8f8e-901d3599bcbc None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:56.097800 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158adb85-9417-4531-8f8e-901d3599bcbc None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:56.097917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158adb85-9417-4531-8f8e-901d3599bcbc None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:56.099334 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 764/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:34:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:34:56.104297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a8f7-0bb6-4c23-a99a-857923503d8e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:56.104736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a8f7-0bb6-4c23-a99a-857923503d8e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:56.104838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4624a8f7-0bb6-4c23-a99a-857923503d8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:56.123736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4624a8f7-0bb6-4c23-a99a-857923503d8e None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:34:56.124921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4624a8f7-0bb6-4c23-a99a-857923503d8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:56.133006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 751/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:34:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:34:56.287198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158adb85-9417-4531-8f8e-901d3599bcbc None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:34:56.302283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158adb85-9417-4531-8f8e-901d3599bcbc None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:34:56.308910 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e79aa8-5f83-4db4-b0a2-8bb7ffd5c722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:34:56.309620 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e79aa8-5f83-4db4-b0a2-8bb7ffd5c722 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:56.309620 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e79aa8-5f83-4db4-b0a2-8bb7ffd5c722 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:56.309620 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e79aa8-5f83-4db4-b0a2-8bb7ffd5c722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:56.319393 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e79aa8-5f83-4db4-b0a2-8bb7ffd5c722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:34:56.321054 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e79aa8-5f83-4db4-b0a2-8bb7ffd5c722 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:34:56.332134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 765/1516] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:34:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:34:56.545234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbadfc-1b93-4fc7-8339-ab3ab69597d7 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:56.545526 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbadfc-1b93-4fc7-8339-ab3ab69597d7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:56.545839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eccbadfc-1b93-4fc7-8339-ab3ab69597d7 None None] PATH_INFO: `/v3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:56.547225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 752/1517] 10.222.0.58 () {54 vars in 925 bytes} [Fri Jul 15 19:34:56 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:34:56.553314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cedbba-3b2e-4233-ae55-32fe38625e84 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:34:56.553607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cedbba-3b2e-4233-ae55-32fe38625e84 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:34:56.553887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32cedbba-3b2e-4233-ae55-32fe38625e84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:34:56.615030 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-32cedbba-3b2e-4233-ae55-32fe38625e84 None None] MFA Rules not processed for user `ad68d871464f4b5588c22070205f159e`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:34:56.616175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-32cedbba-3b2e-4233-ae55-32fe38625e84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:34:56.634367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:34:56.691817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 766/1518] 10.222.0.58 () {58 vars in 1015 bytes} [Fri Jul 15 19:34:56 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:00.657311 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dc5ff-78e9-45ba-99f3-60adff7ecbd4 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:00.657878 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dc5ff-78e9-45ba-99f3-60adff7ecbd4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:00.657878 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313dc5ff-78e9-45ba-99f3-60adff7ecbd4 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:00.659316 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 753/1519] 10.222.0.40 () {54 vars in 960 bytes} [Fri Jul 15 19:35:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:35:00.664205 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078570d4-9f4b-4352-aac9-8ceea004e4b0 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:00.664614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078570d4-9f4b-4352-aac9-8ceea004e4b0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:00.664809 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078570d4-9f4b-4352-aac9-8ceea004e4b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:00.684271 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-078570d4-9f4b-4352-aac9-8ceea004e4b0 None None] MFA Rules not processed for user `ad68d871464f4b5588c22070205f159e`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:00.685460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-078570d4-9f4b-4352-aac9-8ceea004e4b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:00.695336 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 767/1520] 10.222.0.40 () {58 vars in 1057 bytes} [Fri Jul 15 19:35:00 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:00.702987 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dc5ff-78e9-45ba-99f3-60adff7ecbd4 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:00.717084 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313dc5ff-78e9-45ba-99f3-60adff7ecbd4 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:00.723301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6d2075-d417-4333-861b-ad69881f0748 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad68d871464f4b5588c22070205f159e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:00.723938 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d2075-d417-4333-861b-ad69881f0748 service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:00.724221 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d2075-d417-4333-861b-ad69881f0748 service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:00.724497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6d2075-d417-4333-861b-ad69881f0748 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:00.733346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d2075-d417-4333-861b-ad69881f0748 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:00.735050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6d2075-d417-4333-861b-ad69881f0748 service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:00.745951 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 754/1521] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:00 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:35:07.605599 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1ff04-0db0-4338-8b60-4ac6fb8e7d73 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:07.606402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1ff04-0db0-4338-8b60-4ac6fb8e7d73 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:07.606402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efb1ff04-0db0-4338-8b60-4ac6fb8e7d73 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:07.607671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 768/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:35:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:35:07.613096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30bb24-4f80-45ff-aa41-4002b52cf444 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:07.613533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30bb24-4f80-45ff-aa41-4002b52cf444 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:07.613645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d30bb24-4f80-45ff-aa41-4002b52cf444 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:07.632308 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4d30bb24-4f80-45ff-aa41-4002b52cf444 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:07.633522 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4d30bb24-4f80-45ff-aa41-4002b52cf444 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:07.641874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 755/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:35:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:07.800865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1ff04-0db0-4338-8b60-4ac6fb8e7d73 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:07.815367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efb1ff04-0db0-4338-8b60-4ac6fb8e7d73 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:07.820738 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-186b4d1c-9c4b-4837-a9c7-e983e5f6af2a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:07.821365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b4d1c-9c4b-4837-a9c7-e983e5f6af2a service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:07.821644 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b4d1c-9c4b-4837-a9c7-e983e5f6af2a service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:07.821917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186b4d1c-9c4b-4837-a9c7-e983e5f6af2a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:07.830179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b4d1c-9c4b-4837-a9c7-e983e5f6af2a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:07.833139 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-186b4d1c-9c4b-4837-a9c7-e983e5f6af2a service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:07.841268 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 769/1524] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:35:08.678824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4fd29-6224-4cab-a692-25e262671d8a None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:08.679383 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4fd29-6224-4cab-a692-25e262671d8a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:08.679501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9b4fd29-6224-4cab-a692-25e262671d8a None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:08.680868 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 756/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Jul 15 19:35:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:35:08.685672 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594a095-c35a-4075-bea9-8180368c6334 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:08.686167 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594a095-c35a-4075-bea9-8180368c6334 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:08.686282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2594a095-c35a-4075-bea9-8180368c6334 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:08.705202 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-2594a095-c35a-4075-bea9-8180368c6334 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:08.706627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2594a095-c35a-4075-bea9-8180368c6334 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:08.714545 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 770/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Jul 15 19:35:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:08.870900 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4fd29-6224-4cab-a692-25e262671d8a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:08.886458 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9b4fd29-6224-4cab-a692-25e262671d8a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:08.891994 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ff012b-5279-47fb-bb98-018df4866987 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:08.893732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff012b-5279-47fb-bb98-018df4866987 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:08.894028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff012b-5279-47fb-bb98-018df4866987 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:08.894304 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ff012b-5279-47fb-bb98-018df4866987 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:08.902734 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff012b-5279-47fb-bb98-018df4866987 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:08.904335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ff012b-5279-47fb-bb98-018df4866987 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:08.914309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 757/1527] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:35:12.869931 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f976657-c5d8-44fd-8c29-40187379fd13 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:12.870517 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f976657-c5d8-44fd-8c29-40187379fd13 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:12.870517 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f976657-c5d8-44fd-8c29-40187379fd13 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:12.871873 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 771/1528] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:35:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:35:12.878106 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf09d5a-0429-4e88-b533-ef7ae208b27b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:12.878725 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf09d5a-0429-4e88-b533-ef7ae208b27b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:12.878725 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf09d5a-0429-4e88-b533-ef7ae208b27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:12.897080 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ccf09d5a-0429-4e88-b533-ef7ae208b27b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:12.898272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ccf09d5a-0429-4e88-b533-ef7ae208b27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:12.906105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 758/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:35:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:35:12.944863 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f976657-c5d8-44fd-8c29-40187379fd13 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:12.946511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5f976657-c5d8-44fd-8c29-40187379fd13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:13.027639 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f976657-c5d8-44fd-8c29-40187379fd13 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:13.031612 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444d9f85-4f30-4f3d-94f6-e86b6cbe1630 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:13.032267 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d9f85-4f30-4f3d-94f6-e86b6cbe1630 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:13.033281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d9f85-4f30-4f3d-94f6-e86b6cbe1630 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:13.033567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444d9f85-4f30-4f3d-94f6-e86b6cbe1630 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:13.043236 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d9f85-4f30-4f3d-94f6-e86b6cbe1630 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:13.044776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444d9f85-4f30-4f3d-94f6-e86b6cbe1630 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:13.055712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 772/1530] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:35:15.109176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91236704-48ac-4046-b548-637af99c99a7 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:15.109707 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91236704-48ac-4046-b548-637af99c99a7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:15.109707 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91236704-48ac-4046-b548-637af99c99a7 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:15.111704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 759/1531] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:35:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:35:15.117180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19f0fd-d66e-44cd-8ce6-162c05ac595a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:15.117632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19f0fd-d66e-44cd-8ce6-162c05ac595a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:15.117744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd19f0fd-d66e-44cd-8ce6-162c05ac595a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:15.137159 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-dd19f0fd-d66e-44cd-8ce6-162c05ac595a None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:15.138341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-dd19f0fd-d66e-44cd-8ce6-162c05ac595a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:15.146549 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 773/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:35:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:15.182041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91236704-48ac-4046-b548-637af99c99a7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:15.193489 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91236704-48ac-4046-b548-637af99c99a7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:15.197224 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59176895-e194-4ede-8e92-2645124c7c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:15.197857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176895-e194-4ede-8e92-2645124c7c86 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:15.198140 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176895-e194-4ede-8e92-2645124c7c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:15.198417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59176895-e194-4ede-8e92-2645124c7c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:15.207812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59176895-e194-4ede-8e92-2645124c7c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:15.209302 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59176895-e194-4ede-8e92-2645124c7c86 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:15.219010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 760/1533] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:35:18.799750 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5e3ed-b1ff-4409-b08c-649abbd7e71e None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:18.800524 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5e3ed-b1ff-4409-b08c-649abbd7e71e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:18.800524 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a5e3ed-b1ff-4409-b08c-649abbd7e71e None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:18.801796 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 774/1534] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:35:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:35:18.807150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5fab9-154d-433b-92c5-c7eb06879418 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:18.807564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5fab9-154d-433b-92c5-c7eb06879418 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:18.807712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea5fab9-154d-433b-92c5-c7eb06879418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:18.814275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=81 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:18.826159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2ea5fab9-154d-433b-92c5-c7eb06879418 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:18.834000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2ea5fab9-154d-433b-92c5-c7eb06879418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:18.835863 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 761/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:35:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:35:19.145320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5e3ed-b1ff-4409-b08c-649abbd7e71e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:19.147102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-38a5e3ed-b1ff-4409-b08c-649abbd7e71e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:19.214604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:19.228797 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a5e3ed-b1ff-4409-b08c-649abbd7e71e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:19.232377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6241f57-3d5e-4a7c-a7f8-c69bfa7b993b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:19.233018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6241f57-3d5e-4a7c-a7f8-c69bfa7b993b service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:19.233299 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6241f57-3d5e-4a7c-a7f8-c69bfa7b993b service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:19.233576 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6241f57-3d5e-4a7c-a7f8-c69bfa7b993b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:19.242764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6241f57-3d5e-4a7c-a7f8-c69bfa7b993b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:19.244212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6241f57-3d5e-4a7c-a7f8-c69bfa7b993b service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:19.255587 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 775/1536] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:35:21.319873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57504ac-bd21-43ec-820c-293689a6ae5d None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:21.320439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57504ac-bd21-43ec-820c-293689a6ae5d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:21.320439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57504ac-bd21-43ec-820c-293689a6ae5d None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:21.321802 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 762/1537] 127.0.0.1 () {54 vars in 916 bytes} [Fri Jul 15 19:35:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:35:21.327082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559c7ac-e84e-408c-bfc3-f510bc773106 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:21.327519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559c7ac-e84e-408c-bfc3-f510bc773106 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:21.327624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5559c7ac-e84e-408c-bfc3-f510bc773106 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:21.346158 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5559c7ac-e84e-408c-bfc3-f510bc773106 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:35:21.347455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5559c7ac-e84e-408c-bfc3-f510bc773106 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:21.355309 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 776/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Fri Jul 15 19:35:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:35:21.671681 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57504ac-bd21-43ec-820c-293689a6ae5d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:35:21.673939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f57504ac-bd21-43ec-820c-293689a6ae5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:35:21.686844 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57504ac-bd21-43ec-820c-293689a6ae5d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:35:21.691151 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f6744-b25b-467d-af8f-591927f0cf99 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:35:21.691788 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f6744-b25b-467d-af8f-591927f0cf99 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:35:21.692075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f6744-b25b-467d-af8f-591927f0cf99 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:35:21.692350 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f6744-b25b-467d-af8f-591927f0cf99 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:35:21.701726 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f6744-b25b-467d-af8f-591927f0cf99 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:35:21.703205 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f6744-b25b-467d-af8f-591927f0cf99 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:35:21.712737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 763/1539] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:35:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:35:31.341579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=11 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:35:31.708483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=8 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:54.862415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d9270-b360-4d69-9e7b-cafbfd4d6606 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:54.863460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d9270-b360-4d69-9e7b-cafbfd4d6606 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:54.863912 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813d9270-b360-4d69-9e7b-cafbfd4d6606 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:54.892057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-813d9270-b360-4d69-9e7b-cafbfd4d6606 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:54.893621 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-813d9270-b360-4d69-9e7b-cafbfd4d6606 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:54.902529 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 777/1540] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:54.911781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c8525-5522-4d6c-8f7f-fc2638a95842 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:54.912385 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c8525-5522-4d6c-8f7f-fc2638a95842 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:54.912385 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97c8525-5522-4d6c-8f7f-fc2638a95842 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:54.940856 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c97c8525-5522-4d6c-8f7f-fc2638a95842 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:54.942113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c97c8525-5522-4d6c-8f7f-fc2638a95842 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:54.953791 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 764/1541] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:54.959275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d9270-b360-4d69-9e7b-cafbfd4d6606 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:54.973351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813d9270-b360-4d69-9e7b-cafbfd4d6606 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:54.987521 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3e10b2-23aa-4b61-b4ce-0a5bd6e745ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:54.988505 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e10b2-23aa-4b61-b4ce-0a5bd6e745ae admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:54.988963 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e10b2-23aa-4b61-b4ce-0a5bd6e745ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:54.989436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3e10b2-23aa-4b61-b4ce-0a5bd6e745ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:54.990364 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e10b2-23aa-4b61-b4ce-0a5bd6e745ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:36:54.990906 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e10b2-23aa-4b61-b4ce-0a5bd6e745ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:54.992724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3e10b2-23aa-4b61-b4ce-0a5bd6e745ae admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:55.012097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 778/1542] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:36:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:36:55.021143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c8525-5522-4d6c-8f7f-fc2638a95842 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:55.032103 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97c8525-5522-4d6c-8f7f-fc2638a95842 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:55.042536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaac608-d4a2-44de-9087-7ea789e51203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:55.043258 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaac608-d4a2-44de-9087-7ea789e51203 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.043598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaac608-d4a2-44de-9087-7ea789e51203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.043877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eaac608-d4a2-44de-9087-7ea789e51203 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.044613 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaac608-d4a2-44de-9087-7ea789e51203 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:55.047628 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eaac608-d4a2-44de-9087-7ea789e51203 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:55.115225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88b306-1210-4374-8169-e0953c8b343a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.115420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88b306-1210-4374-8169-e0953c8b343a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.115708 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e88b306-1210-4374-8169-e0953c8b343a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.140029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-4e88b306-1210-4374-8169-e0953c8b343a None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:55.141863 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4e88b306-1210-4374-8169-e0953c8b343a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:55.152072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 779/1543] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:55.162470 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3797b-20aa-4312-bf10-83a37c0f8d6f None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.163134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3797b-20aa-4312-bf10-83a37c0f8d6f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.163630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf3797b-20aa-4312-bf10-83a37c0f8d6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.191015 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-acf3797b-20aa-4312-bf10-83a37c0f8d6f None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:55.192601 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-acf3797b-20aa-4312-bf10-83a37c0f8d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:55.201479 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 780/1544] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:55.203543 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d5831-1328-4fda-87f6-8bb52621b0eb None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.204093 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d5831-1328-4fda-87f6-8bb52621b0eb None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.204584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450d5831-1328-4fda-87f6-8bb52621b0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.231788 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-450d5831-1328-4fda-87f6-8bb52621b0eb None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:55.239769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-450d5831-1328-4fda-87f6-8bb52621b0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:55.239929 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 765/1545] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/projects => generated 379 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:55.239929 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaac608-d4a2-44de-9087-7ea789e51203 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:55.349494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eaac608-d4a2-44de-9087-7ea789e51203 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:55.356946 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-024f8591-a65f-4045-a7c4-30cc572b783d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:55.357162 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 781/1546] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:55.357887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d5831-1328-4fda-87f6-8bb52621b0eb None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:55.358169 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f8591-a65f-4045-a7c4-30cc572b783d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.359409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f8591-a65f-4045-a7c4-30cc572b783d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.359885 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-024f8591-a65f-4045-a7c4-30cc572b783d admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.360787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f8591-a65f-4045-a7c4-30cc572b783d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:36:55.361243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f8591-a65f-4045-a7c4-30cc572b783d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:55.362969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-024f8591-a65f-4045-a7c4-30cc572b783d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:36:55.362969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 15 19:36:55.362969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: Jul 15 19:36:55.364303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-024f8591-a65f-4045-a7c4-30cc572b783d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:55.373120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450d5831-1328-4fda-87f6-8bb52621b0eb None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:55.378166 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8384b64-5d59-427d-b6b6-cd80cfae0cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:55.378852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 766/1547] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:36:55.379344 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8384b64-5d59-427d-b6b6-cd80cfae0cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.379727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8384b64-5d59-427d-b6b6-cd80cfae0cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.380098 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8384b64-5d59-427d-b6b6-cd80cfae0cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.386783 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8384b64-5d59-427d-b6b6-cd80cfae0cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:55.386783 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8384b64-5d59-427d-b6b6-cd80cfae0cf5 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:55.387637 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d1610-daf5-4447-aa2a-af6373cb3d32 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.388166 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d1610-daf5-4447-aa2a-af6373cb3d32 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.388616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-661d1610-daf5-4447-aa2a-af6373cb3d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.411029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-661d1610-daf5-4447-aa2a-af6373cb3d32 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:55.413374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-661d1610-daf5-4447-aa2a-af6373cb3d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:55.422282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 767/1548] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:55.424020 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0483f3-7025-47cd-a471-1f891343a363 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.424307 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0483f3-7025-47cd-a471-1f891343a363 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.424587 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c0483f3-7025-47cd-a471-1f891343a363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.443255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4c0483f3-7025-47cd-a471-1f891343a363 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:55.444534 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4c0483f3-7025-47cd-a471-1f891343a363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:55.453213 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 768/1549] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:55.454360 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4315b-84fe-473d-9ff6-191dabb91df9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.454646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4315b-84fe-473d-9ff6-191dabb91df9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.454958 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d4315b-84fe-473d-9ff6-191dabb91df9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.474165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-06d4315b-84fe-473d-9ff6-191dabb91df9 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:55.475402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-06d4315b-84fe-473d-9ff6-191dabb91df9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:55.484074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 769/1550] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:55.485372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaa0a9-2385-49f2-850f-5d0364e6664b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.485659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaa0a9-2385-49f2-850f-5d0364e6664b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.485938 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aaa0a9-2385-49f2-850f-5d0364e6664b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.487328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 782/1551] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/users => generated 290 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:55.488362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8384b64-5d59-427d-b6b6-cd80cfae0cf5 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:55.500010 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8384b64-5d59-427d-b6b6-cd80cfae0cf5 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:55.504952 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3859e-1930-4155-b509-890cc94632eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:55.505613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3859e-1930-4155-b509-890cc94632eb admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.506142 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3859e-1930-4155-b509-890cc94632eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.506415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3859e-1930-4155-b509-890cc94632eb admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.506538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-40aaa0a9-2385-49f2-850f-5d0364e6664b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:55.507136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3859e-1930-4155-b509-890cc94632eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:55.507656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-40aaa0a9-2385-49f2-850f-5d0364e6664b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:55.508137 dv-cinder-799871-34-smb devstack@keystone.service[80361]: WARNING py.warnings [None req-dfc3859e-1930-4155-b509-890cc94632eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:36:55.508137 dv-cinder-799871-34-smb devstack@keystone.service[80361]: warnings.warn(msg) Jul 15 19:36:55.508137 dv-cinder-799871-34-smb devstack@keystone.service[80361]: Jul 15 19:36:55.509340 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3859e-1930-4155-b509-890cc94632eb admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:55.516099 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 770/1552] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:55.517237 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfe6dd-777b-47ff-9605-f8b886b954c0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.517519 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfe6dd-777b-47ff-9605-f8b886b954c0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.517799 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dfe6dd-777b-47ff-9605-f8b886b954c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.537873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-96dfe6dd-777b-47ff-9605-f8b886b954c0 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:55.539109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-96dfe6dd-777b-47ff-9605-f8b886b954c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:55.548126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 771/1553] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:55.549364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf4652-b292-4ec8-a881-e43c91ec442c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.549712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf4652-b292-4ec8-a881-e43c91ec442c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.549997 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1bf4652-b292-4ec8-a881-e43c91ec442c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.569309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e1bf4652-b292-4ec8-a881-e43c91ec442c None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:55.570515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e1bf4652-b292-4ec8-a881-e43c91ec442c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:55.579669 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 772/1554] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:55.581170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cc6bf-aae6-4d37-b4a1-713c5af63cc9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.581467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cc6bf-aae6-4d37-b4a1-713c5af63cc9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.581769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-790cc6bf-aae6-4d37-b4a1-713c5af63cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.599827 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-790cc6bf-aae6-4d37-b4a1-713c5af63cc9 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:55.601014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-790cc6bf-aae6-4d37-b4a1-713c5af63cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:55.609664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 773/1555] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:55.611157 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c762077-f3d0-45e0-a991-cb7d98f6b744 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.611291 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c762077-f3d0-45e0-a991-cb7d98f6b744 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.611568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c762077-f3d0-45e0-a991-cb7d98f6b744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.619161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 783/1556] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/projects => generated 367 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:55.620111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3859e-1930-4155-b509-890cc94632eb admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:55.631952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9c762077-f3d0-45e0-a991-cb7d98f6b744 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:55.633114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9c762077-f3d0-45e0-a991-cb7d98f6b744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:55.685910 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3859e-1930-4155-b509-890cc94632eb admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:55.691332 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a52c87-bfb2-48ac-903b-f52f0820bd49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:55.692004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a52c87-bfb2-48ac-903b-f52f0820bd49 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.692284 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a52c87-bfb2-48ac-903b-f52f0820bd49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.692561 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a52c87-bfb2-48ac-903b-f52f0820bd49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.693292 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a52c87-bfb2-48ac-903b-f52f0820bd49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:55.695278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 774/1557] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:55.695777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a52c87-bfb2-48ac-903b-f52f0820bd49 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:55.696712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac1067-8fd8-4530-8d13-d58dc3c7f6b1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.696996 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac1067-8fd8-4530-8d13-d58dc3c7f6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.697343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dac1067-8fd8-4530-8d13-d58dc3c7f6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.707768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 784/1558] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:55.719465 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a52c87-bfb2-48ac-903b-f52f0820bd49 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:55.719636 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5dac1067-8fd8-4530-8d13-d58dc3c7f6b1 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:55.719636 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5dac1067-8fd8-4530-8d13-d58dc3c7f6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:55.719822 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a52c87-bfb2-48ac-903b-f52f0820bd49 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:55.723526 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefce41-3fc7-4902-9f83-ca15962257ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:55.724186 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefce41-3fc7-4902-9f83-ca15962257ef admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.724494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefce41-3fc7-4902-9f83-ca15962257ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.724797 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbefce41-3fc7-4902-9f83-ca15962257ef admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.725545 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbefce41-3fc7-4902-9f83-ca15962257ef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:36:55.725842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbefce41-3fc7-4902-9f83-ca15962257ef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:55.726049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 775/1559] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:55.727421 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59afd7-4581-4396-ac29-cdcf54ec78c2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.727534 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbefce41-3fc7-4902-9f83-ca15962257ef admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:55.727698 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59afd7-4581-4396-ac29-cdcf54ec78c2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.727975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb59afd7-4581-4396-ac29-cdcf54ec78c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.735861 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:55.748763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 785/1560] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:36:55.748763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefce41-3fc7-4902-9f83-ca15962257ef admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:55.753822 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbefce41-3fc7-4902-9f83-ca15962257ef admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:55.755550 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-eb59afd7-4581-4396-ac29-cdcf54ec78c2 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:55.757011 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-eb59afd7-4581-4396-ac29-cdcf54ec78c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:55.758961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed43a30-9268-4fc6-b8e1-70da8b633398 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:55.759618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed43a30-9268-4fc6-b8e1-70da8b633398 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.759903 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed43a30-9268-4fc6-b8e1-70da8b633398 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.760181 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aed43a30-9268-4fc6-b8e1-70da8b633398 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.760958 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed43a30-9268-4fc6-b8e1-70da8b633398 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:36:55.761267 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed43a30-9268-4fc6-b8e1-70da8b633398 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:55.762876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aed43a30-9268-4fc6-b8e1-70da8b633398 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:55.765222 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 776/1561] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:55.766024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59afd7-4581-4396-ac29-cdcf54ec78c2 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:55.773619 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:55.775752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb59afd7-4581-4396-ac29-cdcf54ec78c2 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:55.784982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 786/1562] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:36:55.784982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed43a30-9268-4fc6-b8e1-70da8b633398 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:55.792024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948db278-787c-4580-8e4b-0d987b9e71cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:55.792024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948db278-787c-4580-8e4b-0d987b9e71cd admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.792024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948db278-787c-4580-8e4b-0d987b9e71cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.792024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948db278-787c-4580-8e4b-0d987b9e71cd admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.792404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948db278-787c-4580-8e4b-0d987b9e71cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:36:55.792404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948db278-787c-4580-8e4b-0d987b9e71cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:55.792404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948db278-787c-4580-8e4b-0d987b9e71cd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:55.792644 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aed43a30-9268-4fc6-b8e1-70da8b633398 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:55.794918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001e8a1-f142-484a-905c-fc02c37501f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:55.795592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001e8a1-f142-484a-905c-fc02c37501f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.796615 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001e8a1-f142-484a-905c-fc02c37501f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.797031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0001e8a1-f142-484a-905c-fc02c37501f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.798019 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001e8a1-f142-484a-905c-fc02c37501f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:55.798479 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 777/1563] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:36:55.805816 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20974d-585d-4a18-86bf-29ee3af6ebb7 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.805915 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0001e8a1-f142-484a-905c-fc02c37501f7 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:55.806018 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20974d-585d-4a18-86bf-29ee3af6ebb7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.806018 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d20974d-585d-4a18-86bf-29ee3af6ebb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.819478 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2d20974d-585d-4a18-86bf-29ee3af6ebb7 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:55.820733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2d20974d-585d-4a18-86bf-29ee3af6ebb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:55.829348 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 778/1564] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:55.830263 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20974d-585d-4a18-86bf-29ee3af6ebb7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:55.839735 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d20974d-585d-4a18-86bf-29ee3af6ebb7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:55.846065 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f99252-1367-40df-bc3b-2d8fcbc740f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:55.846796 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f99252-1367-40df-bc3b-2d8fcbc740f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.847137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f99252-1367-40df-bc3b-2d8fcbc740f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.847453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f99252-1367-40df-bc3b-2d8fcbc740f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.848521 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f99252-1367-40df-bc3b-2d8fcbc740f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:55.850217 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f99252-1367-40df-bc3b-2d8fcbc740f4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:55.861759 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 779/1565] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:55.862715 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f99252-1367-40df-bc3b-2d8fcbc740f4 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:55.872862 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f99252-1367-40df-bc3b-2d8fcbc740f4 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:55.877967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a2699-8350-4329-8b6a-d75399dde381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:55.878662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a2699-8350-4329-8b6a-d75399dde381 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.879092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a2699-8350-4329-8b6a-d75399dde381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.879378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1a2699-8350-4329-8b6a-d75399dde381 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.880109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a2699-8350-4329-8b6a-d75399dde381 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:36:55.880417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a2699-8350-4329-8b6a-d75399dde381 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:55.882348 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1a2699-8350-4329-8b6a-d75399dde381 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:55.894374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 780/1566] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:36:55.895163 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a2699-8350-4329-8b6a-d75399dde381 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:55.904502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1a2699-8350-4329-8b6a-d75399dde381 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:55.909872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aa6d2-a4fa-4a76-8caa-6b9edf64d997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:55.910509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aa6d2-a4fa-4a76-8caa-6b9edf64d997 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.910813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aa6d2-a4fa-4a76-8caa-6b9edf64d997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.911088 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-548aa6d2-a4fa-4a76-8caa-6b9edf64d997 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.911765 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548aa6d2-a4fa-4a76-8caa-6b9edf64d997 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:55.913646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-548aa6d2-a4fa-4a76-8caa-6b9edf64d997 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:55.914230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 787/1567] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/users => generated 284 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:55.914884 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001e8a1-f142-484a-905c-fc02c37501f7 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:55.925428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0001e8a1-f142-484a-905c-fc02c37501f7 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:55.930502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd674c-d68a-4a7c-aed3-df6a70155ad0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:55.931222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd674c-d68a-4a7c-aed3-df6a70155ad0 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.931513 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd674c-d68a-4a7c-aed3-df6a70155ad0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.931791 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffd674c-d68a-4a7c-aed3-df6a70155ad0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.932522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd674c-d68a-4a7c-aed3-df6a70155ad0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:36:55.932831 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd674c-d68a-4a7c-aed3-df6a70155ad0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:55.934432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffd674c-d68a-4a7c-aed3-df6a70155ad0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:55.948461 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 788/1568] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:36:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:36:55.949284 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd674c-d68a-4a7c-aed3-df6a70155ad0 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:55.959287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffd674c-d68a-4a7c-aed3-df6a70155ad0 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:55.963934 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa032297-081f-407a-a197-9715bf86682d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:55.964576 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa032297-081f-407a-a197-9715bf86682d admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:55.964881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa032297-081f-407a-a197-9715bf86682d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:55.965157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa032297-081f-407a-a197-9715bf86682d admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:55.965836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa032297-081f-407a-a197-9715bf86682d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:55.968306 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa032297-081f-407a-a197-9715bf86682d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:56.041056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 781/1569] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:56.041056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aa6d2-a4fa-4a76-8caa-6b9edf64d997 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:56.079273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 789/1570] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:36:55 2022] POST /identity/v3/projects => generated 369 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:56.079965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa032297-081f-407a-a197-9715bf86682d admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:56.113206 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-548aa6d2-a4fa-4a76-8caa-6b9edf64d997 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:56.144703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa032297-081f-407a-a197-9715bf86682d admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:56.149502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed3c3f-7e52-461f-b5a9-d3db3602e120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:56.150154 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed3c3f-7e52-461f-b5a9-d3db3602e120 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:56.150438 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed3c3f-7e52-461f-b5a9-d3db3602e120 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:56.150719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfed3c3f-7e52-461f-b5a9-d3db3602e120 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:56.151563 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed3c3f-7e52-461f-b5a9-d3db3602e120 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:36:56.151877 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed3c3f-7e52-461f-b5a9-d3db3602e120 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:56.153478 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfed3c3f-7e52-461f-b5a9-d3db3602e120 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:56.165893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 790/1571] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:36:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:36:56.166866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed3c3f-7e52-461f-b5a9-d3db3602e120 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:56.177166 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfed3c3f-7e52-461f-b5a9-d3db3602e120 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:56.180465 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad33a0-1d2f-4b16-8aed-af2e65b7b4c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:56.181138 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad33a0-1d2f-4b16-8aed-af2e65b7b4c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:56.181425 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad33a0-1d2f-4b16-8aed-af2e65b7b4c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:56.181713 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ad33a0-1d2f-4b16-8aed-af2e65b7b4c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:56.181823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de0bcf-708a-459d-89bd-690177934c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:56.182424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad33a0-1d2f-4b16-8aed-af2e65b7b4c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:56.182705 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de0bcf-708a-459d-89bd-690177934c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:56.183035 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de0bcf-708a-459d-89bd-690177934c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:56.183314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28de0bcf-708a-459d-89bd-690177934c6d admin admin] PATH_INFO: `/v3/projects/115fe7763abc4e32bc88cd0846619fa4/users/7a57f2b2c3a041f48290f7441cffe5b8/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:56.184537 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24ad33a0-1d2f-4b16-8aed-af2e65b7b4c7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:56.199620 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de0bcf-708a-459d-89bd-690177934c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=115fe7763abc4e32bc88cd0846619fa4, user_id=7a57f2b2c3a041f48290f7441cffe5b8, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:56.200656 dv-cinder-799871-34-smb devstack@keystone.service[80361]: WARNING py.warnings [None req-28de0bcf-708a-459d-89bd-690177934c6d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:36:56.200656 dv-cinder-799871-34-smb devstack@keystone.service[80361]: warnings.warn(msg) Jul 15 19:36:56.200656 dv-cinder-799871-34-smb devstack@keystone.service[80361]: Jul 15 19:36:56.203219 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28de0bcf-708a-459d-89bd-690177934c6d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:56.303896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 782/1572] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:36:56 2022] POST /identity/v3/projects => generated 393 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:56.304724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad33a0-1d2f-4b16-8aed-af2e65b7b4c7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:56.324969 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 791/1573] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:36:56 2022] PUT /identity/v3/projects/115fe7763abc4e32bc88cd0846619fa4/users/7a57f2b2c3a041f48290f7441cffe5b8/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:36:56.325954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de0bcf-708a-459d-89bd-690177934c6d admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:56.333048 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:56.371637 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ad33a0-1d2f-4b16-8aed-af2e65b7b4c7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:56.394518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28de0bcf-708a-459d-89bd-690177934c6d admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:56.399682 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe515f-b3e8-4532-8435-b80e43511c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:56.400286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe515f-b3e8-4532-8435-b80e43511c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:56.400613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe515f-b3e8-4532-8435-b80e43511c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:56.400845 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfe515f-b3e8-4532-8435-b80e43511c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:56.401598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe515f-b3e8-4532-8435-b80e43511c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:56.403299 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfe515f-b3e8-4532-8435-b80e43511c6d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:56.416955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 792/1574] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:56.416955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe515f-b3e8-4532-8435-b80e43511c6d admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:56.424515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfe515f-b3e8-4532-8435-b80e43511c6d admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:56.434828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398a040-8ce6-4612-9253-6827690811d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:56.434828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398a040-8ce6-4612-9253-6827690811d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:56.434828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398a040-8ce6-4612-9253-6827690811d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:56.434828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7398a040-8ce6-4612-9253-6827690811d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:56.435966 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398a040-8ce6-4612-9253-6827690811d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:56.436063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f002af-d704-4e10-a73c-f706c3164c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:56.436172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7398a040-8ce6-4612-9253-6827690811d2 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:56.436250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f002af-d704-4e10-a73c-f706c3164c25 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:56.436250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f002af-d704-4e10-a73c-f706c3164c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:56.436250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f002af-d704-4e10-a73c-f706c3164c25 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:56.436250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f002af-d704-4e10-a73c-f706c3164c25 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:56.436250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f002af-d704-4e10-a73c-f706c3164c25 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:56.441257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:56.566742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 793/1575] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:36:56 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:56.567601 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398a040-8ce6-4612-9253-6827690811d2 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:56.589391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 783/1576] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:36:56 2022] POST /identity/v3/projects => generated 373 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:56.590339 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f002af-d704-4e10-a73c-f706c3164c25 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:56.632038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7398a040-8ce6-4612-9253-6827690811d2 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:56.654888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f002af-d704-4e10-a73c-f706c3164c25 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:56.659694 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fbd65-2aba-48b0-ba59-3b19bb098730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:56.660357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fbd65-2aba-48b0-ba59-3b19bb098730 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:56.660646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fbd65-2aba-48b0-ba59-3b19bb098730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:56.660928 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956fbd65-2aba-48b0-ba59-3b19bb098730 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:56.661617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fbd65-2aba-48b0-ba59-3b19bb098730 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:56.662637 dv-cinder-799871-34-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-956fbd65-2aba-48b0-ba59-3b19bb098730 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:36:56.662637 dv-cinder-799871-34-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 15 19:36:56.662637 dv-cinder-799871-34-smb devstack@keystone.service[80362]: Jul 15 19:36:56.666424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956fbd65-2aba-48b0-ba59-3b19bb098730 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:56.689278 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084f6f0-ca9f-4dd6-8b8c-833a65e2fdaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:56.689947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084f6f0-ca9f-4dd6-8b8c-833a65e2fdaa admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:56.690229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084f6f0-ca9f-4dd6-8b8c-833a65e2fdaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:56.690506 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b084f6f0-ca9f-4dd6-8b8c-833a65e2fdaa admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:56.691219 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084f6f0-ca9f-4dd6-8b8c-833a65e2fdaa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:56.693133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b084f6f0-ca9f-4dd6-8b8c-833a65e2fdaa admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:56.751814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 784/1577] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:36:56 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:56.751814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fbd65-2aba-48b0-ba59-3b19bb098730 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:56.762771 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956fbd65-2aba-48b0-ba59-3b19bb098730 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:56.767895 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99634ebb-76a5-4fd6-b4ca-b95fb987457f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:56.768538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99634ebb-76a5-4fd6-b4ca-b95fb987457f admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:56.768817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99634ebb-76a5-4fd6-b4ca-b95fb987457f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:56.769117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99634ebb-76a5-4fd6-b4ca-b95fb987457f admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:56.769814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99634ebb-76a5-4fd6-b4ca-b95fb987457f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:56.771834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99634ebb-76a5-4fd6-b4ca-b95fb987457f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:56.808069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 794/1578] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:36:56 2022] POST /identity/v3/users => generated 283 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:56.808069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084f6f0-ca9f-4dd6-8b8c-833a65e2fdaa admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:56.817490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b084f6f0-ca9f-4dd6-8b8c-833a65e2fdaa admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:56.822422 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74cc5e-4e72-4580-bcda-1e26694c3552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:56.823137 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74cc5e-4e72-4580-bcda-1e26694c3552 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:56.823425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74cc5e-4e72-4580-bcda-1e26694c3552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:56.823737 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca74cc5e-4e72-4580-bcda-1e26694c3552 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:56.824396 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74cc5e-4e72-4580-bcda-1e26694c3552 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:56.826376 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca74cc5e-4e72-4580-bcda-1e26694c3552 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:56.910235 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 785/1579] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:36:56 2022] POST /identity/v3/projects => generated 383 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:56.911672 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac99be-cdb1-4b24-957a-85c3b0920ad3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:56.911960 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac99be-cdb1-4b24-957a-85c3b0920ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:56.912354 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dac99be-cdb1-4b24-957a-85c3b0920ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:56.930503 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4dac99be-cdb1-4b24-957a-85c3b0920ad3 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:56.939730 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4dac99be-cdb1-4b24-957a-85c3b0920ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:56.951075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:56.966690 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 795/1580] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:36:56 2022] POST /identity/v3/users => generated 297 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:56.968783 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74cc5e-4e72-4580-bcda-1e26694c3552 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:56.979003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca74cc5e-4e72-4580-bcda-1e26694c3552 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:56.995433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 786/1581] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:56.996451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac99be-cdb1-4b24-957a-85c3b0920ad3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.006625 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dac99be-cdb1-4b24-957a-85c3b0920ad3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.011478 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad15a54-8258-40c9-843a-2114fb855709 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.012143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad15a54-8258-40c9-843a-2114fb855709 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.012437 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad15a54-8258-40c9-843a-2114fb855709 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.012715 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad15a54-8258-40c9-843a-2114fb855709 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.013449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad15a54-8258-40c9-843a-2114fb855709 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.016016 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad15a54-8258-40c9-843a-2114fb855709 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.038071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de15462-af08-4e02-a5af-2f00cefbd451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.038733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de15462-af08-4e02-a5af-2f00cefbd451 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.039041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de15462-af08-4e02-a5af-2f00cefbd451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.039314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de15462-af08-4e02-a5af-2f00cefbd451 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.040035 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de15462-af08-4e02-a5af-2f00cefbd451 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.041610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de15462-af08-4e02-a5af-2f00cefbd451 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.051278 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 796/1582] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:56 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:57.052041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de15462-af08-4e02-a5af-2f00cefbd451 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.059507 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:57.065914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de15462-af08-4e02-a5af-2f00cefbd451 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.068848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0f15c-0d88-4571-9950-36a07d031f31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.069515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0f15c-0d88-4571-9950-36a07d031f31 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.069791 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0f15c-0d88-4571-9950-36a07d031f31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.070061 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e0f15c-0d88-4571-9950-36a07d031f31 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.070787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0f15c-0d88-4571-9950-36a07d031f31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.072809 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e0f15c-0d88-4571-9950-36a07d031f31 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.125475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 787/1583] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:36:56 2022] POST /identity/v3/users => generated 287 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:57.126444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad15a54-8258-40c9-843a-2114fb855709 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.137083 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad15a54-8258-40c9-843a-2114fb855709 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.142732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a0e51-ba62-440d-8844-e91fe4b381b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.143429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a0e51-ba62-440d-8844-e91fe4b381b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.143720 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a0e51-ba62-440d-8844-e91fe4b381b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.144025 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a0e51-ba62-440d-8844-e91fe4b381b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.144757 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a0e51-ba62-440d-8844-e91fe4b381b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.146510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a0e51-ba62-440d-8844-e91fe4b381b6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.162116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 788/1584] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:57.162116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a0e51-ba62-440d-8844-e91fe4b381b6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.170462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a0e51-ba62-440d-8844-e91fe4b381b6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.175148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c64599-9986-4f92-a04f-a94a5b9c9504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.175853 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c64599-9986-4f92-a04f-a94a5b9c9504 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.176138 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c64599-9986-4f92-a04f-a94a5b9c9504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.176406 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c64599-9986-4f92-a04f-a94a5b9c9504 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.177130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c64599-9986-4f92-a04f-a94a5b9c9504 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.178718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c64599-9986-4f92-a04f-a94a5b9c9504 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.191469 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 797/1585] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:36:57 2022] POST /identity/v3/users => generated 287 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:57.191469 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0f15c-0d88-4571-9950-36a07d031f31 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.193473 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 789/1586] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:57.195847 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c64599-9986-4f92-a04f-a94a5b9c9504 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.204394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e0f15c-0d88-4571-9950-36a07d031f31 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.207830 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c64599-9986-4f92-a04f-a94a5b9c9504 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.210458 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5569e-924f-4e19-aad4-b1fdbd45df6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.211521 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5569e-924f-4e19-aad4-b1fdbd45df6c admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.211854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5569e-924f-4e19-aad4-b1fdbd45df6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.212313 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c5569e-924f-4e19-aad4-b1fdbd45df6c admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.212981 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee171dc1-c3d8-4b2f-8a9e-b73444052dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.213128 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5569e-924f-4e19-aad4-b1fdbd45df6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.213791 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee171dc1-c3d8-4b2f-8a9e-b73444052dd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.214152 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee171dc1-c3d8-4b2f-8a9e-b73444052dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.214714 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee171dc1-c3d8-4b2f-8a9e-b73444052dd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.215366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee171dc1-c3d8-4b2f-8a9e-b73444052dd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.215489 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c5569e-924f-4e19-aad4-b1fdbd45df6c admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.217174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee171dc1-c3d8-4b2f-8a9e-b73444052dd0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.229008 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 790/1587] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:57.229835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee171dc1-c3d8-4b2f-8a9e-b73444052dd0 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.290069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee171dc1-c3d8-4b2f-8a9e-b73444052dd0 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.293806 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2fd2a-008f-4236-9e64-281b3c1af9a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.294453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2fd2a-008f-4236-9e64-281b3c1af9a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.294793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2fd2a-008f-4236-9e64-281b3c1af9a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.295077 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea2fd2a-008f-4236-9e64-281b3c1af9a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.305268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2fd2a-008f-4236-9e64-281b3c1af9a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.306717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea2fd2a-008f-4236-9e64-281b3c1af9a1 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.318000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 791/1588] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:36:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:36:57.318827 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2fd2a-008f-4236-9e64-281b3c1af9a1 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.329161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea2fd2a-008f-4236-9e64-281b3c1af9a1 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.334473 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e2297-3da9-462f-bdd2-279c2f80e4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.340236 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e2297-3da9-462f-bdd2-279c2f80e4d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.340236 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e2297-3da9-462f-bdd2-279c2f80e4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.340236 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e2297-3da9-462f-bdd2-279c2f80e4d5 admin admin] PATH_INFO: `/v3/projects/be7e2b67e7bd4059b0321970e4a89d57/users/d7ed35c9043e485cbc95e9c48a24f570/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.340762 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 798/1589] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:36:57 2022] POST /identity/v3/users => generated 292 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:57.341852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5569e-924f-4e19-aad4-b1fdbd45df6c admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.352413 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c5569e-924f-4e19-aad4-b1fdbd45df6c admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.352784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e2297-3da9-462f-bdd2-279c2f80e4d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be7e2b67e7bd4059b0321970e4a89d57, user_id=d7ed35c9043e485cbc95e9c48a24f570, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.355493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e2297-3da9-462f-bdd2-279c2f80e4d5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.357205 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cf5d1-31bb-4f0c-a913-b9f7c42baaef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.357870 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cf5d1-31bb-4f0c-a913-b9f7c42baaef admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.358170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cf5d1-31bb-4f0c-a913-b9f7c42baaef admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.358474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17cf5d1-31bb-4f0c-a913-b9f7c42baaef admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.359262 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cf5d1-31bb-4f0c-a913-b9f7c42baaef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.360831 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17cf5d1-31bb-4f0c-a913-b9f7c42baaef admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.372024 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 799/1590] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:57.374467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cf5d1-31bb-4f0c-a913-b9f7c42baaef admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.384894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17cf5d1-31bb-4f0c-a913-b9f7c42baaef admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.390341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7015c-8be9-48f3-9993-7095a49c1df5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.391039 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7015c-8be9-48f3-9993-7095a49c1df5 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.391321 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7015c-8be9-48f3-9993-7095a49c1df5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.391625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c7015c-8be9-48f3-9993-7095a49c1df5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.392340 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7015c-8be9-48f3-9993-7095a49c1df5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.393911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c7015c-8be9-48f3-9993-7095a49c1df5 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.403815 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 800/1591] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:57.404583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7015c-8be9-48f3-9993-7095a49c1df5 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.433673 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c7015c-8be9-48f3-9993-7095a49c1df5 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.433673 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be36ff5-1b1f-4977-9c5d-878e858aa46c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.433673 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be36ff5-1b1f-4977-9c5d-878e858aa46c admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.433673 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be36ff5-1b1f-4977-9c5d-878e858aa46c admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.434193 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be36ff5-1b1f-4977-9c5d-878e858aa46c admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.434193 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be36ff5-1b1f-4977-9c5d-878e858aa46c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.434193 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8be36ff5-1b1f-4977-9c5d-878e858aa46c admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.434193 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 801/1592] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:57.434193 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be36ff5-1b1f-4977-9c5d-878e858aa46c admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.445040 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be36ff5-1b1f-4977-9c5d-878e858aa46c admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.450238 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad59ee-b7b6-4269-a697-46300cc0170b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.450970 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad59ee-b7b6-4269-a697-46300cc0170b admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.451259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad59ee-b7b6-4269-a697-46300cc0170b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.451538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad59ee-b7b6-4269-a697-46300cc0170b admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.452857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad59ee-b7b6-4269-a697-46300cc0170b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.454679 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad59ee-b7b6-4269-a697-46300cc0170b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.468269 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 802/1593] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:57.469246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad59ee-b7b6-4269-a697-46300cc0170b admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.486450 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad59ee-b7b6-4269-a697-46300cc0170b admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.492446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cb88e-ad49-426d-a77f-8d4771f30f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.493169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cb88e-ad49-426d-a77f-8d4771f30f1c admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.493444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cb88e-ad49-426d-a77f-8d4771f30f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.493714 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8cb88e-ad49-426d-a77f-8d4771f30f1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.494430 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8cb88e-ad49-426d-a77f-8d4771f30f1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.496521 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8cb88e-ad49-426d-a77f-8d4771f30f1c admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.509572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 803/1594] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:57.510514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cb88e-ad49-426d-a77f-8d4771f30f1c admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.523051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8cb88e-ad49-426d-a77f-8d4771f30f1c admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.531388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 792/1595] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:36:57 2022] PUT /identity/v3/projects/be7e2b67e7bd4059b0321970e4a89d57/users/d7ed35c9043e485cbc95e9c48a24f570/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:36:57.531388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e2297-3da9-462f-bdd2-279c2f80e4d5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.585575 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:57.594496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e78392-085a-45df-a70d-c895066d37d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.595196 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78392-085a-45df-a70d-c895066d37d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.595482 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78392-085a-45df-a70d-c895066d37d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.595737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e2297-3da9-462f-bdd2-279c2f80e4d5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.595850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e78392-085a-45df-a70d-c895066d37d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.596483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e78392-085a-45df-a70d-c895066d37d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.598074 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e78392-085a-45df-a70d-c895066d37d0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.600401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dece69-d990-4601-a582-6e2ad1c8dbbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.602738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dece69-d990-4601-a582-6e2ad1c8dbbd admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.602738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dece69-d990-4601-a582-6e2ad1c8dbbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.602738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dece69-d990-4601-a582-6e2ad1c8dbbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.602738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dece69-d990-4601-a582-6e2ad1c8dbbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.603903 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52dece69-d990-4601-a582-6e2ad1c8dbbd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.611343 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 804/1596] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:57.611343 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e78392-085a-45df-a70d-c895066d37d0 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.617082 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 793/1597] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:57.617804 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dece69-d990-4601-a582-6e2ad1c8dbbd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.619387 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e78392-085a-45df-a70d-c895066d37d0 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.625558 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea917b-fc5e-4a6d-bbb9-47be0bb2f3ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.626484 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea917b-fc5e-4a6d-bbb9-47be0bb2f3ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.626815 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea917b-fc5e-4a6d-bbb9-47be0bb2f3ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.636574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea917b-fc5e-4a6d-bbb9-47be0bb2f3ec admin admin] PATH_INFO: `/v3/projects/9531f20efcb147ffafbe82dbae163696/users/bcc210a20d2e44248ff4170aaf3b37d4/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.636727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dece69-d990-4601-a582-6e2ad1c8dbbd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.636727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b002f6-6dfe-4572-81be-064ab7e2b3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.636727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b002f6-6dfe-4572-81be-064ab7e2b3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.636727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b002f6-6dfe-4572-81be-064ab7e2b3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.637097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b002f6-6dfe-4572-81be-064ab7e2b3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.637097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b002f6-6dfe-4572-81be-064ab7e2b3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.637097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b002f6-6dfe-4572-81be-064ab7e2b3d8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.642832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea917b-fc5e-4a6d-bbb9-47be0bb2f3ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9531f20efcb147ffafbe82dbae163696, user_id=bcc210a20d2e44248ff4170aaf3b37d4, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.645563 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea917b-fc5e-4a6d-bbb9-47be0bb2f3ec admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.648387 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 794/1598] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:57.649629 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b002f6-6dfe-4572-81be-064ab7e2b3d8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.659929 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b002f6-6dfe-4572-81be-064ab7e2b3d8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.664942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866304f8-7161-47a6-9c0c-ce34c7cddab8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.670367 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866304f8-7161-47a6-9c0c-ce34c7cddab8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.670367 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866304f8-7161-47a6-9c0c-ce34c7cddab8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.670367 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866304f8-7161-47a6-9c0c-ce34c7cddab8 admin admin] PATH_INFO: `/v3/projects/f5ba4e518b2d4cd29a3853b02aad8c82/users/5d85fe4fba904aecadb55682d3482623/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.682142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866304f8-7161-47a6-9c0c-ce34c7cddab8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5ba4e518b2d4cd29a3853b02aad8c82, user_id=5d85fe4fba904aecadb55682d3482623, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.685303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866304f8-7161-47a6-9c0c-ce34c7cddab8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.749106 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 805/1599] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:36:57 2022] PUT /identity/v3/projects/9531f20efcb147ffafbe82dbae163696/users/bcc210a20d2e44248ff4170aaf3b37d4/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:36:57.751395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea917b-fc5e-4a6d-bbb9-47be0bb2f3ec admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.781520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 795/1600] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:36:57 2022] PUT /identity/v3/projects/f5ba4e518b2d4cd29a3853b02aad8c82/users/5d85fe4fba904aecadb55682d3482623/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:36:57.792514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558389e-bd32-409d-994d-83e23dcf8586 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.792514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558389e-bd32-409d-994d-83e23dcf8586 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.792514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b558389e-bd32-409d-994d-83e23dcf8586 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.819666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b558389e-bd32-409d-994d-83e23dcf8586 None None] MFA Rules not processed for user `d7ed35c9043e485cbc95e9c48a24f570`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:57.819909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b558389e-bd32-409d-994d-83e23dcf8586 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:57.831926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:57.849831 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea917b-fc5e-4a6d-bbb9-47be0bb2f3ec admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.893175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 796/1601] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:57 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:57.894105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558389e-bd32-409d-994d-83e23dcf8586 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:57.916209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce76667-1897-43fc-8c80-a4e0503d581b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.917199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce76667-1897-43fc-8c80-a4e0503d581b admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.917577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce76667-1897-43fc-8c80-a4e0503d581b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.917921 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce76667-1897-43fc-8c80-a4e0503d581b admin admin] PATH_INFO: `/v3/projects/37634b7d5cda4eec8d1d7a72fff05e45/users/4e504742dcd245e5bee9a4d68a748b92/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.940725 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce76667-1897-43fc-8c80-a4e0503d581b admin admin] RBAC: Authorizing `identity:create_grant(project_id=37634b7d5cda4eec8d1d7a72fff05e45, user_id=4e504742dcd245e5bee9a4d68a748b92, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.943707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce76667-1897-43fc-8c80-a4e0503d581b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.972613 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b558389e-bd32-409d-994d-83e23dcf8586 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:57.977346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9609f-cfda-4455-b27f-455b4ebcd70f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:57.978021 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9609f-cfda-4455-b27f-455b4ebcd70f admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:57.978303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9609f-cfda-4455-b27f-455b4ebcd70f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:57.978578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd9609f-cfda-4455-b27f-455b4ebcd70f admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:57.979345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9609f-cfda-4455-b27f-455b4ebcd70f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:57.981003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd9609f-cfda-4455-b27f-455b4ebcd70f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:57.994922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 797/1602] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:57 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:57.994922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9609f-cfda-4455-b27f-455b4ebcd70f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:58.006737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd9609f-cfda-4455-b27f-455b4ebcd70f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:58.011621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44de6fa-b00b-4810-82d0-59fbc1f3dd57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:58.012563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44de6fa-b00b-4810-82d0-59fbc1f3dd57 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:58.012796 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44de6fa-b00b-4810-82d0-59fbc1f3dd57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:58.013066 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44de6fa-b00b-4810-82d0-59fbc1f3dd57 admin admin] PATH_INFO: `/v3/projects/9197598bf69e4a0886e555c125e86a4c/users/bf137a3c5f3545589b38e6874c0e2e03/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:58.029738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44de6fa-b00b-4810-82d0-59fbc1f3dd57 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9197598bf69e4a0886e555c125e86a4c, user_id=bf137a3c5f3545589b38e6874c0e2e03, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:58.036025 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 806/1603] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:36:57 2022] PUT /identity/v3/projects/37634b7d5cda4eec8d1d7a72fff05e45/users/4e504742dcd245e5bee9a4d68a748b92/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:36:58.036523 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44de6fa-b00b-4810-82d0-59fbc1f3dd57 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:58.036678 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce76667-1897-43fc-8c80-a4e0503d581b admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:58.106160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce76667-1897-43fc-8c80-a4e0503d581b admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:58.112059 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02fa266-f6c1-4776-b692-588a1fa553a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:58.112890 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fa266-f6c1-4776-b692-588a1fa553a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:58.113178 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fa266-f6c1-4776-b692-588a1fa553a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:58.114186 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02fa266-f6c1-4776-b692-588a1fa553a9 admin admin] PATH_INFO: `/v3/projects/6dfddfd1838d455c96977c2115f6963a/users/ff96a544058640e19e60c5f51895e95f/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:58.120559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 798/1604] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:36:57 2022] PUT /identity/v3/projects/9197598bf69e4a0886e555c125e86a4c/users/bf137a3c5f3545589b38e6874c0e2e03/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:36:58.122294 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d032db9-f576-4846-a381-8a13d077e77b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:58.129547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d032db9-f576-4846-a381-8a13d077e77b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:58.129547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d032db9-f576-4846-a381-8a13d077e77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:58.138202 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fa266-f6c1-4776-b692-588a1fa553a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6dfddfd1838d455c96977c2115f6963a, user_id=ff96a544058640e19e60c5f51895e95f, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:58.141436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02fa266-f6c1-4776-b692-588a1fa553a9 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:58.152284 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8d032db9-f576-4846-a381-8a13d077e77b None None] MFA Rules not processed for user `bcc210a20d2e44248ff4170aaf3b37d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:58.153535 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8d032db9-f576-4846-a381-8a13d077e77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:58.158318 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:58.224012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 807/1605] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:36:58 2022] PUT /identity/v3/projects/6dfddfd1838d455c96977c2115f6963a/users/ff96a544058640e19e60c5f51895e95f/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:36:58.224012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedaea9-a2a6-4b32-9779-7d82ef2d492b None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:58.224012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedaea9-a2a6-4b32-9779-7d82ef2d492b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:58.224012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fedaea9-a2a6-4b32-9779-7d82ef2d492b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:58.245013 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 799/1606] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:58 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:58.247224 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d032db9-f576-4846-a381-8a13d077e77b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:58.256301 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-0fedaea9-a2a6-4b32-9779-7d82ef2d492b None None] MFA Rules not processed for user `5d85fe4fba904aecadb55682d3482623`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:58.259109 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0fedaea9-a2a6-4b32-9779-7d82ef2d492b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:58.314392 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:58.319118 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d032db9-f576-4846-a381-8a13d077e77b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:58.335752 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 808/1607] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:58.340439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedaea9-a2a6-4b32-9779-7d82ef2d492b None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:58.375377 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e11fc46c-82a6-4e2c-8906-268fab4b4df0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:58.377361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc46c-82a6-4e2c-8906-268fab4b4df0 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:58.377361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc46c-82a6-4e2c-8906-268fab4b4df0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:58.377361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11fc46c-82a6-4e2c-8906-268fab4b4df0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:58.407277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fedaea9-a2a6-4b32-9779-7d82ef2d492b None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:58.412036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079a02b-5033-4365-bbd2-4b557d222e42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:58.413011 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079a02b-5033-4365-bbd2-4b557d222e42 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:58.413225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079a02b-5033-4365-bbd2-4b557d222e42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:58.413504 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079a02b-5033-4365-bbd2-4b557d222e42 admin admin] PATH_INFO: `/v3/projects/2cd8c41c1c514dd3befc4ffff1ad52e5/users/efaba747710744f59d77350e6f78f18b/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:58.429562 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079a02b-5033-4365-bbd2-4b557d222e42 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd8c41c1c514dd3befc4ffff1ad52e5, user_id=efaba747710744f59d77350e6f78f18b, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:58.432421 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9079a02b-5033-4365-bbd2-4b557d222e42 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:58.437493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fc46c-82a6-4e2c-8906-268fab4b4df0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:58.438999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e11fc46c-82a6-4e2c-8906-268fab4b4df0 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:58.449166 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 800/1608] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:36:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 203 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:36:58.452776 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4453324-7a87-4b06-a91f-5aebd25f3bd4 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:58.452776 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4453324-7a87-4b06-a91f-5aebd25f3bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:58.452776 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4453324-7a87-4b06-a91f-5aebd25f3bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:58.470215 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b4453324-7a87-4b06-a91f-5aebd25f3bd4 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:58.471900 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b4453324-7a87-4b06-a91f-5aebd25f3bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:58.483440 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 801/1609] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:58.483440 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadff4d-0d0e-4085-a418-14cc2517e860 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:58.483440 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadff4d-0d0e-4085-a418-14cc2517e860 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:58.483440 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dadff4d-0d0e-4085-a418-14cc2517e860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:58.514088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 809/1610] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:36:58 2022] PUT /identity/v3/projects/2cd8c41c1c514dd3befc4ffff1ad52e5/users/efaba747710744f59d77350e6f78f18b/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:36:58.516753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523cf26-e944-46a4-bbbe-3da59c63223d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:58.516918 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9dadff4d-0d0e-4085-a418-14cc2517e860 None None] MFA Rules not processed for user `bf137a3c5f3545589b38e6874c0e2e03`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:58.517283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523cf26-e944-46a4-bbbe-3da59c63223d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:58.517661 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e523cf26-e944-46a4-bbbe-3da59c63223d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:58.518422 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9dadff4d-0d0e-4085-a418-14cc2517e860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:58.564547 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-e523cf26-e944-46a4-bbbe-3da59c63223d None None] MFA Rules not processed for user `ff96a544058640e19e60c5f51895e95f`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:58.571068 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e523cf26-e944-46a4-bbbe-3da59c63223d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:58.593915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 802/1611] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:58.600177 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadff4d-0d0e-4085-a418-14cc2517e860 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:58.649277 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:58.651201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 810/1612] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:58.659755 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523cf26-e944-46a4-bbbe-3da59c63223d None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:58.687598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dadff4d-0d0e-4085-a418-14cc2517e860 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:58.693358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7d1ca-eb6c-4bfc-9aa9-a3aa3095609b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:58.694023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7d1ca-eb6c-4bfc-9aa9-a3aa3095609b admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:58.694341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7d1ca-eb6c-4bfc-9aa9-a3aa3095609b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:58.694607 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e7d1ca-eb6c-4bfc-9aa9-a3aa3095609b admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:58.695364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7d1ca-eb6c-4bfc-9aa9-a3aa3095609b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:58.697908 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e7d1ca-eb6c-4bfc-9aa9-a3aa3095609b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:58.742378 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e523cf26-e944-46a4-bbbe-3da59c63223d None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:58.747646 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddb5d17-c9ec-4763-9b83-2fd0c8afb892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:58.748319 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb5d17-c9ec-4763-9b83-2fd0c8afb892 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:58.748608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb5d17-c9ec-4763-9b83-2fd0c8afb892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:58.749068 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddb5d17-c9ec-4763-9b83-2fd0c8afb892 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:58.749604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb5d17-c9ec-4763-9b83-2fd0c8afb892 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:58.751625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddb5d17-c9ec-4763-9b83-2fd0c8afb892 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:58.770922 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:58.827797 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 803/1613] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:36:58 2022] POST /identity/v3/projects => generated 369 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:58.828973 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7d1ca-eb6c-4bfc-9aa9-a3aa3095609b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:58.830804 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d3e7d1ca-eb6c-4bfc-9aa9-a3aa3095609b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:58.867186 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 811/1614] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:36:58 2022] POST /identity/v3/projects => generated 365 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:58.869275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac80eed-2cc5-421e-9661-7e5fe2909a5c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:58.869540 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac80eed-2cc5-421e-9661-7e5fe2909a5c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:58.870027 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac80eed-2cc5-421e-9661-7e5fe2909a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:58.906354 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-4ac80eed-2cc5-421e-9661-7e5fe2909a5c None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:58.907606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4ac80eed-2cc5-421e-9661-7e5fe2909a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:58.911520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e7d1ca-eb6c-4bfc-9aa9-a3aa3095609b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:58.958626 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:36:58.971125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdbfa6-7916-403b-95c7-d1d86f331ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:58.971842 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdbfa6-7916-403b-95c7-d1d86f331ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:58.972176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdbfa6-7916-403b-95c7-d1d86f331ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:58.972456 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75fdbfa6-7916-403b-95c7-d1d86f331ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:58.979793 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 812/1615] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:58.981581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630cc6b-c8eb-4d66-8851-1eddd7352feb None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:58.981912 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630cc6b-c8eb-4d66-8851-1eddd7352feb None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:58.982329 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630cc6b-c8eb-4d66-8851-1eddd7352feb None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:58.983714 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fdbfa6-7916-403b-95c7-d1d86f331ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:58.985342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 813/1616] 10.222.0.40 () {54 vars in 961 bytes} [Fri Jul 15 19:36:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:36:58.986662 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3debbc-5967-4480-baa4-0e95ac115827 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:58.987071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3debbc-5967-4480-baa4-0e95ac115827 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:58.987540 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3debbc-5967-4480-baa4-0e95ac115827 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:58.990951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 814/1617] 10.222.0.40 () {54 vars in 961 bytes} [Fri Jul 15 19:36:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:36:58.991134 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75fdbfa6-7916-403b-95c7-d1d86f331ef0 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:58.995702 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3debbc-5967-4480-baa4-0e95ac115827 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:59.003509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 804/1618] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:36:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:36:59.004361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdbfa6-7916-403b-95c7-d1d86f331ef0 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:59.019436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3debbc-5967-4480-baa4-0e95ac115827 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:59.019594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75fdbfa6-7916-403b-95c7-d1d86f331ef0 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:59.021581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7360b6-61f0-4336-9791-4a6376a08469 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:59.022382 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7360b6-61f0-4336-9791-4a6376a08469 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:59.022940 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7360b6-61f0-4336-9791-4a6376a08469 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:59.023317 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79035464-58ca-43d0-8d56-25837e9f596e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:59.023453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7360b6-61f0-4336-9791-4a6376a08469 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:59.024225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79035464-58ca-43d0-8d56-25837e9f596e admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:59.024516 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79035464-58ca-43d0-8d56-25837e9f596e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:59.024638 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7360b6-61f0-4336-9791-4a6376a08469 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:59.024830 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79035464-58ca-43d0-8d56-25837e9f596e admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:59.025727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79035464-58ca-43d0-8d56-25837e9f596e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:59.028284 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79035464-58ca-43d0-8d56-25837e9f596e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:59.028436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7360b6-61f0-4336-9791-4a6376a08469 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:59.139217 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 805/1619] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:36:59 2022] POST /identity/v3/users => generated 289 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:59.141634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe304b-cfd9-4c5a-964c-209f6cf216bb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:59.141926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe304b-cfd9-4c5a-964c-209f6cf216bb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:59.142204 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfe304b-cfd9-4c5a-964c-209f6cf216bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:59.146892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 815/1620] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:36:58 2022] POST /identity/v3/users => generated 291 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:36:59.146892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7360b6-61f0-4336-9791-4a6376a08469 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:59.172447 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7360b6-61f0-4336-9791-4a6376a08469 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:59.185244 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fdae6dc-66f9-4f49-bacf-2a0d799807ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:59.189878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdae6dc-66f9-4f49-bacf-2a0d799807ef service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:59.189878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdae6dc-66f9-4f49-bacf-2a0d799807ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:59.189878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fdae6dc-66f9-4f49-bacf-2a0d799807ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:59.191319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-bdfe304b-cfd9-4c5a-964c-209f6cf216bb None None] MFA Rules not processed for user `850a32e590154968bfbbfc404450b70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:59.192719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bdfe304b-cfd9-4c5a-964c-209f6cf216bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:59.201772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdae6dc-66f9-4f49-bacf-2a0d799807ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:59.204525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fdae6dc-66f9-4f49-bacf-2a0d799807ef service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:59.218297 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 816/1621] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:36:59.220362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d690d0-1c18-455f-ae3d-c93573febc61 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:59.220877 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d690d0-1c18-455f-ae3d-c93573febc61 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:59.221218 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d690d0-1c18-455f-ae3d-c93573febc61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:59.246951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-25d690d0-1c18-455f-ae3d-c93573febc61 None None] MFA Rules not processed for user `850a32e590154968bfbbfc404450b70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:36:59.248565 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-25d690d0-1c18-455f-ae3d-c93573febc61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:36:59.288510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 806/1622] 10.222.0.40 () {58 vars in 1058 bytes} [Fri Jul 15 19:36:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:59.289535 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe304b-cfd9-4c5a-964c-209f6cf216bb None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:59.300896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfe304b-cfd9-4c5a-964c-209f6cf216bb None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:59.306079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969de5a-3190-4b26-9b4d-4c5df89ea9f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:59.306813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969de5a-3190-4b26-9b4d-4c5df89ea9f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:59.307096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969de5a-3190-4b26-9b4d-4c5df89ea9f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:59.310290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3969de5a-3190-4b26-9b4d-4c5df89ea9f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:59.310290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969de5a-3190-4b26-9b4d-4c5df89ea9f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:59.310290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3969de5a-3190-4b26-9b4d-4c5df89ea9f5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:59.326623 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 807/1623] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:59.328519 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969de5a-3190-4b26-9b4d-4c5df89ea9f5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:59.348684 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3969de5a-3190-4b26-9b4d-4c5df89ea9f5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:59.361582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366fa58-cfea-4b85-98b1-bc6977ba77dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:59.362267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366fa58-cfea-4b85-98b1-bc6977ba77dd admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:59.362559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366fa58-cfea-4b85-98b1-bc6977ba77dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:59.363099 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5366fa58-cfea-4b85-98b1-bc6977ba77dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:59.365954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366fa58-cfea-4b85-98b1-bc6977ba77dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:59.374238 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5366fa58-cfea-4b85-98b1-bc6977ba77dd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:59.379071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 817/1624] 10.222.0.40 () {58 vars in 1058 bytes} [Fri Jul 15 19:36:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:36:59.380120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d690d0-1c18-455f-ae3d-c93573febc61 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:59.388567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 808/1625] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:59.390401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366fa58-cfea-4b85-98b1-bc6977ba77dd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:59.396450 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d690d0-1c18-455f-ae3d-c93573febc61 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:59.402816 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6fd19-3d55-4c52-9cfc-f40a4ae2c3f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:59.403754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6fd19-3d55-4c52-9cfc-f40a4ae2c3f6 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:59.404416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6fd19-3d55-4c52-9cfc-f40a4ae2c3f6 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:59.404749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6fd19-3d55-4c52-9cfc-f40a4ae2c3f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:59.428781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5366fa58-cfea-4b85-98b1-bc6977ba77dd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:59.453849 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dab10a-35b5-4068-938c-a24e311ce6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:59.457948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab10a-35b5-4068-938c-a24e311ce6c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:59.458250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab10a-35b5-4068-938c-a24e311ce6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:59.458531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dab10a-35b5-4068-938c-a24e311ce6c9 admin admin] PATH_INFO: `/v3/projects/0a731a3a09e346ca852f50f447bad08c/users/3efe6920bba0463188b991b6dba42295/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:59.491857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6fd19-3d55-4c52-9cfc-f40a4ae2c3f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:59.494639 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6fd19-3d55-4c52-9cfc-f40a4ae2c3f6 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:59.502688 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dab10a-35b5-4068-938c-a24e311ce6c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a731a3a09e346ca852f50f447bad08c, user_id=3efe6920bba0463188b991b6dba42295, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:59.508278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dab10a-35b5-4068-938c-a24e311ce6c9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:59.520898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 818/1626] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:36:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:36:59.522065 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6fd19-3d55-4c52-9cfc-f40a4ae2c3f6 service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:59.537101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6fd19-3d55-4c52-9cfc-f40a4ae2c3f6 service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:59.548834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7d186-6cda-4ea6-84cf-ae282d84ecba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:59.549538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7d186-6cda-4ea6-84cf-ae282d84ecba service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:59.549824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7d186-6cda-4ea6-84cf-ae282d84ecba service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:59.550099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd7d186-6cda-4ea6-84cf-ae282d84ecba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:59.655805 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 809/1627] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:36:59 2022] PUT /identity/v3/projects/0a731a3a09e346ca852f50f447bad08c/users/3efe6920bba0463188b991b6dba42295/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:36:59.656780 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dab10a-35b5-4068-938c-a24e311ce6c9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:59.657473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7d186-6cda-4ea6-84cf-ae282d84ecba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:59.659619 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd7d186-6cda-4ea6-84cf-ae282d84ecba service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:59.681088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 819/1628] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:36:59 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:36:59.682311 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7d186-6cda-4ea6-84cf-ae282d84ecba service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:59.695871 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd7d186-6cda-4ea6-84cf-ae282d84ecba service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:59.807085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dab10a-35b5-4068-938c-a24e311ce6c9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:59.825485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b24d1a-b38c-4b02-b7a3-700e9167a892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:59.826445 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b24d1a-b38c-4b02-b7a3-700e9167a892 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:59.826729 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b24d1a-b38c-4b02-b7a3-700e9167a892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:59.828580 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b24d1a-b38c-4b02-b7a3-700e9167a892 admin admin] PATH_INFO: `/v3/projects/6aa3244fb5224f019d0730dbbdb32db0/users/fcb1ee31582240bca2499ac85fe8d454/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:59.856978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013a8bd-7287-40fd-9083-0e345bd40012 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:59.857680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013a8bd-7287-40fd-9083-0e345bd40012 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:59.861854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013a8bd-7287-40fd-9083-0e345bd40012 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:59.862146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9013a8bd-7287-40fd-9083-0e345bd40012 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:59.863929 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013a8bd-7287-40fd-9083-0e345bd40012 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:59.877332 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9013a8bd-7287-40fd-9083-0e345bd40012 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:59.883861 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b24d1a-b38c-4b02-b7a3-700e9167a892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa3244fb5224f019d0730dbbdb32db0, user_id=fcb1ee31582240bca2499ac85fe8d454, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:59.892292 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b24d1a-b38c-4b02-b7a3-700e9167a892 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:59.913695 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 820/1629] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:36:59 2022] GET /identity/v3/roles => generated 1420 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:36:59.914648 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013a8bd-7287-40fd-9083-0e345bd40012 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:36:59.945979 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9013a8bd-7287-40fd-9083-0e345bd40012 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:36:59.952627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f422c1f5-55d2-40f7-bda3-322da8a3eb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:36:59.953787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422c1f5-55d2-40f7-bda3-322da8a3eb21 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:59.954914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422c1f5-55d2-40f7-bda3-322da8a3eb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:59.955204 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f422c1f5-55d2-40f7-bda3-322da8a3eb21 admin admin] PATH_INFO: `/v3/projects/0a731a3a09e346ca852f50f447bad08c/users/3efe6920bba0463188b991b6dba42295/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:36:59.957608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422c1f5-55d2-40f7-bda3-322da8a3eb21 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a731a3a09e346ca852f50f447bad08c, user_id=3efe6920bba0463188b991b6dba42295, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:36:59.960570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f422c1f5-55d2-40f7-bda3-322da8a3eb21 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:36:59.974150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 821/1630] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:36:59 2022] PUT /identity/v3/projects/0a731a3a09e346ca852f50f447bad08c/users/3efe6920bba0463188b991b6dba42295/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:36:59.985345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad9070-7628-4450-bf0e-5938b76bcf93 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:36:59.985644 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad9070-7628-4450-bf0e-5938b76bcf93 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:36:59.985993 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ad9070-7628-4450-bf0e-5938b76bcf93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:00.065854 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 810/1631] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:36:59 2022] PUT /identity/v3/projects/6aa3244fb5224f019d0730dbbdb32db0/users/fcb1ee31582240bca2499ac85fe8d454/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:00.067710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a521d29-e05b-4c2b-9e6b-32c0451a4f43 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:00.068037 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a521d29-e05b-4c2b-9e6b-32c0451a4f43 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:00.068324 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a521d29-e05b-4c2b-9e6b-32c0451a4f43 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:00.078465 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 811/1632] 10.222.0.40 () {54 vars in 912 bytes} [Fri Jul 15 19:37:00 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:37:00.079227 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a521d29-e05b-4c2b-9e6b-32c0451a4f43 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:00.085018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a2ad9070-7628-4450-bf0e-5938b76bcf93 None None] MFA Rules not processed for user `3efe6920bba0463188b991b6dba42295`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:00.087914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a2ad9070-7628-4450-bf0e-5938b76bcf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:00.105210 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:00.176299 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:00.258780 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a521d29-e05b-4c2b-9e6b-32c0451a4f43 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:00.269619 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e570a9fc-538a-4af1-9fd3-255795bcd404 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:00.270364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570a9fc-538a-4af1-9fd3-255795bcd404 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:00.270737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570a9fc-538a-4af1-9fd3-255795bcd404 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:00.271110 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e570a9fc-538a-4af1-9fd3-255795bcd404 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:00.271968 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570a9fc-538a-4af1-9fd3-255795bcd404 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:00.350910 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e570a9fc-538a-4af1-9fd3-255795bcd404 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:00.713194 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 822/1633] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:36:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 317 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:00.713194 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557778f2-b3bf-4552-ad72-acfb68fca1c5 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:00.713194 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557778f2-b3bf-4552-ad72-acfb68fca1c5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:00.713194 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557778f2-b3bf-4552-ad72-acfb68fca1c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:00.717189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 812/1634] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:00.717189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c0b6-99e3-4c51-81cc-da26266e8bd5 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:00.717189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c0b6-99e3-4c51-81cc-da26266e8bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:00.717189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228c0b6-99e3-4c51-81cc-da26266e8bd5 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:00.717189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 813/1635] 10.222.0.40 () {54 vars in 912 bytes} [Fri Jul 15 19:37:00 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:37:00.717189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228c0b6-99e3-4c51-81cc-da26266e8bd5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:00.719303 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-557778f2-b3bf-4552-ad72-acfb68fca1c5 None None] MFA Rules not processed for user `850a32e590154968bfbbfc404450b70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:00.719303 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-557778f2-b3bf-4552-ad72-acfb68fca1c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:00.719800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228c0b6-99e3-4c51-81cc-da26266e8bd5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:00.719800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1cf82-c917-48b6-af0c-0e2f3f993a8f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:00.719800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1cf82-c917-48b6-af0c-0e2f3f993a8f service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:00.719800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1cf82-c917-48b6-af0c-0e2f3f993a8f service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:00.720877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a1cf82-c917-48b6-af0c-0e2f3f993a8f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:00.720877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1cf82-c917-48b6-af0c-0e2f3f993a8f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:00.720877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a1cf82-c917-48b6-af0c-0e2f3f993a8f service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:00.720877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 814/1636] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:00 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:00.720877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1cf82-c917-48b6-af0c-0e2f3f993a8f service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:00.723283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 823/1637] 10.222.0.40 () {58 vars in 1009 bytes} [Fri Jul 15 19:37:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:00.723283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37123373-9d15-4760-b027-6ce95309037f None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:00.723283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37123373-9d15-4760-b027-6ce95309037f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:00.723283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37123373-9d15-4760-b027-6ce95309037f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:00.724568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a1cf82-c917-48b6-af0c-0e2f3f993a8f service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:00.724568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03366d9f-4f8e-4744-9da5-cd65a5f3ab5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:00.727952 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-37123373-9d15-4760-b027-6ce95309037f None None] MFA Rules not processed for user `850a32e590154968bfbbfc404450b70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:00.728486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03366d9f-4f8e-4744-9da5-cd65a5f3ab5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:00.728486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03366d9f-4f8e-4744-9da5-cd65a5f3ab5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:00.728486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03366d9f-4f8e-4744-9da5-cd65a5f3ab5c admin admin] PATH_INFO: `/v3/projects/6aa3244fb5224f019d0730dbbdb32db0/users/fcb1ee31582240bca2499ac85fe8d454/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:00.728832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-37123373-9d15-4760-b027-6ce95309037f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:00.728930 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03366d9f-4f8e-4744-9da5-cd65a5f3ab5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6aa3244fb5224f019d0730dbbdb32db0, user_id=fcb1ee31582240bca2499ac85fe8d454, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:00.728930 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03366d9f-4f8e-4744-9da5-cd65a5f3ab5c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:00.729111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 824/1638] 10.222.0.40 () {58 vars in 1009 bytes} [Fri Jul 15 19:37:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:00.729111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37123373-9d15-4760-b027-6ce95309037f None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:00.729111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37123373-9d15-4760-b027-6ce95309037f None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:00.729397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 815/1639] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:00 2022] PUT /identity/v3/projects/6aa3244fb5224f019d0730dbbdb32db0/users/fcb1ee31582240bca2499ac85fe8d454/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 86 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:00.729397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace46833-1f40-4855-92eb-445a617fa362 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:00.729397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace46833-1f40-4855-92eb-445a617fa362 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:00.729397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace46833-1f40-4855-92eb-445a617fa362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:00.729397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ace46833-1f40-4855-92eb-445a617fa362 None None] MFA Rules not processed for user `fcb1ee31582240bca2499ac85fe8d454`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:00.729918 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ace46833-1f40-4855-92eb-445a617fa362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:00.730029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885906b-e34f-429e-8d44-f8d663a6c500 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:00.730029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885906b-e34f-429e-8d44-f8d663a6c500 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:00.730029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885906b-e34f-429e-8d44-f8d663a6c500 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:00.730029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2885906b-e34f-429e-8d44-f8d663a6c500 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:00.804382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 816/1640] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:00 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:37:00.824511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885906b-e34f-429e-8d44-f8d663a6c500 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:00.825989 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2885906b-e34f-429e-8d44-f8d663a6c500 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:00.851719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 825/1641] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:00.872541 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace46833-1f40-4855-92eb-445a617fa362 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:00.901573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace46833-1f40-4855-92eb-445a617fa362 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:00.908825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa7dbf-7a0e-4d92-8960-d39e34599110 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:00.908825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa7dbf-7a0e-4d92-8960-d39e34599110 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:00.908825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa7dbf-7a0e-4d92-8960-d39e34599110 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:00.909128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa7dbf-7a0e-4d92-8960-d39e34599110 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:00.928710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa7dbf-7a0e-4d92-8960-d39e34599110 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:00.930418 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa7dbf-7a0e-4d92-8960-d39e34599110 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:00.944661 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 817/1642] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:00.986668 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885906b-e34f-429e-8d44-f8d663a6c500 service cinder] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:00.998084 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2885906b-e34f-429e-8d44-f8d663a6c500 service cinder] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:01.002951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1b9de4-aab1-4852-9b6f-9d8725760e67 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:01.003744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b9de4-aab1-4852-9b6f-9d8725760e67 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:01.004125 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b9de4-aab1-4852-9b6f-9d8725760e67 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:01.004524 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1b9de4-aab1-4852-9b6f-9d8725760e67 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:01.021399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b9de4-aab1-4852-9b6f-9d8725760e67 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:01.023042 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1b9de4-aab1-4852-9b6f-9d8725760e67 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:01.066099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 826/1643] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:00 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:01.251929 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:01.445642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:01.663232 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa7dbf-7a0e-4d92-8960-d39e34599110 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:01.761273 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa7dbf-7a0e-4d92-8960-d39e34599110 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:01.767967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2de57f-e618-4852-9900-815fc7071d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:01.768980 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2de57f-e618-4852-9900-815fc7071d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:01.769327 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2de57f-e618-4852-9900-815fc7071d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:01.769758 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2de57f-e618-4852-9900-815fc7071d62 admin admin] PATH_INFO: `/v3/users/bf137a3c5f3545589b38e6874c0e2e03` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:01.771291 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2de57f-e618-4852-9900-815fc7071d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf137a3c5f3545589b38e6874c0e2e03)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:01.773456 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b2de57f-e618-4852-9900-815fc7071d62 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:02.136517 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5b2de57f-e618-4852-9900-815fc7071d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf137a3c5f3545589b38e6874c0e2e03'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:02.172183 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5b2de57f-e618-4852-9900-815fc7071d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf137a3c5f3545589b38e6874c0e2e03'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:02.174860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5b2de57f-e618-4852-9900-815fc7071d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf137a3c5f3545589b38e6874c0e2e03'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:02.177110 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5b2de57f-e618-4852-9900-815fc7071d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf137a3c5f3545589b38e6874c0e2e03'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:02.199291 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5b2de57f-e618-4852-9900-815fc7071d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf137a3c5f3545589b38e6874c0e2e03'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:02.334588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 818/1644] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:01 2022] DELETE /identity/v3/users/bf137a3c5f3545589b38e6874c0e2e03 => generated 0 bytes in 672 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:02.340782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9ac54-8201-4633-879a-656c2881c009 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:02.341492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9ac54-8201-4633-879a-656c2881c009 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:02.341492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea9ac54-8201-4633-879a-656c2881c009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:02.373901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-0ea9ac54-8201-4633-879a-656c2881c009 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:02.376095 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0ea9ac54-8201-4633-879a-656c2881c009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:02.512595 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 827/1645] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:02.521201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2de57f-e618-4852-9900-815fc7071d62 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:02.522670 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5b2de57f-e618-4852-9900-815fc7071d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:02.673633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2de57f-e618-4852-9900-815fc7071d62 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:02.677317 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e908b26-9fdc-4f3d-92a6-67d0a99db1d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:02.678066 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e908b26-9fdc-4f3d-92a6-67d0a99db1d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:02.679011 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e908b26-9fdc-4f3d-92a6-67d0a99db1d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:02.679011 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e908b26-9fdc-4f3d-92a6-67d0a99db1d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:02.691453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e908b26-9fdc-4f3d-92a6-67d0a99db1d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:02.693369 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e908b26-9fdc-4f3d-92a6-67d0a99db1d0 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:02.719574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 819/1646] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:02.988312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:03.208456 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:04.327634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9ac54-8201-4633-879a-656c2881c009 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:04.329930 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0ea9ac54-8201-4633-879a-656c2881c009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:04.357431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea9ac54-8201-4633-879a-656c2881c009 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:04.369217 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fe9918-fd6d-4dcc-a93c-f3c6858d50b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:04.380984 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe9918-fd6d-4dcc-a93c-f3c6858d50b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:04.381560 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe9918-fd6d-4dcc-a93c-f3c6858d50b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:04.381858 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fe9918-fd6d-4dcc-a93c-f3c6858d50b0 admin admin] PATH_INFO: `/v3/projects/9197598bf69e4a0886e555c125e86a4c` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:04.384016 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe9918-fd6d-4dcc-a93c-f3c6858d50b0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9197598bf69e4a0886e555c125e86a4c)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:04.395523 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fe9918-fd6d-4dcc-a93c-f3c6858d50b0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:04.664328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-44fe9918-fd6d-4dcc-a93c-f3c6858d50b0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9197598bf69e4a0886e555c125e86a4c', 'request_id': 'req-44fe9918-fd6d-4dcc-a93c-f3c6858d50b0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:04.668218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e908b26-9fdc-4f3d-92a6-67d0a99db1d0 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:04.669837 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9e908b26-9fdc-4f3d-92a6-67d0a99db1d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:04.701095 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e908b26-9fdc-4f3d-92a6-67d0a99db1d0 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:04.782291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-44fe9918-fd6d-4dcc-a93c-f3c6858d50b0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9197598bf69e4a0886e555c125e86a4c', 'request_id': 'req-44fe9918-fd6d-4dcc-a93c-f3c6858d50b0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:04.800018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-44fe9918-fd6d-4dcc-a93c-f3c6858d50b0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9197598bf69e4a0886e555c125e86a4c', 'request_id': 'req-44fe9918-fd6d-4dcc-a93c-f3c6858d50b0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:04.816904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-44fe9918-fd6d-4dcc-a93c-f3c6858d50b0 admin admin] The token cache is being invalidate because project 9197598bf69e4a0886e555c125e86a4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:04.817484 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-44fe9918-fd6d-4dcc-a93c-f3c6858d50b0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:04.820581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-44fe9918-fd6d-4dcc-a93c-f3c6858d50b0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:04.824732 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 828/1647] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:04 2022] DELETE /identity/v3/projects/9197598bf69e4a0886e555c125e86a4c => generated 0 bytes in 499 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:04.829388 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fd529-126d-4646-b7c1-2513eb5092d0 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:04.830030 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fd529-126d-4646-b7c1-2513eb5092d0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:04.830533 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521fd529-126d-4646-b7c1-2513eb5092d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:04.875090 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-521fd529-126d-4646-b7c1-2513eb5092d0 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:04.881867 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-521fd529-126d-4646-b7c1-2513eb5092d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:04.884517 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163951c3-dc42-412e-a102-88a0883cb78e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:04.888530 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163951c3-dc42-412e-a102-88a0883cb78e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:04.892914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163951c3-dc42-412e-a102-88a0883cb78e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:04.893846 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163951c3-dc42-412e-a102-88a0883cb78e admin admin] PATH_INFO: `/v3/users/5d85fe4fba904aecadb55682d3482623` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:04.896928 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163951c3-dc42-412e-a102-88a0883cb78e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5d85fe4fba904aecadb55682d3482623)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:04.900814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163951c3-dc42-412e-a102-88a0883cb78e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:04.918578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 829/1648] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:37:04.928068 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9fd54-218e-492d-8e26-6564deef7538 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:04.928653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9fd54-218e-492d-8e26-6564deef7538 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:04.929070 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f9fd54-218e-492d-8e26-6564deef7538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:05.007353 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c4f9fd54-218e-492d-8e26-6564deef7538 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:05.017467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c4f9fd54-218e-492d-8e26-6564deef7538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:05.050187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 830/1649] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:37:05.055691 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9fd54-218e-492d-8e26-6564deef7538 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:05.094028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4f9fd54-218e-492d-8e26-6564deef7538 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:05.123996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d48cfe-d0a3-4d18-9015-0a9e6d6edf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:05.125642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d48cfe-d0a3-4d18-9015-0a9e6d6edf74 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:05.126199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d48cfe-d0a3-4d18-9015-0a9e6d6edf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:05.126570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d48cfe-d0a3-4d18-9015-0a9e6d6edf74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:05.127458 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d48cfe-d0a3-4d18-9015-0a9e6d6edf74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:37:05.127828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d48cfe-d0a3-4d18-9015-0a9e6d6edf74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:05.132269 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d48cfe-d0a3-4d18-9015-0a9e6d6edf74 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:05.177108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 831/1650] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:37:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 122 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:37:05.181478 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d48cfe-d0a3-4d18-9015-0a9e6d6edf74 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:05.220107 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d48cfe-d0a3-4d18-9015-0a9e6d6edf74 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:05.228769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30119c-1e58-441d-9483-0115cd84c4d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:05.229669 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30119c-1e58-441d-9483-0115cd84c4d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:05.229841 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30119c-1e58-441d-9483-0115cd84c4d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:05.230125 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a30119c-1e58-441d-9483-0115cd84c4d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:05.230925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30119c-1e58-441d-9483-0115cd84c4d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:05.233778 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a30119c-1e58-441d-9483-0115cd84c4d9 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:05.234597 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-163951c3-dc42-412e-a102-88a0883cb78e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5d85fe4fba904aecadb55682d3482623'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:05.279598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-163951c3-dc42-412e-a102-88a0883cb78e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5d85fe4fba904aecadb55682d3482623'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:05.279598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-163951c3-dc42-412e-a102-88a0883cb78e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5d85fe4fba904aecadb55682d3482623'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:05.281971 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-163951c3-dc42-412e-a102-88a0883cb78e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5d85fe4fba904aecadb55682d3482623'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:05.306298 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-163951c3-dc42-412e-a102-88a0883cb78e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5d85fe4fba904aecadb55682d3482623'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:05.350494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 832/1651] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:05 2022] POST /identity/v3/projects => generated 403 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:05.357654 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30119c-1e58-441d-9483-0115cd84c4d9 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:05.364075 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5a30119c-1e58-441d-9483-0115cd84c4d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:05.463279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 820/1652] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:04 2022] DELETE /identity/v3/users/5d85fe4fba904aecadb55682d3482623 => generated 0 bytes in 790 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:05.468782 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62420f85-b48a-43fc-afb8-f4ad960609b8 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:05.469798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62420f85-b48a-43fc-afb8-f4ad960609b8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:05.470308 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62420f85-b48a-43fc-afb8-f4ad960609b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:05.489726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:05.564298 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-62420f85-b48a-43fc-afb8-f4ad960609b8 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:05.568900 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-62420f85-b48a-43fc-afb8-f4ad960609b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:05.571621 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a30119c-1e58-441d-9483-0115cd84c4d9 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:05.771214 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc1f49-c215-4a79-81e6-87c0bdf7273b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:05.771935 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc1f49-c215-4a79-81e6-87c0bdf7273b admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:05.772246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc1f49-c215-4a79-81e6-87c0bdf7273b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:05.772530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afc1f49-c215-4a79-81e6-87c0bdf7273b admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:05.773242 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc1f49-c215-4a79-81e6-87c0bdf7273b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:05.774781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 821/1653] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:05.776243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62420f85-b48a-43fc-afb8-f4ad960609b8 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:05.781903 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-62420f85-b48a-43fc-afb8-f4ad960609b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:05.783471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afc1f49-c215-4a79-81e6-87c0bdf7273b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:05.833454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62420f85-b48a-43fc-afb8-f4ad960609b8 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:05.853618 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78682ba5-3ae8-487d-8bf9-d8f681ffa89d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:05.863779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78682ba5-3ae8-487d-8bf9-d8f681ffa89d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:05.864241 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78682ba5-3ae8-487d-8bf9-d8f681ffa89d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:05.865801 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78682ba5-3ae8-487d-8bf9-d8f681ffa89d admin admin] PATH_INFO: `/v3/users/ff96a544058640e19e60c5f51895e95f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:05.868331 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78682ba5-3ae8-487d-8bf9-d8f681ffa89d admin admin] RBAC: Authorizing `identity:delete_user(user_id=ff96a544058640e19e60c5f51895e95f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:05.872221 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78682ba5-3ae8-487d-8bf9-d8f681ffa89d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:05.916050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 833/1654] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:05 2022] POST /identity/v3/users => generated 302 bytes in 560 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:05.917030 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc1f49-c215-4a79-81e6-87c0bdf7273b admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:05.923379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9afc1f49-c215-4a79-81e6-87c0bdf7273b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:06.064565 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afc1f49-c215-4a79-81e6-87c0bdf7273b admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:06.078667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e62d67-1af9-4ec5-8554-c16c426ed5bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:06.084680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e62d67-1af9-4ec5-8554-c16c426ed5bd service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:06.084680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e62d67-1af9-4ec5-8554-c16c426ed5bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:06.084680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e62d67-1af9-4ec5-8554-c16c426ed5bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:06.105259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e62d67-1af9-4ec5-8554-c16c426ed5bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:06.108169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e62d67-1af9-4ec5-8554-c16c426ed5bd service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:06.111367 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:06.138294 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-78682ba5-3ae8-487d-8bf9-d8f681ffa89d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ff96a544058640e19e60c5f51895e95f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:06.142316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 834/1655] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:06.143883 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e62d67-1af9-4ec5-8554-c16c426ed5bd service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:06.157804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e62d67-1af9-4ec5-8554-c16c426ed5bd service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:06.164920 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066e82a-ef8e-425f-b21a-a28ca98a707d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:06.166182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066e82a-ef8e-425f-b21a-a28ca98a707d admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:06.166611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066e82a-ef8e-425f-b21a-a28ca98a707d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:06.167293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066e82a-ef8e-425f-b21a-a28ca98a707d admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:06.168611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066e82a-ef8e-425f-b21a-a28ca98a707d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:06.171049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-78682ba5-3ae8-487d-8bf9-d8f681ffa89d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ff96a544058640e19e60c5f51895e95f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:06.173154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-78682ba5-3ae8-487d-8bf9-d8f681ffa89d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ff96a544058640e19e60c5f51895e95f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:06.176350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066e82a-ef8e-425f-b21a-a28ca98a707d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:06.182289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-78682ba5-3ae8-487d-8bf9-d8f681ffa89d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ff96a544058640e19e60c5f51895e95f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:06.197131 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-78682ba5-3ae8-487d-8bf9-d8f681ffa89d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ff96a544058640e19e60c5f51895e95f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:06.228065 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 835/1656] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:06.237328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066e82a-ef8e-425f-b21a-a28ca98a707d admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:06.240747 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6066e82a-ef8e-425f-b21a-a28ca98a707d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:06.276345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066e82a-ef8e-425f-b21a-a28ca98a707d admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:06.290042 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb271c9-6448-4d7d-a0e3-4b829d7bf1f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:06.296571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb271c9-6448-4d7d-a0e3-4b829d7bf1f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:06.296571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb271c9-6448-4d7d-a0e3-4b829d7bf1f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:06.296571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb271c9-6448-4d7d-a0e3-4b829d7bf1f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:06.296571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb271c9-6448-4d7d-a0e3-4b829d7bf1f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:06.296571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdb271c9-6448-4d7d-a0e3-4b829d7bf1f0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:06.315528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 836/1657] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:06 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:37:06.319861 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb271c9-6448-4d7d-a0e3-4b829d7bf1f0 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:06.329184 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 822/1658] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:05 2022] DELETE /identity/v3/users/ff96a544058640e19e60c5f51895e95f => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:06.334777 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787b4ef-4177-4a21-a3ac-eb562e128341 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:06.335104 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787b4ef-4177-4a21-a3ac-eb562e128341 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:06.335389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8787b4ef-4177-4a21-a3ac-eb562e128341 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:06.359547 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb271c9-6448-4d7d-a0e3-4b829d7bf1f0 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:06.423875 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8787b4ef-4177-4a21-a3ac-eb562e128341 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:06.429462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8787b4ef-4177-4a21-a3ac-eb562e128341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:06.565931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 823/1659] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:06.573900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609ffce9-a179-46de-9642-53a5aa71451f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:06.576519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ffce9-a179-46de-9642-53a5aa71451f admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:06.577867 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ffce9-a179-46de-9642-53a5aa71451f admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:06.578164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609ffce9-a179-46de-9642-53a5aa71451f admin admin] PATH_INFO: `/v3/projects/0afd46ec8864438d92a80796f0b5d8b9/users/c402c2f851fa47258e01fb2cc6aa59c8/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:06.585674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787b4ef-4177-4a21-a3ac-eb562e128341 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:06.587437 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8787b4ef-4177-4a21-a3ac-eb562e128341 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:06.644749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ffce9-a179-46de-9642-53a5aa71451f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0afd46ec8864438d92a80796f0b5d8b9, user_id=c402c2f851fa47258e01fb2cc6aa59c8, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:06.647760 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609ffce9-a179-46de-9642-53a5aa71451f admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:06.714018 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8787b4ef-4177-4a21-a3ac-eb562e128341 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:06.725299 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987e32f-964b-41be-9088-8546e620d1ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:06.726135 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987e32f-964b-41be-9088-8546e620d1ef service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:06.728478 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987e32f-964b-41be-9088-8546e620d1ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:06.728829 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5987e32f-964b-41be-9088-8546e620d1ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:06.743017 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 837/1660] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:06 2022] PUT /identity/v3/projects/0afd46ec8864438d92a80796f0b5d8b9/users/c402c2f851fa47258e01fb2cc6aa59c8/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:06.754282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00b51f-e11b-4138-985f-35a23bddcfd2 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:06.755050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00b51f-e11b-4138-985f-35a23bddcfd2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:06.755292 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa00b51f-e11b-4138-985f-35a23bddcfd2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:06.780085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987e32f-964b-41be-9088-8546e620d1ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:06.793030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5987e32f-964b-41be-9088-8546e620d1ef service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:06.849963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 824/1661] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:06.869894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-aa00b51f-e11b-4138-985f-35a23bddcfd2 None None] MFA Rules not processed for user `c402c2f851fa47258e01fb2cc6aa59c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:06.874134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-aa00b51f-e11b-4138-985f-35a23bddcfd2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:07.078345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 838/1662] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:06 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:37:07.083079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987e32f-964b-41be-9088-8546e620d1ef service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:07.100536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5987e32f-964b-41be-9088-8546e620d1ef service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:07.256567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d1bb2-8aa1-4e4c-a12f-bbf524c11ca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:07.257378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d1bb2-8aa1-4e4c-a12f-bbf524c11ca1 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:07.257787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d1bb2-8aa1-4e4c-a12f-bbf524c11ca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:07.258188 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767d1bb2-8aa1-4e4c-a12f-bbf524c11ca1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:07.259046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d1bb2-8aa1-4e4c-a12f-bbf524c11ca1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:07.261273 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767d1bb2-8aa1-4e4c-a12f-bbf524c11ca1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:07.403952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 825/1663] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:07 2022] POST /identity/v3/projects => generated 405 bytes in 321 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:07.408208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00b51f-e11b-4138-985f-35a23bddcfd2 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:07.426877 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa00b51f-e11b-4138-985f-35a23bddcfd2 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:07.564746 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb03d47-c046-489e-835a-bc0e5b56d51d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:07.576490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb03d47-c046-489e-835a-bc0e5b56d51d admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:07.578472 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb03d47-c046-489e-835a-bc0e5b56d51d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:07.579257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb03d47-c046-489e-835a-bc0e5b56d51d admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:07.581472 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb03d47-c046-489e-835a-bc0e5b56d51d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:07.585694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb03d47-c046-489e-835a-bc0e5b56d51d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:07.676048 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d1bb2-8aa1-4e4c-a12f-bbf524c11ca1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:07.678206 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-767d1bb2-8aa1-4e4c-a12f-bbf524c11ca1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:07.696280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767d1bb2-8aa1-4e4c-a12f-bbf524c11ca1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:07.703692 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dee0b-6684-46c1-b021-cfb25f4e465e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:07.704826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dee0b-6684-46c1-b021-cfb25f4e465e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:07.705246 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dee0b-6684-46c1-b021-cfb25f4e465e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:07.736303 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 839/1664] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:07 2022] POST /identity/v3/users => generated 309 bytes in 328 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:07.736480 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869dee0b-6684-46c1-b021-cfb25f4e465e admin admin] PATH_INFO: `/v3/projects/f5ba4e518b2d4cd29a3853b02aad8c82` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:07.740136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb03d47-c046-489e-835a-bc0e5b56d51d admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:07.743381 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869dee0b-6684-46c1-b021-cfb25f4e465e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5ba4e518b2d4cd29a3853b02aad8c82)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:07.754927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: WARNING py.warnings [None req-869dee0b-6684-46c1-b021-cfb25f4e465e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:37:07.754927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: warnings.warn(msg) Jul 15 19:37:07.754927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: Jul 15 19:37:07.754927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869dee0b-6684-46c1-b021-cfb25f4e465e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:07.774451 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb03d47-c046-489e-835a-bc0e5b56d51d admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:07.784460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b074c8-e302-4335-9b88-5a4945afa503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:07.785220 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b074c8-e302-4335-9b88-5a4945afa503 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:07.786151 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b074c8-e302-4335-9b88-5a4945afa503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:07.786594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b074c8-e302-4335-9b88-5a4945afa503 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:07.789092 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b074c8-e302-4335-9b88-5a4945afa503 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:07.790706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b074c8-e302-4335-9b88-5a4945afa503 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:07.816252 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 840/1665] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:07.817758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb5df-6673-428f-96d0-09b3e53b5d52 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:07.821070 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb5df-6673-428f-96d0-09b3e53b5d52 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:07.824566 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeeb5df-6673-428f-96d0-09b3e53b5d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:07.862554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-daeeb5df-6673-428f-96d0-09b3e53b5d52 None None] MFA Rules not processed for user `7a57f2b2c3a041f48290f7441cffe5b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:07.864082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-daeeb5df-6673-428f-96d0-09b3e53b5d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:08.008944 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-869dee0b-6684-46c1-b021-cfb25f4e465e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5ba4e518b2d4cd29a3853b02aad8c82', 'request_id': 'req-869dee0b-6684-46c1-b021-cfb25f4e465e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:08.033300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 841/1666] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:08.034603 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeb5df-6673-428f-96d0-09b3e53b5d52 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:08.048793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-869dee0b-6684-46c1-b021-cfb25f4e465e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5ba4e518b2d4cd29a3853b02aad8c82', 'request_id': 'req-869dee0b-6684-46c1-b021-cfb25f4e465e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:08.058741 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeeb5df-6673-428f-96d0-09b3e53b5d52 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:08.059463 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-869dee0b-6684-46c1-b021-cfb25f4e465e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5ba4e518b2d4cd29a3853b02aad8c82', 'request_id': 'req-869dee0b-6684-46c1-b021-cfb25f4e465e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:08.150127 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-869dee0b-6684-46c1-b021-cfb25f4e465e admin admin] The token cache is being invalidate because project f5ba4e518b2d4cd29a3853b02aad8c82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:08.150127 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-869dee0b-6684-46c1-b021-cfb25f4e465e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:08.150127 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-869dee0b-6684-46c1-b021-cfb25f4e465e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:08.153706 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 826/1667] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:07 2022] DELETE /identity/v3/projects/f5ba4e518b2d4cd29a3853b02aad8c82 => generated 0 bytes in 475 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:37:08.153706 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dee0b-6684-46c1-b021-cfb25f4e465e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:08.158348 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-869dee0b-6684-46c1-b021-cfb25f4e465e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:08.191747 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4dbb0e-c91d-4cd5-bf67-3d28e3dc1040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:08.194693 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dbb0e-c91d-4cd5-bf67-3d28e3dc1040 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:08.195270 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dbb0e-c91d-4cd5-bf67-3d28e3dc1040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:08.196186 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4dbb0e-c91d-4cd5-bf67-3d28e3dc1040 admin admin] PATH_INFO: `/v3/projects/7eb768b63cba4fd383e009e8ac4df726/users/6e4b5392804f468a92b66b6a10e2c917/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:08.222209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:08.238087 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dbb0e-c91d-4cd5-bf67-3d28e3dc1040 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb768b63cba4fd383e009e8ac4df726, user_id=6e4b5392804f468a92b66b6a10e2c917, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:08.246057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4dbb0e-c91d-4cd5-bf67-3d28e3dc1040 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:08.263446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869dee0b-6684-46c1-b021-cfb25f4e465e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:08.268514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e904ddf-2013-41d7-a045-9bc30243e5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:08.271790 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e904ddf-2013-41d7-a045-9bc30243e5ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:08.271790 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e904ddf-2013-41d7-a045-9bc30243e5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:08.271790 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e904ddf-2013-41d7-a045-9bc30243e5ae admin admin] PATH_INFO: `/v3/users/bcc210a20d2e44248ff4170aaf3b37d4` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:08.271790 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e904ddf-2013-41d7-a045-9bc30243e5ae admin admin] RBAC: Authorizing `identity:delete_user(user_id=bcc210a20d2e44248ff4170aaf3b37d4)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:08.273568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e904ddf-2013-41d7-a045-9bc30243e5ae admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:08.280521 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:08.355396 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 842/1668] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:08 2022] PUT /identity/v3/projects/7eb768b63cba4fd383e009e8ac4df726/users/6e4b5392804f468a92b66b6a10e2c917/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:08.357401 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91dcd9-4cf2-495a-90b9-9e609ea95b6f None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:08.359247 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91dcd9-4cf2-495a-90b9-9e609ea95b6f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:08.363022 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e91dcd9-4cf2-495a-90b9-9e609ea95b6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:08.394281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-9e91dcd9-4cf2-495a-90b9-9e609ea95b6f None None] MFA Rules not processed for user `7a57f2b2c3a041f48290f7441cffe5b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:08.395739 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9e91dcd9-4cf2-495a-90b9-9e609ea95b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:08.480894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 843/1669] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:08 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:08.482168 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91dcd9-4cf2-495a-90b9-9e609ea95b6f None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:08.484896 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9e91dcd9-4cf2-495a-90b9-9e609ea95b6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:08.576193 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5e904ddf-2013-41d7-a045-9bc30243e5ae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bcc210a20d2e44248ff4170aaf3b37d4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:08.621027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5e904ddf-2013-41d7-a045-9bc30243e5ae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bcc210a20d2e44248ff4170aaf3b37d4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:08.625053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5e904ddf-2013-41d7-a045-9bc30243e5ae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bcc210a20d2e44248ff4170aaf3b37d4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:08.627371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5e904ddf-2013-41d7-a045-9bc30243e5ae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bcc210a20d2e44248ff4170aaf3b37d4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:08.637020 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e91dcd9-4cf2-495a-90b9-9e609ea95b6f None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:08.653469 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab0964-fe9f-429e-b062-6a6587b000ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:08.662622 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0964-fe9f-429e-b062-6a6587b000ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:08.662622 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0964-fe9f-429e-b062-6a6587b000ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:08.662622 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ab0964-fe9f-429e-b062-6a6587b000ad admin admin] PATH_INFO: `/v3/users/3efe6920bba0463188b991b6dba42295` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:08.662622 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab0964-fe9f-429e-b062-6a6587b000ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=3efe6920bba0463188b991b6dba42295)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:08.663017 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5e904ddf-2013-41d7-a045-9bc30243e5ae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bcc210a20d2e44248ff4170aaf3b37d4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:08.663112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: WARNING py.warnings [None req-68ab0964-fe9f-429e-b062-6a6587b000ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 15 19:37:08.663112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: warnings.warn(msg) Jul 15 19:37:08.663112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: Jul 15 19:37:08.663112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ab0964-fe9f-429e-b062-6a6587b000ad admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:08.747467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 827/1670] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:08 2022] DELETE /identity/v3/users/bcc210a20d2e44248ff4170aaf3b37d4 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:08.747467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e904ddf-2013-41d7-a045-9bc30243e5ae admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:08.750288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5e904ddf-2013-41d7-a045-9bc30243e5ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:08.889813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e904ddf-2013-41d7-a045-9bc30243e5ae admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:08.910299 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b610d46-8f26-4f27-bf42-ccfb813e5528 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:08.911001 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b610d46-8f26-4f27-bf42-ccfb813e5528 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:08.912834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b610d46-8f26-4f27-bf42-ccfb813e5528 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:08.914949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b610d46-8f26-4f27-bf42-ccfb813e5528 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:08.915892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b610d46-8f26-4f27-bf42-ccfb813e5528 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:08.932732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b610d46-8f26-4f27-bf42-ccfb813e5528 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:08.932807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-68ab0964-fe9f-429e-b062-6a6587b000ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3efe6920bba0463188b991b6dba42295'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:08.932807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-68ab0964-fe9f-429e-b062-6a6587b000ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3efe6920bba0463188b991b6dba42295'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:08.947064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 828/1671] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:08.948242 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b610d46-8f26-4f27-bf42-ccfb813e5528 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:08.960970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8b610d46-8f26-4f27-bf42-ccfb813e5528 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:08.990351 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b610d46-8f26-4f27-bf42-ccfb813e5528 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:09.000288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40223e4a-a681-43bb-b3ca-dc51f49a20a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:09.002285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40223e4a-a681-43bb-b3ca-dc51f49a20a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:09.002285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40223e4a-a681-43bb-b3ca-dc51f49a20a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:09.002285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40223e4a-a681-43bb-b3ca-dc51f49a20a1 admin admin] PATH_INFO: `/v3/projects/6dfddfd1838d455c96977c2115f6963a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:09.004142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40223e4a-a681-43bb-b3ca-dc51f49a20a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6dfddfd1838d455c96977c2115f6963a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:09.007473 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40223e4a-a681-43bb-b3ca-dc51f49a20a1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:09.032192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-68ab0964-fe9f-429e-b062-6a6587b000ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3efe6920bba0463188b991b6dba42295'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:09.034056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-68ab0964-fe9f-429e-b062-6a6587b000ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3efe6920bba0463188b991b6dba42295'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:09.109839 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-68ab0964-fe9f-429e-b062-6a6587b000ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3efe6920bba0463188b991b6dba42295'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:09.159577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 844/1672] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:08 2022] DELETE /identity/v3/users/3efe6920bba0463188b991b6dba42295 => generated 0 bytes in 675 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:09.159577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab0964-fe9f-429e-b062-6a6587b000ad admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:09.164750 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-68ab0964-fe9f-429e-b062-6a6587b000ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:09.265543 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-40223e4a-a681-43bb-b3ca-dc51f49a20a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6dfddfd1838d455c96977c2115f6963a', 'request_id': 'req-40223e4a-a681-43bb-b3ca-dc51f49a20a1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:09.292133 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-40223e4a-a681-43bb-b3ca-dc51f49a20a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6dfddfd1838d455c96977c2115f6963a', 'request_id': 'req-40223e4a-a681-43bb-b3ca-dc51f49a20a1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:09.306121 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-40223e4a-a681-43bb-b3ca-dc51f49a20a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6dfddfd1838d455c96977c2115f6963a', 'request_id': 'req-40223e4a-a681-43bb-b3ca-dc51f49a20a1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:09.354340 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ab0964-fe9f-429e-b062-6a6587b000ad admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:09.458726 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-40223e4a-a681-43bb-b3ca-dc51f49a20a1 admin admin] The token cache is being invalidate because project 6dfddfd1838d455c96977c2115f6963a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:09.459078 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-40223e4a-a681-43bb-b3ca-dc51f49a20a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:09.460150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-40223e4a-a681-43bb-b3ca-dc51f49a20a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:09.462262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 829/1673] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:08 2022] DELETE /identity/v3/projects/6dfddfd1838d455c96977c2115f6963a => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:09.476839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec85cd-4c80-4929-98e5-d43b36d17ada None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:09.478762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec85cd-4c80-4929-98e5-d43b36d17ada None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:09.479046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fec85cd-4c80-4929-98e5-d43b36d17ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:09.541039 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b823d-4726-4900-bbad-b3fafa09538b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:09.543138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b823d-4726-4900-bbad-b3fafa09538b service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:09.543636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b823d-4726-4900-bbad-b3fafa09538b service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:09.547639 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6fec85cd-4c80-4929-98e5-d43b36d17ada None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:09.547763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4b823d-4726-4900-bbad-b3fafa09538b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:09.550610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3f4b823d-4726-4900-bbad-b3fafa09538b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:09.551590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6fec85cd-4c80-4929-98e5-d43b36d17ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:09.676169 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 830/1674] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:09.677834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec85cd-4c80-4929-98e5-d43b36d17ada None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:09.679485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6fec85cd-4c80-4929-98e5-d43b36d17ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:09.702856 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fec85cd-4c80-4929-98e5-d43b36d17ada None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:09.706742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b823d-4726-4900-bbad-b3fafa09538b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:09.708523 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4b823d-4726-4900-bbad-b3fafa09538b service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:09.710189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8ab6b52-9d6a-4bdf-b02c-7f7c0c6ae4fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:09.711177 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab6b52-9d6a-4bdf-b02c-7f7c0c6ae4fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:09.711466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab6b52-9d6a-4bdf-b02c-7f7c0c6ae4fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:09.713233 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8ab6b52-9d6a-4bdf-b02c-7f7c0c6ae4fe admin admin] PATH_INFO: `/v3/projects/7eb768b63cba4fd383e009e8ac4df726/users/6e4b5392804f468a92b66b6a10e2c917/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:09.714625 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab6b52-9d6a-4bdf-b02c-7f7c0c6ae4fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb768b63cba4fd383e009e8ac4df726, user_id=6e4b5392804f468a92b66b6a10e2c917, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:09.720032 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8ab6b52-9d6a-4bdf-b02c-7f7c0c6ae4fe admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:09.735769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 831/1675] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:09 2022] PUT /identity/v3/projects/7eb768b63cba4fd383e009e8ac4df726/users/6e4b5392804f468a92b66b6a10e2c917/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:09.736492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 845/1676] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:09 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 579 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:09.737504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ab0f3-16ed-40b6-b373-754ae18e1f6e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:09.737981 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ab0f3-16ed-40b6-b373-754ae18e1f6e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:09.738090 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b823d-4726-4900-bbad-b3fafa09538b service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:09.738264 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-765ab0f3-16ed-40b6-b373-754ae18e1f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:09.744666 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3f4b823d-4726-4900-bbad-b3fafa09538b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:09.769964 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-765ab0f3-16ed-40b6-b373-754ae18e1f6e None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:09.772404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-765ab0f3-16ed-40b6-b373-754ae18e1f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:09.773723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:09.864971 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4b823d-4726-4900-bbad-b3fafa09538b service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:09.892714 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 832/1677] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:09.894022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f0215-af4a-4291-80b7-21743af57703 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:09.894411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f0215-af4a-4291-80b7-21743af57703 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:09.899178 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca4f0215-af4a-4291-80b7-21743af57703 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:09.945946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da2bb9e-6b11-4a30-b545-45988de43e65 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:09.946719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2bb9e-6b11-4a30-b545-45988de43e65 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:09.947531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2bb9e-6b11-4a30-b545-45988de43e65 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:09.947888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da2bb9e-6b11-4a30-b545-45988de43e65 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:09.960629 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ca4f0215-af4a-4291-80b7-21743af57703 None None] MFA Rules not processed for user `6e4b5392804f468a92b66b6a10e2c917`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:09.964572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ca4f0215-af4a-4291-80b7-21743af57703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:09.964721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2bb9e-6b11-4a30-b545-45988de43e65 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:09.965512 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da2bb9e-6b11-4a30-b545-45988de43e65 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:09.994321 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 846/1678] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:09.995796 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee828a5-7605-4671-b368-846b7f61d0b7 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:09.998179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee828a5-7605-4671-b368-846b7f61d0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:09.999515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee828a5-7605-4671-b368-846b7f61d0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:10.085737 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-9ee828a5-7605-4671-b368-846b7f61d0b7 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:10.086786 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 833/1679] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:09 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:10.087282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9ee828a5-7605-4671-b368-846b7f61d0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:10.099097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f0215-af4a-4291-80b7-21743af57703 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:10.101650 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ca4f0215-af4a-4291-80b7-21743af57703 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:10.111865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 847/1680] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:10.115614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee828a5-7605-4671-b368-846b7f61d0b7 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:10.142369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee828a5-7605-4671-b368-846b7f61d0b7 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:10.154167 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936e956-fbb6-4510-b1dd-a8a6b5b965d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:10.160608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936e956-fbb6-4510-b1dd-a8a6b5b965d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:10.160608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936e956-fbb6-4510-b1dd-a8a6b5b965d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:10.160608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0936e956-fbb6-4510-b1dd-a8a6b5b965d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:10.160608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936e956-fbb6-4510-b1dd-a8a6b5b965d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:37:10.160608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936e956-fbb6-4510-b1dd-a8a6b5b965d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:10.165649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0936e956-fbb6-4510-b1dd-a8a6b5b965d2 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:10.195762 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 848/1681] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:37:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:37:10.201939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936e956-fbb6-4510-b1dd-a8a6b5b965d2 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:10.224672 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0936e956-fbb6-4510-b1dd-a8a6b5b965d2 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:10.239482 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b20334-655d-44ce-8cb7-b9255b709cfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:10.240161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b20334-655d-44ce-8cb7-b9255b709cfb admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:10.240444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b20334-655d-44ce-8cb7-b9255b709cfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:10.240725 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b20334-655d-44ce-8cb7-b9255b709cfb admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:10.241427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b20334-655d-44ce-8cb7-b9255b709cfb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:10.243440 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b20334-655d-44ce-8cb7-b9255b709cfb admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:10.256245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca4f0215-af4a-4291-80b7-21743af57703 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:10.269197 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b8313-0d1b-4426-9efa-0cbaca4b5f1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:10.269881 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b8313-0d1b-4426-9efa-0cbaca4b5f1a service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:10.270142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b8313-0d1b-4426-9efa-0cbaca4b5f1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:10.270420 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4b8313-0d1b-4426-9efa-0cbaca4b5f1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:10.298572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b8313-0d1b-4426-9efa-0cbaca4b5f1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:10.302716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4b8313-0d1b-4426-9efa-0cbaca4b5f1a service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:10.321038 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 834/1682] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:10 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:10.469573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 849/1683] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:10 2022] POST /identity/v3/projects => generated 381 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:10.474443 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b8313-0d1b-4426-9efa-0cbaca4b5f1a service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:10.524449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4b8313-0d1b-4426-9efa-0cbaca4b5f1a service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:10.626408 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f31bfe-53bd-4cc6-8a0b-db63e0067724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:10.628006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31bfe-53bd-4cc6-8a0b-db63e0067724 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:10.628716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31bfe-53bd-4cc6-8a0b-db63e0067724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:10.629318 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f31bfe-53bd-4cc6-8a0b-db63e0067724 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:10.630322 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f31bfe-53bd-4cc6-8a0b-db63e0067724 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:10.633402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f31bfe-53bd-4cc6-8a0b-db63e0067724 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:10.683136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b20334-655d-44ce-8cb7-b9255b709cfb admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:10.709179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b20334-655d-44ce-8cb7-b9255b709cfb admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:10.722650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54afb184-2e5a-4324-8ad1-6feb48002e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:10.723687 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afb184-2e5a-4324-8ad1-6feb48002e06 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:10.723966 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afb184-2e5a-4324-8ad1-6feb48002e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:10.724236 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54afb184-2e5a-4324-8ad1-6feb48002e06 admin admin] PATH_INFO: `/v3/users/c402c2f851fa47258e01fb2cc6aa59c8` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:10.742390 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:10.756420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afb184-2e5a-4324-8ad1-6feb48002e06 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c402c2f851fa47258e01fb2cc6aa59c8)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:10.762602 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 835/1684] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:10 2022] POST /identity/v3/users => generated 291 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:10.762602 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f31bfe-53bd-4cc6-8a0b-db63e0067724 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:10.763691 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54afb184-2e5a-4324-8ad1-6feb48002e06 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:10.766671 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-09f31bfe-53bd-4cc6-8a0b-db63e0067724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:10.810431 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f31bfe-53bd-4cc6-8a0b-db63e0067724 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:10.817703 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:10.819504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:10.819924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:10.820315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8 admin admin] PATH_INFO: `/v3/projects/0a731a3a09e346ca852f50f447bad08c` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:10.821920 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a731a3a09e346ca852f50f447bad08c)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:10.824572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:11.078061 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a731a3a09e346ca852f50f447bad08c', 'request_id': 'req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:11.084750 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-54afb184-2e5a-4324-8ad1-6feb48002e06 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c402c2f851fa47258e01fb2cc6aa59c8'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:11.088195 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-54afb184-2e5a-4324-8ad1-6feb48002e06 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c402c2f851fa47258e01fb2cc6aa59c8'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:11.088362 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a731a3a09e346ca852f50f447bad08c', 'request_id': 'req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:11.098579 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a731a3a09e346ca852f50f447bad08c', 'request_id': 'req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:11.147284 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:11.178660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8 admin admin] The token cache is being invalidate because project 0a731a3a09e346ca852f50f447bad08c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:11.178993 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:11.180189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:11.183200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 836/1685] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:10 2022] DELETE /identity/v3/projects/0a731a3a09e346ca852f50f447bad08c => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:11.188525 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:11.190870 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:11.293907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-54afb184-2e5a-4324-8ad1-6feb48002e06 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c402c2f851fa47258e01fb2cc6aa59c8'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:11.294956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-54afb184-2e5a-4324-8ad1-6feb48002e06 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c402c2f851fa47258e01fb2cc6aa59c8'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:11.322921 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-54afb184-2e5a-4324-8ad1-6feb48002e06 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c402c2f851fa47258e01fb2cc6aa59c8'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:11.351052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 850/1686] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:10 2022] DELETE /identity/v3/users/c402c2f851fa47258e01fb2cc6aa59c8 => generated 0 bytes in 666 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:11.351052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea499c9-d3cd-421c-a8d8-c8d34dfdd941 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:11.351670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea499c9-d3cd-421c-a8d8-c8d34dfdd941 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:11.351964 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea499c9-d3cd-421c-a8d8-c8d34dfdd941 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:11.354443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 851/1687] 10.222.0.40 () {54 vars in 912 bytes} [Fri Jul 15 19:37:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:37:11.367283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c2ff7bb-d16d-40c1-ac06-c08f9b1411b8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:11.367759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd84e6-0233-4683-97d6-44985b220850 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:11.367759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd84e6-0233-4683-97d6-44985b220850 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:11.367759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cd84e6-0233-4683-97d6-44985b220850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:11.402895 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-00cd84e6-0233-4683-97d6-44985b220850 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:11.406069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-00cd84e6-0233-4683-97d6-44985b220850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:11.535927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c13b89-935e-4936-a437-db793112ce8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:11.536629 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c13b89-935e-4936-a437-db793112ce8a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:11.536909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c13b89-935e-4936-a437-db793112ce8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:11.540093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c13b89-935e-4936-a437-db793112ce8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:11.541029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c13b89-935e-4936-a437-db793112ce8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:11.544990 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c13b89-935e-4936-a437-db793112ce8a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:11.563114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 837/1688] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:11.563312 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573ccc0-d90a-469f-8f99-958435cf1fa2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:11.563620 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573ccc0-d90a-469f-8f99-958435cf1fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:11.564247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573ccc0-d90a-469f-8f99-958435cf1fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:11.593962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 852/1689] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:11.601645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b615c55-4255-40b4-9970-724c730b356c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:11.601645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b615c55-4255-40b4-9970-724c730b356c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:11.601645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b615c55-4255-40b4-9970-724c730b356c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:11.624754 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c573ccc0-d90a-469f-8f99-958435cf1fa2 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:11.626314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c573ccc0-d90a-469f-8f99-958435cf1fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:11.649409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 838/1690] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:11.652852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573ccc0-d90a-469f-8f99-958435cf1fa2 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:11.700458 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573ccc0-d90a-469f-8f99-958435cf1fa2 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:11.702833 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-4b615c55-4255-40b4-9970-724c730b356c None None] MFA Rules not processed for user `c99418232a0848a1b7a1a73966928769`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:11.704211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4b615c55-4255-40b4-9970-724c730b356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:11.715638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6460656d-ce45-4d64-8826-029cd42663f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:11.716789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460656d-ce45-4d64-8826-029cd42663f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:11.718008 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460656d-ce45-4d64-8826-029cd42663f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:11.719238 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6460656d-ce45-4d64-8826-029cd42663f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:11.719875 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460656d-ce45-4d64-8826-029cd42663f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:11.724310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6460656d-ce45-4d64-8826-029cd42663f8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:11.746208 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 839/1691] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:11 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:11.748699 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63944301-f8ca-434d-90d0-45923463c198 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:11.750092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63944301-f8ca-434d-90d0-45923463c198 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:11.751279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63944301-f8ca-434d-90d0-45923463c198 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:11.787384 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-63944301-f8ca-434d-90d0-45923463c198 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:11.788716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-63944301-f8ca-434d-90d0-45923463c198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:11.813969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 840/1692] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:11.814939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63944301-f8ca-434d-90d0-45923463c198 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:11.815624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 853/1693] 10.222.0.40 () {58 vars in 1009 bytes} [Fri Jul 15 19:37:11 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:11.816519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b615c55-4255-40b4-9970-724c730b356c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:11.817954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-63944301-f8ca-434d-90d0-45923463c198 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:11.823836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4b615c55-4255-40b4-9970-724c730b356c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:11.848891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b615c55-4255-40b4-9970-724c730b356c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:11.852926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63944301-f8ca-434d-90d0-45923463c198 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:11.857998 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdda182-d485-47f1-9bee-2d6a41b8e4cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:11.858731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdda182-d485-47f1-9bee-2d6a41b8e4cb service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:11.859207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdda182-d485-47f1-9bee-2d6a41b8e4cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:11.859494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdda182-d485-47f1-9bee-2d6a41b8e4cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:11.869822 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0ebec-2a9a-4691-8335-ce1f169566cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:11.870863 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0ebec-2a9a-4691-8335-ce1f169566cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:11.871133 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0ebec-2a9a-4691-8335-ce1f169566cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:11.871410 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da0ebec-2a9a-4691-8335-ce1f169566cf admin admin] PATH_INFO: `/v3/projects/9531f20efcb147ffafbe82dbae163696` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:11.874141 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0ebec-2a9a-4691-8335-ce1f169566cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=9531f20efcb147ffafbe82dbae163696)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:11.877010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da0ebec-2a9a-4691-8335-ce1f169566cf admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:11.890926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdda182-d485-47f1-9bee-2d6a41b8e4cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:11.892135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bdda182-d485-47f1-9bee-2d6a41b8e4cb service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:11.939334 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 854/1694] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:11.940356 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdda182-d485-47f1-9bee-2d6a41b8e4cb service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:11.964634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdda182-d485-47f1-9bee-2d6a41b8e4cb service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:11.979126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f0d85-697a-4acb-8506-8134a7c1f9fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:11.980550 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f0d85-697a-4acb-8506-8134a7c1f9fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:11.980850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f0d85-697a-4acb-8506-8134a7c1f9fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:11.981099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9f0d85-697a-4acb-8506-8134a7c1f9fa admin admin] PATH_INFO: `/v3/projects/c2a278c318634c4385e754073f222058/users/abb28b54349b42409831f0c78c05975a/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:12.017725 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f0d85-697a-4acb-8506-8134a7c1f9fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2a278c318634c4385e754073f222058, user_id=abb28b54349b42409831f0c78c05975a, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:12.021840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9f0d85-697a-4acb-8506-8134a7c1f9fa admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:12.196484 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 855/1695] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:11 2022] PUT /identity/v3/projects/c2a278c318634c4385e754073f222058/users/abb28b54349b42409831f0c78c05975a/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:12.197571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f0d85-697a-4acb-8506-8134a7c1f9fa admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:12.215381 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0da0ebec-2a9a-4691-8335-ce1f169566cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9531f20efcb147ffafbe82dbae163696', 'request_id': 'req-0da0ebec-2a9a-4691-8335-ce1f169566cf'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:12.225300 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0da0ebec-2a9a-4691-8335-ce1f169566cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9531f20efcb147ffafbe82dbae163696', 'request_id': 'req-0da0ebec-2a9a-4691-8335-ce1f169566cf'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:12.232365 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0da0ebec-2a9a-4691-8335-ce1f169566cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9531f20efcb147ffafbe82dbae163696', 'request_id': 'req-0da0ebec-2a9a-4691-8335-ce1f169566cf'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:12.331255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0da0ebec-2a9a-4691-8335-ce1f169566cf admin admin] The token cache is being invalidate because project 9531f20efcb147ffafbe82dbae163696 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:12.334141 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0da0ebec-2a9a-4691-8335-ce1f169566cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:12.337090 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0da0ebec-2a9a-4691-8335-ce1f169566cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:12.349700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 841/1696] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:11 2022] DELETE /identity/v3/projects/9531f20efcb147ffafbe82dbae163696 => generated 0 bytes in 535 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:12.351140 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0ebec-2a9a-4691-8335-ce1f169566cf admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:12.354297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0da0ebec-2a9a-4691-8335-ce1f169566cf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:12.359258 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:12.427613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9f0d85-697a-4acb-8506-8134a7c1f9fa admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:12.444385 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f8353-3c62-4ccf-bece-43b235d5f154 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:12.445125 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f8353-3c62-4ccf-bece-43b235d5f154 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:12.445360 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f8353-3c62-4ccf-bece-43b235d5f154 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:12.445807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f8353-3c62-4ccf-bece-43b235d5f154 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:12.446833 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f8353-3c62-4ccf-bece-43b235d5f154 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:37:12.447355 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f8353-3c62-4ccf-bece-43b235d5f154 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:12.450720 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f8353-3c62-4ccf-bece-43b235d5f154 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:12.495260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:12.508736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da0ebec-2a9a-4691-8335-ce1f169566cf admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:12.514549 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 856/1697] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:37:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:37:12.522128 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6edc3b-28ad-41f9-bb81-cd805e8c8664 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:12.522781 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6edc3b-28ad-41f9-bb81-cd805e8c8664 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:12.523389 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b6edc3b-28ad-41f9-bb81-cd805e8c8664 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:12.611701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-4b6edc3b-28ad-41f9-bb81-cd805e8c8664 None None] MFA Rules not processed for user `abb28b54349b42409831f0c78c05975a`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:12.613273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4b6edc3b-28ad-41f9-bb81-cd805e8c8664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:12.647964 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e23f9-bc87-4bb9-a30d-12f7003d7723 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:12.649808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e23f9-bc87-4bb9-a30d-12f7003d7723 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:12.650098 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e23f9-bc87-4bb9-a30d-12f7003d7723 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:12.650372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814e23f9-bc87-4bb9-a30d-12f7003d7723 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:12.664063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-814e23f9-bc87-4bb9-a30d-12f7003d7723 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:12.696927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e23f9-bc87-4bb9-a30d-12f7003d7723 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:12.707280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814e23f9-bc87-4bb9-a30d-12f7003d7723 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:12.733442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 842/1698] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:12.735333 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e23f9-bc87-4bb9-a30d-12f7003d7723 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:12.738181 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-814e23f9-bc87-4bb9-a30d-12f7003d7723 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:12.772617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814e23f9-bc87-4bb9-a30d-12f7003d7723 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:12.781619 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75274906-eee2-4d4b-9812-f84b31b6ad1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:12.787536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75274906-eee2-4d4b-9812-f84b31b6ad1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:12.788124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75274906-eee2-4d4b-9812-f84b31b6ad1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:12.788783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75274906-eee2-4d4b-9812-f84b31b6ad1d admin admin] PATH_INFO: `/v3/users/fcb1ee31582240bca2499ac85fe8d454` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:12.792633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75274906-eee2-4d4b-9812-f84b31b6ad1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fcb1ee31582240bca2499ac85fe8d454)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:12.804454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75274906-eee2-4d4b-9812-f84b31b6ad1d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:12.828949 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 857/1699] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:12 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:12.834910 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6edc3b-28ad-41f9-bb81-cd805e8c8664 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:12.838944 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4b6edc3b-28ad-41f9-bb81-cd805e8c8664 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:12.886265 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b6edc3b-28ad-41f9-bb81-cd805e8c8664 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:12.894104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bc541-a30c-4b57-a563-6ad05a37b4aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:12.896657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bc541-a30c-4b57-a563-6ad05a37b4aa admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:12.896657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bc541-a30c-4b57-a563-6ad05a37b4aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:12.897008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882bc541-a30c-4b57-a563-6ad05a37b4aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:12.898012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bc541-a30c-4b57-a563-6ad05a37b4aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:12.900464 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882bc541-a30c-4b57-a563-6ad05a37b4aa admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:13.017886 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 858/1700] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:12 2022] POST /identity/v3/projects => generated 385 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:13.017886 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bc541-a30c-4b57-a563-6ad05a37b4aa admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:13.019430 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-882bc541-a30c-4b57-a563-6ad05a37b4aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:13.105406 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75274906-eee2-4d4b-9812-f84b31b6ad1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fcb1ee31582240bca2499ac85fe8d454'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:13.142583 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75274906-eee2-4d4b-9812-f84b31b6ad1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fcb1ee31582240bca2499ac85fe8d454'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:13.143418 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75274906-eee2-4d4b-9812-f84b31b6ad1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fcb1ee31582240bca2499ac85fe8d454'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:13.147818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75274906-eee2-4d4b-9812-f84b31b6ad1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fcb1ee31582240bca2499ac85fe8d454'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:13.167784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75274906-eee2-4d4b-9812-f84b31b6ad1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fcb1ee31582240bca2499ac85fe8d454'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:13.232693 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882bc541-a30c-4b57-a563-6ad05a37b4aa admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:13.239356 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bcaa9-2a20-4299-9b10-ad2f420c67ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:13.240567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bcaa9-2a20-4299-9b10-ad2f420c67ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:13.240797 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bcaa9-2a20-4299-9b10-ad2f420c67ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:13.241079 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704bcaa9-2a20-4299-9b10-ad2f420c67ca admin admin] PATH_INFO: `/v3/projects/0afd46ec8864438d92a80796f0b5d8b9` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:13.243610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704bcaa9-2a20-4299-9b10-ad2f420c67ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=0afd46ec8864438d92a80796f0b5d8b9)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:13.245623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-704bcaa9-2a20-4299-9b10-ad2f420c67ca admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:13.261315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 843/1701] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:12 2022] DELETE /identity/v3/users/fcb1ee31582240bca2499ac85fe8d454 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:13.261315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75274906-eee2-4d4b-9812-f84b31b6ad1d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:13.263615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-75274906-eee2-4d4b-9812-f84b31b6ad1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:13.359377 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75274906-eee2-4d4b-9812-f84b31b6ad1d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:13.378008 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd3231a1-f4cb-4cd0-9ede-0e1d43c3ec80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:13.386150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3231a1-f4cb-4cd0-9ede-0e1d43c3ec80 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:13.387683 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3231a1-f4cb-4cd0-9ede-0e1d43c3ec80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:13.388270 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd3231a1-f4cb-4cd0-9ede-0e1d43c3ec80 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:13.393288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3231a1-f4cb-4cd0-9ede-0e1d43c3ec80 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:13.397753 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd3231a1-f4cb-4cd0-9ede-0e1d43c3ec80 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:13.406488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-704bcaa9-2a20-4299-9b10-ad2f420c67ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0afd46ec8864438d92a80796f0b5d8b9', 'request_id': 'req-704bcaa9-2a20-4299-9b10-ad2f420c67ca'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:13.584431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-704bcaa9-2a20-4299-9b10-ad2f420c67ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0afd46ec8864438d92a80796f0b5d8b9', 'request_id': 'req-704bcaa9-2a20-4299-9b10-ad2f420c67ca'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:13.601269 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-704bcaa9-2a20-4299-9b10-ad2f420c67ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0afd46ec8864438d92a80796f0b5d8b9', 'request_id': 'req-704bcaa9-2a20-4299-9b10-ad2f420c67ca'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:13.607636 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 844/1702] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:13 2022] POST /identity/v3/projects => generated 379 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:13.611522 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff39f6d-95bd-4aa7-bc5f-929f9dee1bf4 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:13.612156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff39f6d-95bd-4aa7-bc5f-929f9dee1bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:13.612642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff39f6d-95bd-4aa7-bc5f-929f9dee1bf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:13.628346 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-704bcaa9-2a20-4299-9b10-ad2f420c67ca admin admin] The token cache is being invalidate because project 0afd46ec8864438d92a80796f0b5d8b9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:13.628636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-704bcaa9-2a20-4299-9b10-ad2f420c67ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:13.630165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-704bcaa9-2a20-4299-9b10-ad2f420c67ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:13.634629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 859/1703] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:13 2022] DELETE /identity/v3/projects/0afd46ec8864438d92a80796f0b5d8b9 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:13.635562 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bcaa9-2a20-4299-9b10-ad2f420c67ca admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:13.647232 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4ff39f6d-95bd-4aa7-bc5f-929f9dee1bf4 None None] MFA Rules not processed for user `4e504742dcd245e5bee9a4d68a748b92`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:13.647740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-704bcaa9-2a20-4299-9b10-ad2f420c67ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:13.649300 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4ff39f6d-95bd-4aa7-bc5f-929f9dee1bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:13.765046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704bcaa9-2a20-4299-9b10-ad2f420c67ca admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:13.797759 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 845/1704] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:13 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:13.800437 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff39f6d-95bd-4aa7-bc5f-929f9dee1bf4 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:13.802517 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4ff39f6d-95bd-4aa7-bc5f-929f9dee1bf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:13.933259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff39f6d-95bd-4aa7-bc5f-929f9dee1bf4 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:13.941802 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd6df53-6da5-4436-97c3-2d40315745d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:13.943663 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42ecb6-3078-4231-acea-76fa088a29aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:13.945408 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42ecb6-3078-4231-acea-76fa088a29aa admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:13.945840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6df53-6da5-4436-97c3-2d40315745d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:13.946159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6df53-6da5-4436-97c3-2d40315745d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:13.948130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd6df53-6da5-4436-97c3-2d40315745d2 admin admin] PATH_INFO: `/v3/users/d7ed35c9043e485cbc95e9c48a24f570` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:13.948528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42ecb6-3078-4231-acea-76fa088a29aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:13.949369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42ecb6-3078-4231-acea-76fa088a29aa admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:13.952939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42ecb6-3078-4231-acea-76fa088a29aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:13.955528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6df53-6da5-4436-97c3-2d40315745d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7ed35c9043e485cbc95e9c48a24f570)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:13.961498 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd6df53-6da5-4436-97c3-2d40315745d2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:13.962276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42ecb6-3078-4231-acea-76fa088a29aa admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:14.122308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 860/1705] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:13 2022] POST /identity/v3/users => generated 293 bytes in 487 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:14.123760 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42ecb6-3078-4231-acea-76fa088a29aa admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:14.128950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-da42ecb6-3078-4231-acea-76fa088a29aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:14.160862 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42ecb6-3078-4231-acea-76fa088a29aa admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:14.166120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818338f2-345e-4ad8-a8fe-acb92c5c6e11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:14.167029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818338f2-345e-4ad8-a8fe-acb92c5c6e11 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:14.167170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818338f2-345e-4ad8-a8fe-acb92c5c6e11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:14.167411 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-818338f2-345e-4ad8-a8fe-acb92c5c6e11 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:14.168139 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818338f2-345e-4ad8-a8fe-acb92c5c6e11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:14.170990 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-818338f2-345e-4ad8-a8fe-acb92c5c6e11 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:14.236651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:14.255141 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1bd6df53-6da5-4436-97c3-2d40315745d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7ed35c9043e485cbc95e9c48a24f570'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:14.266311 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 861/1706] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:14 2022] POST /identity/v3/users => generated 296 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:14.268211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818338f2-345e-4ad8-a8fe-acb92c5c6e11 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:14.273161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-818338f2-345e-4ad8-a8fe-acb92c5c6e11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:14.297245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1bd6df53-6da5-4436-97c3-2d40315745d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7ed35c9043e485cbc95e9c48a24f570'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:14.298710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1bd6df53-6da5-4436-97c3-2d40315745d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7ed35c9043e485cbc95e9c48a24f570'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:14.299678 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1bd6df53-6da5-4436-97c3-2d40315745d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7ed35c9043e485cbc95e9c48a24f570'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:14.312548 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:14.314398 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1bd6df53-6da5-4436-97c3-2d40315745d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7ed35c9043e485cbc95e9c48a24f570'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:14.325944 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-818338f2-345e-4ad8-a8fe-acb92c5c6e11 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:14.334288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eab810-261c-4316-a0df-916a104e5297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:14.335275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eab810-261c-4316-a0df-916a104e5297 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:14.335654 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eab810-261c-4316-a0df-916a104e5297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:14.336142 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95eab810-261c-4316-a0df-916a104e5297 admin admin] PATH_INFO: `/v3/users/6e4b5392804f468a92b66b6a10e2c917` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:14.338329 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eab810-261c-4316-a0df-916a104e5297 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e4b5392804f468a92b66b6a10e2c917)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:14.341977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95eab810-261c-4316-a0df-916a104e5297 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:14.417271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 846/1707] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:13 2022] DELETE /identity/v3/users/d7ed35c9043e485cbc95e9c48a24f570 => generated 0 bytes in 617 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:14.418812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4607125-e740-4f9e-8098-82dcef082b77 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:14.419109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4607125-e740-4f9e-8098-82dcef082b77 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:14.419389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4607125-e740-4f9e-8098-82dcef082b77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:14.458462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c4607125-e740-4f9e-8098-82dcef082b77 None None] MFA Rules not processed for user `4e504742dcd245e5bee9a4d68a748b92`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:14.459752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c4607125-e740-4f9e-8098-82dcef082b77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:14.608013 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-95eab810-261c-4316-a0df-916a104e5297 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e4b5392804f468a92b66b6a10e2c917'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:14.609083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-95eab810-261c-4316-a0df-916a104e5297 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e4b5392804f468a92b66b6a10e2c917'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:14.649889 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 847/1708] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:14 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:14.651615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94e8fa-bc4b-443b-bbad-68021cc66e47 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:14.651976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94e8fa-bc4b-443b-bbad-68021cc66e47 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:14.652514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f94e8fa-bc4b-443b-bbad-68021cc66e47 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:14.655107 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 848/1709] 10.222.0.40 () {54 vars in 960 bytes} [Fri Jul 15 19:37:14 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:37:14.656057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94e8fa-bc4b-443b-bbad-68021cc66e47 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:14.657960 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8f94e8fa-bc4b-443b-bbad-68021cc66e47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:14.752369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-95eab810-261c-4316-a0df-916a104e5297 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e4b5392804f468a92b66b6a10e2c917'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:14.756638 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-95eab810-261c-4316-a0df-916a104e5297 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e4b5392804f468a92b66b6a10e2c917'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:14.780851 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-95eab810-261c-4316-a0df-916a104e5297 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e4b5392804f468a92b66b6a10e2c917'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:14.781673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f94e8fa-bc4b-443b-bbad-68021cc66e47 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:14.796810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7c9df-06ae-43a7-ad6c-ce575e4f621c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:14.797970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7c9df-06ae-43a7-ad6c-ce575e4f621c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:14.798401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7c9df-06ae-43a7-ad6c-ce575e4f621c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:14.798914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca7c9df-06ae-43a7-ad6c-ce575e4f621c admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:14.804526 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7c9df-06ae-43a7-ad6c-ce575e4f621c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:14.808629 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca7c9df-06ae-43a7-ad6c-ce575e4f621c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:14.814238 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 862/1710] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:14 2022] DELETE /identity/v3/users/6e4b5392804f468a92b66b6a10e2c917 => generated 0 bytes in 543 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:14.814238 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eab810-261c-4316-a0df-916a104e5297 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:14.814238 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-95eab810-261c-4316-a0df-916a104e5297 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:14.848950 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 849/1711] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:14.851979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7c9df-06ae-43a7-ad6c-ce575e4f621c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:14.860450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3ca7c9df-06ae-43a7-ad6c-ce575e4f621c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:14.889783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca7c9df-06ae-43a7-ad6c-ce575e4f621c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:14.963213 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95eab810-261c-4316-a0df-916a104e5297 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:14.971649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a70dc6-a32d-4e61-b5b7-25f1150be947 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:14.973942 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a70dc6-a32d-4e61-b5b7-25f1150be947 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:14.974424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a70dc6-a32d-4e61-b5b7-25f1150be947 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:14.974974 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a70dc6-a32d-4e61-b5b7-25f1150be947 admin admin] PATH_INFO: `/v3/projects/6aa3244fb5224f019d0730dbbdb32db0` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:14.977902 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a70dc6-a32d-4e61-b5b7-25f1150be947 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6aa3244fb5224f019d0730dbbdb32db0)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:14.981272 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19a70dc6-a32d-4e61-b5b7-25f1150be947 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:15.008912 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f159df-6c57-45e9-bd81-f6dab9c287f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:15.009681 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f159df-6c57-45e9-bd81-f6dab9c287f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:15.009967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f159df-6c57-45e9-bd81-f6dab9c287f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:15.010244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f159df-6c57-45e9-bd81-f6dab9c287f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:15.011053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f159df-6c57-45e9-bd81-f6dab9c287f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:15.012999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f159df-6c57-45e9-bd81-f6dab9c287f9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:15.031621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 850/1712] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:14 2022] GET /identity/v3/roles => generated 1420 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:15.033188 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a4274-6a3e-4ccc-a280-b726f229a7af None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:15.033488 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a4274-6a3e-4ccc-a280-b726f229a7af None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:15.033761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3a4274-6a3e-4ccc-a280-b726f229a7af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:15.058043 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3e3a4274-6a3e-4ccc-a280-b726f229a7af None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:15.059474 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3e3a4274-6a3e-4ccc-a280-b726f229a7af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:15.073752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 851/1713] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:15.073752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e1ea3-3e6a-4fcb-a5ef-e481f1134e4f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:15.073752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e1ea3-3e6a-4fcb-a5ef-e481f1134e4f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:15.073752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85e1ea3-3e6a-4fcb-a5ef-e481f1134e4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:15.106339 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f85e1ea3-3e6a-4fcb-a5ef-e481f1134e4f None None] MFA Rules not processed for user `ad68d871464f4b5588c22070205f159e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:15.108513 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f85e1ea3-3e6a-4fcb-a5ef-e481f1134e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:15.177352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-19a70dc6-a32d-4e61-b5b7-25f1150be947 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6aa3244fb5224f019d0730dbbdb32db0', 'request_id': 'req-19a70dc6-a32d-4e61-b5b7-25f1150be947'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:15.262915 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-19a70dc6-a32d-4e61-b5b7-25f1150be947 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6aa3244fb5224f019d0730dbbdb32db0', 'request_id': 'req-19a70dc6-a32d-4e61-b5b7-25f1150be947'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:15.272441 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-19a70dc6-a32d-4e61-b5b7-25f1150be947 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6aa3244fb5224f019d0730dbbdb32db0', 'request_id': 'req-19a70dc6-a32d-4e61-b5b7-25f1150be947'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:15.301036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 852/1714] 10.222.0.40 () {58 vars in 1057 bytes} [Fri Jul 15 19:37:15 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:15.305380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e1ea3-3e6a-4fcb-a5ef-e481f1134e4f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:15.307432 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f85e1ea3-3e6a-4fcb-a5ef-e481f1134e4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:15.313146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-19a70dc6-a32d-4e61-b5b7-25f1150be947 admin admin] The token cache is being invalidate because project 6aa3244fb5224f019d0730dbbdb32db0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:15.313440 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-19a70dc6-a32d-4e61-b5b7-25f1150be947 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:15.315838 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-19a70dc6-a32d-4e61-b5b7-25f1150be947 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:15.324170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 863/1715] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:14 2022] DELETE /identity/v3/projects/6aa3244fb5224f019d0730dbbdb32db0 => generated 0 bytes in 511 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:15.324889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadd896-627a-4cc4-b293-801ca2b5cb3a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:15.325206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadd896-627a-4cc4-b293-801ca2b5cb3a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:15.327101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aadd896-627a-4cc4-b293-801ca2b5cb3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:15.402149 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-9aadd896-627a-4cc4-b293-801ca2b5cb3a None None] MFA Rules not processed for user `efaba747710744f59d77350e6f78f18b`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:15.403912 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9aadd896-627a-4cc4-b293-801ca2b5cb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:15.495368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85e1ea3-3e6a-4fcb-a5ef-e481f1134e4f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:15.525386 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 864/1716] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:15.526516 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadd896-627a-4cc4-b293-801ca2b5cb3a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:15.533620 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9aadd896-627a-4cc4-b293-801ca2b5cb3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:15.548207 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:15.591883 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f770c59-1f8b-4df8-81b4-0b43242e8c0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:15.592234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f770c59-1f8b-4df8-81b4-0b43242e8c0a service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:15.592474 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f770c59-1f8b-4df8-81b4-0b43242e8c0a service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:15.593325 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f770c59-1f8b-4df8-81b4-0b43242e8c0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:15.595308 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7f770c59-1f8b-4df8-81b4-0b43242e8c0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:15.635725 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aadd896-627a-4cc4-b293-801ca2b5cb3a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:15.641394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241c8ae-8ff0-4e42-b9a3-4b85e76e3037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:15.642300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241c8ae-8ff0-4e42-b9a3-4b85e76e3037 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:15.642431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241c8ae-8ff0-4e42-b9a3-4b85e76e3037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:15.642736 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f241c8ae-8ff0-4e42-b9a3-4b85e76e3037 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:15.643488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241c8ae-8ff0-4e42-b9a3-4b85e76e3037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:15.645101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f241c8ae-8ff0-4e42-b9a3-4b85e76e3037 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:15.658848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 865/1717] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:15 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:15.658848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241c8ae-8ff0-4e42-b9a3-4b85e76e3037 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:15.658848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f241c8ae-8ff0-4e42-b9a3-4b85e76e3037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:15.664587 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f770c59-1f8b-4df8-81b4-0b43242e8c0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:15.666447 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f770c59-1f8b-4df8-81b4-0b43242e8c0a service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:15.671820 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f241c8ae-8ff0-4e42-b9a3-4b85e76e3037 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:15.676567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3406528-c72a-4761-891a-2f3d61365e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:15.676721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 853/1718] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:15 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:15.677625 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f770c59-1f8b-4df8-81b4-0b43242e8c0a service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:15.677767 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3406528-c72a-4761-891a-2f3d61365e45 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:15.678150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3406528-c72a-4761-891a-2f3d61365e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:15.678683 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3406528-c72a-4761-891a-2f3d61365e45 admin admin] PATH_INFO: `/v3/projects/e9ee6575e7664d2298d198c2d7710221/users/e0d6ba12950d46be8e6995458c703589/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:15.679069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7f770c59-1f8b-4df8-81b4-0b43242e8c0a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:15.696115 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3406528-c72a-4761-891a-2f3d61365e45 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ee6575e7664d2298d198c2d7710221, user_id=e0d6ba12950d46be8e6995458c703589, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:15.698801 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3406528-c72a-4761-891a-2f3d61365e45 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:15.750850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f770c59-1f8b-4df8-81b4-0b43242e8c0a service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:15.756560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1472afd-2f93-4e30-a993-2110bcf423cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:15.757628 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1472afd-2f93-4e30-a993-2110bcf423cb service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:15.757944 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1472afd-2f93-4e30-a993-2110bcf423cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:15.758324 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1472afd-2f93-4e30-a993-2110bcf423cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:15.762594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a1472afd-2f93-4e30-a993-2110bcf423cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:15.781692 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1472afd-2f93-4e30-a993-2110bcf423cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:15.784767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1472afd-2f93-4e30-a993-2110bcf423cb service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:15.793837 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 866/1719] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:15 2022] PUT /identity/v3/projects/e9ee6575e7664d2298d198c2d7710221/users/e0d6ba12950d46be8e6995458c703589/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:15.797843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3406528-c72a-4761-891a-2f3d61365e45 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:15.801553 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 854/1720] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:15.802577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a3406528-c72a-4761-891a-2f3d61365e45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:15.805239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a0c51-600b-4143-a0cd-04a386d7f6cd None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:15.806194 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a0c51-600b-4143-a0cd-04a386d7f6cd None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:15.807375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552a0c51-600b-4143-a0cd-04a386d7f6cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:15.845136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-552a0c51-600b-4143-a0cd-04a386d7f6cd None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:15.846657 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-552a0c51-600b-4143-a0cd-04a386d7f6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:15.922997 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3406528-c72a-4761-891a-2f3d61365e45 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:15.928908 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32763eef-ac36-4696-b236-5766c9b31d6a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad68d871464f4b5588c22070205f159e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:15.929740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32763eef-ac36-4696-b236-5766c9b31d6a service placement] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:15.930146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32763eef-ac36-4696-b236-5766c9b31d6a service placement] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:15.930525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32763eef-ac36-4696-b236-5766c9b31d6a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:15.932663 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-32763eef-ac36-4696-b236-5766c9b31d6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:15.932934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 855/1721] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:15.933893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a0c51-600b-4143-a0cd-04a386d7f6cd None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:15.940043 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:15.940892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-552a0c51-600b-4143-a0cd-04a386d7f6cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:15.949861 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32763eef-ac36-4696-b236-5766c9b31d6a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:15.951840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32763eef-ac36-4696-b236-5766c9b31d6a service placement] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:15.957730 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552a0c51-600b-4143-a0cd-04a386d7f6cd None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:15.967453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 867/1722] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:15.968578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32763eef-ac36-4696-b236-5766c9b31d6a service placement] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:15.970857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-32763eef-ac36-4696-b236-5766c9b31d6a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:15.971704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdce9d4-3356-4cad-b8db-8a868de4628c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:15.972877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdce9d4-3356-4cad-b8db-8a868de4628c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:15.978385 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdce9d4-3356-4cad-b8db-8a868de4628c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:15.978385 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdce9d4-3356-4cad-b8db-8a868de4628c admin admin] PATH_INFO: `/v3/projects/7eb768b63cba4fd383e009e8ac4df726` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:15.978385 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdce9d4-3356-4cad-b8db-8a868de4628c admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb768b63cba4fd383e009e8ac4df726)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:15.978385 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdce9d4-3356-4cad-b8db-8a868de4628c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:16.093021 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32763eef-ac36-4696-b236-5766c9b31d6a service placement] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:16.124550 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586418d6-8eae-4c12-882c-b4f9a532cf79 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:16.129130 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586418d6-8eae-4c12-882c-b4f9a532cf79 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:16.129975 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586418d6-8eae-4c12-882c-b4f9a532cf79 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:16.130265 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586418d6-8eae-4c12-882c-b4f9a532cf79 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:16.137598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ffdce9d4-3356-4cad-b8db-8a868de4628c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb768b63cba4fd383e009e8ac4df726', 'request_id': 'req-ffdce9d4-3356-4cad-b8db-8a868de4628c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:16.149758 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ffdce9d4-3356-4cad-b8db-8a868de4628c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb768b63cba4fd383e009e8ac4df726', 'request_id': 'req-ffdce9d4-3356-4cad-b8db-8a868de4628c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:16.161549 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ffdce9d4-3356-4cad-b8db-8a868de4628c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb768b63cba4fd383e009e8ac4df726', 'request_id': 'req-ffdce9d4-3356-4cad-b8db-8a868de4628c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:16.250887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ffdce9d4-3356-4cad-b8db-8a868de4628c admin admin] The token cache is being invalidate because project 7eb768b63cba4fd383e009e8ac4df726 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:16.256508 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ffdce9d4-3356-4cad-b8db-8a868de4628c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:16.256508 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ffdce9d4-3356-4cad-b8db-8a868de4628c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:16.256853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586418d6-8eae-4c12-882c-b4f9a532cf79 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:16.256853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586418d6-8eae-4c12-882c-b4f9a532cf79 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:16.257607 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 856/1723] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:15 2022] DELETE /identity/v3/projects/7eb768b63cba4fd383e009e8ac4df726 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:16.262962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdce9d4-3356-4cad-b8db-8a868de4628c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:16.271873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ffdce9d4-3356-4cad-b8db-8a868de4628c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:16.285343 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 868/1724] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:16.285343 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586418d6-8eae-4c12-882c-b4f9a532cf79 service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:16.321180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586418d6-8eae-4c12-882c-b4f9a532cf79 service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:16.477367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a373450-b665-4bba-92db-2fca15d8db06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:16.478838 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a373450-b665-4bba-92db-2fca15d8db06 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:16.479305 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a373450-b665-4bba-92db-2fca15d8db06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:16.487502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a373450-b665-4bba-92db-2fca15d8db06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:16.487502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a373450-b665-4bba-92db-2fca15d8db06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:16.487502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a373450-b665-4bba-92db-2fca15d8db06 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:16.509128 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 869/1725] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:16 2022] GET /identity/v3/roles => generated 1420 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:16.510059 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc1a9e-5595-41c2-9735-d443e9517a39 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:16.510358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc1a9e-5595-41c2-9735-d443e9517a39 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:16.510655 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cc1a9e-5595-41c2-9735-d443e9517a39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:16.556385 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-08cc1a9e-5595-41c2-9735-d443e9517a39 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:16.557684 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-08cc1a9e-5595-41c2-9735-d443e9517a39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:16.571787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdce9d4-3356-4cad-b8db-8a868de4628c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:16.592858 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 870/1726] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:16.594413 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e9a8a-1f2c-49bd-a27d-b448975dbd9f None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:16.594705 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e9a8a-1f2c-49bd-a27d-b448975dbd9f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:16.595012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3e9a8a-1f2c-49bd-a27d-b448975dbd9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:16.598633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570e680c-a019-4ee9-978a-251cad147894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:16.599621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e680c-a019-4ee9-978a-251cad147894 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:16.599952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e680c-a019-4ee9-978a-251cad147894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:16.600180 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570e680c-a019-4ee9-978a-251cad147894 admin admin] PATH_INFO: `/v3/projects/891be9ba555c4de6a336f62c8b020fa4/users/fa5950bf32f54c889a07cafdb4179180/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:16.632529 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-1a3e9a8a-1f2c-49bd-a27d-b448975dbd9f None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:16.633708 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1a3e9a8a-1f2c-49bd-a27d-b448975dbd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:16.635724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e680c-a019-4ee9-978a-251cad147894 admin admin] RBAC: Authorizing `identity:create_grant(project_id=891be9ba555c4de6a336f62c8b020fa4, user_id=fa5950bf32f54c889a07cafdb4179180, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:16.640499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570e680c-a019-4ee9-978a-251cad147894 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:16.643821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 871/1727] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:16.645183 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e9a8a-1f2c-49bd-a27d-b448975dbd9f None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:16.650586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1a3e9a8a-1f2c-49bd-a27d-b448975dbd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:16.667412 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3e9a8a-1f2c-49bd-a27d-b448975dbd9f None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:16.674725 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb9d27-c087-4419-ada9-52e76c4f34ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:16.675992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb9d27-c087-4419-ada9-52e76c4f34ad admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:16.676510 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb9d27-c087-4419-ada9-52e76c4f34ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:16.677038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fb9d27-c087-4419-ada9-52e76c4f34ad admin admin] PATH_INFO: `/v3/projects/e9ee6575e7664d2298d198c2d7710221/users/e0d6ba12950d46be8e6995458c703589/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:16.680187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb9d27-c087-4419-ada9-52e76c4f34ad admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ee6575e7664d2298d198c2d7710221, user_id=e0d6ba12950d46be8e6995458c703589, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:16.683535 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fb9d27-c087-4419-ada9-52e76c4f34ad admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:16.705643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 872/1728] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:16 2022] PUT /identity/v3/projects/e9ee6575e7664d2298d198c2d7710221/users/e0d6ba12950d46be8e6995458c703589/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:16.706896 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb9d27-c087-4419-ada9-52e76c4f34ad admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:16.797542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 857/1729] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:16 2022] PUT /identity/v3/projects/891be9ba555c4de6a336f62c8b020fa4/users/fa5950bf32f54c889a07cafdb4179180/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 540 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:16.799014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce40cb-eff3-4271-a707-1fd6ea191042 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:16.799305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce40cb-eff3-4271-a707-1fd6ea191042 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:16.799602 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fce40cb-eff3-4271-a707-1fd6ea191042 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:16.841450 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fb9d27-c087-4419-ada9-52e76c4f34ad admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:16.852091 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4fce40cb-eff3-4271-a707-1fd6ea191042 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:16.854341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4fce40cb-eff3-4271-a707-1fd6ea191042 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:17.044957 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b300e-6de5-4226-bad9-dcf7e6ca988b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:17.046331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b300e-6de5-4226-bad9-dcf7e6ca988b admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:17.046625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b300e-6de5-4226-bad9-dcf7e6ca988b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:17.047136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8b300e-6de5-4226-bad9-dcf7e6ca988b admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:17.047892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b300e-6de5-4226-bad9-dcf7e6ca988b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:37:17.048212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b300e-6de5-4226-bad9-dcf7e6ca988b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:17.050391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b8b300e-6de5-4226-bad9-dcf7e6ca988b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:17.095211 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 858/1730] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:17.101978 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7bde0-f955-446c-b015-74b7173da961 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:17.102271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7bde0-f955-446c-b015-74b7173da961 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:17.102554 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7bde0-f955-446c-b015-74b7173da961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:17.104776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 873/1731] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:37:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:37:17.106480 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b300e-6de5-4226-bad9-dcf7e6ca988b admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:17.114900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5b8b300e-6de5-4226-bad9-dcf7e6ca988b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:17.163110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8b300e-6de5-4226-bad9-dcf7e6ca988b admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:17.180941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61239989-e7fd-4fc0-80f4-c08ec16918fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:17.184201 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61239989-e7fd-4fc0-80f4-c08ec16918fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:17.185049 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61239989-e7fd-4fc0-80f4-c08ec16918fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:17.185668 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61239989-e7fd-4fc0-80f4-c08ec16918fc admin admin] PATH_INFO: `/v3/projects/be7e2b67e7bd4059b0321970e4a89d57` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:17.188110 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b1e7bde0-f955-446c-b015-74b7173da961 None None] MFA Rules not processed for user `e0d6ba12950d46be8e6995458c703589`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:17.191643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b1e7bde0-f955-446c-b015-74b7173da961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:17.192044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61239989-e7fd-4fc0-80f4-c08ec16918fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=be7e2b67e7bd4059b0321970e4a89d57)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:17.194357 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61239989-e7fd-4fc0-80f4-c08ec16918fc admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:17.307148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 859/1732] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:17 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:17.308675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9ff96-07db-4de8-a573-a0e5cd8f3662 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:17.308977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9ff96-07db-4de8-a573-a0e5cd8f3662 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:17.309256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae9ff96-07db-4de8-a573-a0e5cd8f3662 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:17.361368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fae9ff96-07db-4de8-a573-a0e5cd8f3662 None None] MFA Rules not processed for user `fa5950bf32f54c889a07cafdb4179180`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:17.362881 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fae9ff96-07db-4de8-a573-a0e5cd8f3662 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:17.407775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-61239989-e7fd-4fc0-80f4-c08ec16918fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be7e2b67e7bd4059b0321970e4a89d57', 'request_id': 'req-61239989-e7fd-4fc0-80f4-c08ec16918fc'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:17.530358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-61239989-e7fd-4fc0-80f4-c08ec16918fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be7e2b67e7bd4059b0321970e4a89d57', 'request_id': 'req-61239989-e7fd-4fc0-80f4-c08ec16918fc'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:17.537419 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:17.540886 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-61239989-e7fd-4fc0-80f4-c08ec16918fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be7e2b67e7bd4059b0321970e4a89d57', 'request_id': 'req-61239989-e7fd-4fc0-80f4-c08ec16918fc'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:17.546042 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 860/1733] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:17 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:17.546042 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9ff96-07db-4de8-a573-a0e5cd8f3662 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:17.558099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-61239989-e7fd-4fc0-80f4-c08ec16918fc admin admin] The token cache is being invalidate because project be7e2b67e7bd4059b0321970e4a89d57 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:17.558454 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-61239989-e7fd-4fc0-80f4-c08ec16918fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:17.559785 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-61239989-e7fd-4fc0-80f4-c08ec16918fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:17.563691 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 874/1734] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:17 2022] DELETE /identity/v3/projects/be7e2b67e7bd4059b0321970e4a89d57 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:17.564789 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61239989-e7fd-4fc0-80f4-c08ec16918fc admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:17.566925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-61239989-e7fd-4fc0-80f4-c08ec16918fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:17.702650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61239989-e7fd-4fc0-80f4-c08ec16918fc admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:17.710337 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd328be-6275-49ea-a2ee-973f85b52dda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:17.712012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd328be-6275-49ea-a2ee-973f85b52dda admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:17.712344 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd328be-6275-49ea-a2ee-973f85b52dda admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:17.712771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd328be-6275-49ea-a2ee-973f85b52dda admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:17.727570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd328be-6275-49ea-a2ee-973f85b52dda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:17.730725 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd328be-6275-49ea-a2ee-973f85b52dda admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:17.739836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae9ff96-07db-4de8-a573-a0e5cd8f3662 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:17.762262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfbf50-d998-4c3f-8bfa-a9183043c293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:17.777114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfbf50-d998-4c3f-8bfa-a9183043c293 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:17.778353 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfbf50-d998-4c3f-8bfa-a9183043c293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:17.779113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbfbf50-d998-4c3f-8bfa-a9183043c293 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:17.781850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfbf50-d998-4c3f-8bfa-a9183043c293 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:37:17.785546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfbf50-d998-4c3f-8bfa-a9183043c293 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:17.792722 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbfbf50-d998-4c3f-8bfa-a9183043c293 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:17.825769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 861/1735] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:37:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:37:17.825769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfbf50-d998-4c3f-8bfa-a9183043c293 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:17.829170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9dbfbf50-d998-4c3f-8bfa-a9183043c293 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:17.892866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 875/1736] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:17 2022] POST /identity/v3/projects => generated 381 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:17.895218 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaaaef-27ac-4fd6-a31d-7801fcabb885 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:17.895501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaaaef-27ac-4fd6-a31d-7801fcabb885 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:17.895735 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6daaaaef-27ac-4fd6-a31d-7801fcabb885 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:17.919851 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:17.940305 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-6daaaaef-27ac-4fd6-a31d-7801fcabb885 None None] MFA Rules not processed for user `4e504742dcd245e5bee9a4d68a748b92`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:17.942655 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6daaaaef-27ac-4fd6-a31d-7801fcabb885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:17.948075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbfbf50-d998-4c3f-8bfa-a9183043c293 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:18.047969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47976c45-4bbc-4cbe-a72a-3e294dba97c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:18.048836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47976c45-4bbc-4cbe-a72a-3e294dba97c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:18.049130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47976c45-4bbc-4cbe-a72a-3e294dba97c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:18.049461 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47976c45-4bbc-4cbe-a72a-3e294dba97c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:18.051529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-47976c45-4bbc-4cbe-a72a-3e294dba97c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:18.154161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 876/1737] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 261 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:18.159189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaaaef-27ac-4fd6-a31d-7801fcabb885 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:18.160410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6daaaaef-27ac-4fd6-a31d-7801fcabb885 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:18.183259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47976c45-4bbc-4cbe-a72a-3e294dba97c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:18.192902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47976c45-4bbc-4cbe-a72a-3e294dba97c2 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:18.208086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 862/1738] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:17 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:18.209703 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc91b7-7334-4184-84e5-49628b49727f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:18.209997 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc91b7-7334-4184-84e5-49628b49727f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:18.210279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc91b7-7334-4184-84e5-49628b49727f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:18.249502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-edbc91b7-7334-4184-84e5-49628b49727f None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:18.255275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-edbc91b7-7334-4184-84e5-49628b49727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:18.304385 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6daaaaef-27ac-4fd6-a31d-7801fcabb885 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:18.347727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9acfb-bc8b-476a-b513-2f9f10074f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:18.348424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9acfb-bc8b-476a-b513-2f9f10074f90 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:18.348709 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9acfb-bc8b-476a-b513-2f9f10074f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:18.348987 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c9acfb-bc8b-476a-b513-2f9f10074f90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:18.350535 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9acfb-bc8b-476a-b513-2f9f10074f90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:18.359013 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c9acfb-bc8b-476a-b513-2f9f10074f90 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:18.381253 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 863/1739] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:18.382697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc91b7-7334-4184-84e5-49628b49727f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:18.386678 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-edbc91b7-7334-4184-84e5-49628b49727f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:18.423525 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc91b7-7334-4184-84e5-49628b49727f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:18.428922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c932c4-1e5e-468f-8216-081eff20c3c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:18.429595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c932c4-1e5e-468f-8216-081eff20c3c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:18.429873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c932c4-1e5e-468f-8216-081eff20c3c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:18.430146 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c932c4-1e5e-468f-8216-081eff20c3c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:18.430898 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c932c4-1e5e-468f-8216-081eff20c3c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:18.433999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c932c4-1e5e-468f-8216-081eff20c3c0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:18.589554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 877/1740] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:18 2022] POST /identity/v3/projects => generated 387 bytes in 432 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:18.589554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9acfb-bc8b-476a-b513-2f9f10074f90 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:18.602323 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 864/1741] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:18 2022] POST /identity/v3/projects => generated 373 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:18.602323 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69483c-bc2a-41cb-902d-67afec224e02 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:18.602323 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69483c-bc2a-41cb-902d-67afec224e02 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:18.602323 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec69483c-bc2a-41cb-902d-67afec224e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:18.642847 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ec69483c-bc2a-41cb-902d-67afec224e02 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:18.652435 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ec69483c-bc2a-41cb-902d-67afec224e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:18.719125 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c9acfb-bc8b-476a-b513-2f9f10074f90 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:18.826188 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 865/1742] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:18.835085 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aba07c-4d5a-4849-8627-51565d15c234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:18.835876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aba07c-4d5a-4849-8627-51565d15c234 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:18.836170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aba07c-4d5a-4849-8627-51565d15c234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:18.836448 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32aba07c-4d5a-4849-8627-51565d15c234 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:18.837217 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aba07c-4d5a-4849-8627-51565d15c234 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:18.837922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69483c-bc2a-41cb-902d-67afec224e02 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:18.839485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32aba07c-4d5a-4849-8627-51565d15c234 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:18.864913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec69483c-bc2a-41cb-902d-67afec224e02 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:18.875440 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f3adb-6a4e-48cb-a542-34f012b6888d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:18.876376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f3adb-6a4e-48cb-a542-34f012b6888d admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:18.876852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f3adb-6a4e-48cb-a542-34f012b6888d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:18.877609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f3adb-6a4e-48cb-a542-34f012b6888d admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:18.878477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f3adb-6a4e-48cb-a542-34f012b6888d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:18.883442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f3adb-6a4e-48cb-a542-34f012b6888d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:18.953454 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 878/1743] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:18 2022] POST /identity/v3/users => generated 291 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:18.955913 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aba07c-4d5a-4849-8627-51565d15c234 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:18.970139 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32aba07c-4d5a-4849-8627-51565d15c234 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:18.977113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b33b119-cd7b-4503-8899-52becdb6ef9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:18.978093 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33b119-cd7b-4503-8899-52becdb6ef9d admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:18.984931 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33b119-cd7b-4503-8899-52becdb6ef9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:18.984931 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b33b119-cd7b-4503-8899-52becdb6ef9d admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:18.984931 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33b119-cd7b-4503-8899-52becdb6ef9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:18.984931 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b33b119-cd7b-4503-8899-52becdb6ef9d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:19.019200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 866/1744] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:18 2022] POST /identity/v3/users => generated 294 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:19.020450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f3adb-6a4e-48cb-a542-34f012b6888d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:19.115777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 879/1745] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:18 2022] POST /identity/v3/users => generated 287 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:19.115777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3c5cc-640b-4591-9625-d52c82318cf8 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:19.115777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3c5cc-640b-4591-9625-d52c82318cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:19.119087 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3c5cc-640b-4591-9625-d52c82318cf8 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:19.125753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 880/1746] 10.222.0.40 () {54 vars in 912 bytes} [Fri Jul 15 19:37:19 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:37:19.132307 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3c5cc-640b-4591-9625-d52c82318cf8 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:19.177322 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3c5cc-640b-4591-9625-d52c82318cf8 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:19.195645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b64faf-f0d3-4520-81d2-0d6744c6cd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:19.195645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b64faf-f0d3-4520-81d2-0d6744c6cd92 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:19.195645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b64faf-f0d3-4520-81d2-0d6744c6cd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:19.195645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36b64faf-f0d3-4520-81d2-0d6744c6cd92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:19.196574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b64faf-f0d3-4520-81d2-0d6744c6cd92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:37:19.196574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b64faf-f0d3-4520-81d2-0d6744c6cd92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:19.196574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36b64faf-f0d3-4520-81d2-0d6744c6cd92 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:19.207366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f3adb-6a4e-48cb-a542-34f012b6888d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:19.220172 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b672d132-8099-443f-bbfb-ecb187836cb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:19.220857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672d132-8099-443f-bbfb-ecb187836cb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:19.221156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672d132-8099-443f-bbfb-ecb187836cb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:19.222649 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b672d132-8099-443f-bbfb-ecb187836cb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:19.238166 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b672d132-8099-443f-bbfb-ecb187836cb0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:19.253344 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 881/1747] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:37:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:37:19.255785 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b64faf-f0d3-4520-81d2-0d6744c6cd92 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:19.290302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36b64faf-f0d3-4520-81d2-0d6744c6cd92 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:19.306591 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77516dd9-2489-44da-acba-bacb7fe29721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:19.307263 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77516dd9-2489-44da-acba-bacb7fe29721 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:19.307549 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77516dd9-2489-44da-acba-bacb7fe29721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:19.307865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77516dd9-2489-44da-acba-bacb7fe29721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:19.308629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77516dd9-2489-44da-acba-bacb7fe29721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:19.315238 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77516dd9-2489-44da-acba-bacb7fe29721 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:19.357052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 882/1748] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:19.359404 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77516dd9-2489-44da-acba-bacb7fe29721 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:19.390532 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77516dd9-2489-44da-acba-bacb7fe29721 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:19.403663 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cb7f1-2003-442d-9e60-e4a022a4910a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:19.404360 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cb7f1-2003-442d-9e60-e4a022a4910a admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:19.407448 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cb7f1-2003-442d-9e60-e4a022a4910a admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:19.407758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7cb7f1-2003-442d-9e60-e4a022a4910a admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:19.410989 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7cb7f1-2003-442d-9e60-e4a022a4910a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:19.418498 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb7cb7f1-2003-442d-9e60-e4a022a4910a admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:19.449297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672d132-8099-443f-bbfb-ecb187836cb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:19.458668 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b672d132-8099-443f-bbfb-ecb187836cb0 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:19.458930 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 883/1749] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:19.459824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cb7f1-2003-442d-9e60-e4a022a4910a admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:19.475692 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7cb7f1-2003-442d-9e60-e4a022a4910a admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:19.482051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6e348-7e80-4b58-abeb-3904eb66fb21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:19.483073 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6e348-7e80-4b58-abeb-3904eb66fb21 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:19.484032 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6e348-7e80-4b58-abeb-3904eb66fb21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:19.484465 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c6e348-7e80-4b58-abeb-3904eb66fb21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:19.485391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6e348-7e80-4b58-abeb-3904eb66fb21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:19.487486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57c6e348-7e80-4b58-abeb-3904eb66fb21 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:19.492381 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 867/1750] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:19.497542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab0562-a859-4579-b29c-d1f82138c449 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:19.498051 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab0562-a859-4579-b29c-d1f82138c449 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:19.498593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ab0562-a859-4579-b29c-d1f82138c449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:19.513241 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 884/1751] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:19.516072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6e348-7e80-4b58-abeb-3904eb66fb21 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:19.537638 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c6e348-7e80-4b58-abeb-3904eb66fb21 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:19.543065 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15856e-2a3a-4d7e-8a2d-0c36d2823474 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:19.544073 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15856e-2a3a-4d7e-8a2d-0c36d2823474 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:19.544542 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15856e-2a3a-4d7e-8a2d-0c36d2823474 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:19.544958 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa15856e-2a3a-4d7e-8a2d-0c36d2823474 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:19.546515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15856e-2a3a-4d7e-8a2d-0c36d2823474 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:19.549001 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa15856e-2a3a-4d7e-8a2d-0c36d2823474 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:19.558539 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a6ab0562-a859-4579-b29c-d1f82138c449 None None] MFA Rules not processed for user `c99418232a0848a1b7a1a73966928769`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:19.559888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a6ab0562-a859-4579-b29c-d1f82138c449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:19.672987 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 868/1752] 10.222.0.40 () {58 vars in 1009 bytes} [Fri Jul 15 19:37:19 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:19.674138 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab0562-a859-4579-b29c-d1f82138c449 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:19.696019 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ab0562-a859-4579-b29c-d1f82138c449 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:19.700815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6db881-1ee1-499a-952f-932eada9f22a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:19.702038 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db881-1ee1-499a-952f-932eada9f22a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:19.709510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db881-1ee1-499a-952f-932eada9f22a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:19.709510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6db881-1ee1-499a-952f-932eada9f22a admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:19.709510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6db881-1ee1-499a-952f-932eada9f22a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:19.709510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6db881-1ee1-499a-952f-932eada9f22a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:19.718796 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 869/1753] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:19.719613 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6db881-1ee1-499a-952f-932eada9f22a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:19.737123 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6db881-1ee1-499a-952f-932eada9f22a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:19.745896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab2cf0-6224-4ad5-80e3-9d149841af65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:19.746589 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab2cf0-6224-4ad5-80e3-9d149841af65 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:19.749683 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab2cf0-6224-4ad5-80e3-9d149841af65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:19.749683 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ab2cf0-6224-4ad5-80e3-9d149841af65 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:19.749683 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab2cf0-6224-4ad5-80e3-9d149841af65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:19.750619 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ab2cf0-6224-4ad5-80e3-9d149841af65 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:19.766058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 870/1754] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:19.766058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab2cf0-6224-4ad5-80e3-9d149841af65 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:19.787969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ab2cf0-6224-4ad5-80e3-9d149841af65 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:19.788801 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 885/1755] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:19 2022] POST /identity/v3/projects => generated 355 bytes in 274 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:19.789772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15856e-2a3a-4d7e-8a2d-0c36d2823474 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:19.791859 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-fa15856e-2a3a-4d7e-8a2d-0c36d2823474 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:19.860881 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995df28-9828-47b3-b54c-bb5e208bf678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:19.861556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995df28-9828-47b3-b54c-bb5e208bf678 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:19.861839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995df28-9828-47b3-b54c-bb5e208bf678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:19.862200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3995df28-9828-47b3-b54c-bb5e208bf678 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:19.863226 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa15856e-2a3a-4d7e-8a2d-0c36d2823474 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:19.863347 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995df28-9828-47b3-b54c-bb5e208bf678 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:19.866157 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3995df28-9828-47b3-b54c-bb5e208bf678 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:19.868428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab96ec-606b-43f2-b948-a9731f3fece1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:19.869393 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab96ec-606b-43f2-b948-a9731f3fece1 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:19.869764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab96ec-606b-43f2-b948-a9731f3fece1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:19.870138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab96ec-606b-43f2-b948-a9731f3fece1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:19.878651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab96ec-606b-43f2-b948-a9731f3fece1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:19.880415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ab96ec-606b-43f2-b948-a9731f3fece1 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:19.881837 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 871/1756] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:19 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:19.883768 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995df28-9828-47b3-b54c-bb5e208bf678 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:19.892354 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 886/1757] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:19 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:19.893669 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab96ec-606b-43f2-b948-a9731f3fece1 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:19.903697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3995df28-9828-47b3-b54c-bb5e208bf678 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:19.909963 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab96ec-606b-43f2-b948-a9731f3fece1 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:19.916920 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323815c-bd70-4c7b-bf30-f9c030c4a01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:19.917966 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323815c-bd70-4c7b-bf30-f9c030c4a01b admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:19.918255 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323815c-bd70-4c7b-bf30-f9c030c4a01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:19.918647 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5323815c-bd70-4c7b-bf30-f9c030c4a01b admin admin] PATH_INFO: `/v3/projects/b23b4fb488de415c8e2edddc568f34e0/users/bbbbc17bf28f4a5dbfd8bf59a2393aac/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:19.926566 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45907964-2cd5-4b19-8e86-693e7af1e1d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:19.927671 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45907964-2cd5-4b19-8e86-693e7af1e1d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:19.928070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45907964-2cd5-4b19-8e86-693e7af1e1d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:19.928490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45907964-2cd5-4b19-8e86-693e7af1e1d5 admin admin] PATH_INFO: `/v3/projects/d2438c77eb8d4c1bb999ca142e8084fa/users/50be00913b7c42eea4f85d2981326fb6/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:19.963471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323815c-bd70-4c7b-bf30-f9c030c4a01b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b23b4fb488de415c8e2edddc568f34e0, user_id=bbbbc17bf28f4a5dbfd8bf59a2393aac, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:19.967282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45907964-2cd5-4b19-8e86-693e7af1e1d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2438c77eb8d4c1bb999ca142e8084fa, user_id=50be00913b7c42eea4f85d2981326fb6, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:19.971044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5323815c-bd70-4c7b-bf30-f9c030c4a01b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:19.973000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45907964-2cd5-4b19-8e86-693e7af1e1d5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:20.012183 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=85,keystone:DELETE=8,keystone:INSERT=7 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:20.095389 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 887/1758] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:19 2022] PUT /identity/v3/projects/b23b4fb488de415c8e2edddc568f34e0/users/bbbbc17bf28f4a5dbfd8bf59a2393aac/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:20.097086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323815c-bd70-4c7b-bf30-f9c030c4a01b admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:20.104364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 872/1759] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:19 2022] PUT /identity/v3/projects/d2438c77eb8d4c1bb999ca142e8084fa/users/50be00913b7c42eea4f85d2981326fb6/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:20.105319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45907964-2cd5-4b19-8e86-693e7af1e1d5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:20.213935 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5323815c-bd70-4c7b-bf30-f9c030c4a01b admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:20.219469 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbf3da0-250a-44e9-8b9d-d9a43baa3d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:20.220180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf3da0-250a-44e9-8b9d-d9a43baa3d01 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:20.220462 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf3da0-250a-44e9-8b9d-d9a43baa3d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:20.220799 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbf3da0-250a-44e9-8b9d-d9a43baa3d01 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:20.221602 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf3da0-250a-44e9-8b9d-d9a43baa3d01 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:20.223624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbf3da0-250a-44e9-8b9d-d9a43baa3d01 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:20.239168 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45907964-2cd5-4b19-8e86-693e7af1e1d5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:20.244312 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc38fd17-55f0-46ac-9f33-841f723c3ac0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:20.258957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38fd17-55f0-46ac-9f33-841f723c3ac0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:20.258957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38fd17-55f0-46ac-9f33-841f723c3ac0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:20.258957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc38fd17-55f0-46ac-9f33-841f723c3ac0 admin admin] PATH_INFO: `/v3/projects/7a90237915404fd796f3f3f0c643cafc/users/75735451cc6e4ed0a70f7498a0ab71e4/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:20.265096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38fd17-55f0-46ac-9f33-841f723c3ac0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7a90237915404fd796f3f3f0c643cafc, user_id=75735451cc6e4ed0a70f7498a0ab71e4, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:20.268214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc38fd17-55f0-46ac-9f33-841f723c3ac0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:20.549294 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 888/1760] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:20 2022] POST /identity/v3/users => generated 278 bytes in 453 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:20.558031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba095-922e-4811-8c6f-cd7cd988d3bb None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:20.558031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba095-922e-4811-8c6f-cd7cd988d3bb None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:20.558031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfba095-922e-4811-8c6f-cd7cd988d3bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:20.584261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-9cfba095-922e-4811-8c6f-cd7cd988d3bb None None] MFA Rules not processed for user `bbbbc17bf28f4a5dbfd8bf59a2393aac`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:20.586375 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9cfba095-922e-4811-8c6f-cd7cd988d3bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:20.610348 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:20.618412 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 873/1761] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:20 2022] PUT /identity/v3/projects/7a90237915404fd796f3f3f0c643cafc/users/75735451cc6e4ed0a70f7498a0ab71e4/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:20.618605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e867036-2fbf-423d-aeeb-92eac4d50ff5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:20.630442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e867036-2fbf-423d-aeeb-92eac4d50ff5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:20.630442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e867036-2fbf-423d-aeeb-92eac4d50ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:20.733612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9e867036-2fbf-423d-aeeb-92eac4d50ff5 None None] MFA Rules not processed for user `50be00913b7c42eea4f85d2981326fb6`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:20.733612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9e867036-2fbf-423d-aeeb-92eac4d50ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:20.802324 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 889/1762] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:20 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:20.803449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfba095-922e-4811-8c6f-cd7cd988d3bb None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:20.821659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfba095-922e-4811-8c6f-cd7cd988d3bb None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:20.926670 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 874/1763] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:20 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:20.929006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0962b-7580-454c-9854-9e28fb0558c1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:20.929497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0962b-7580-454c-9854-9e28fb0558c1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:20.929497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae0962b-7580-454c-9854-9e28fb0558c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:20.986440 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9568124-720f-434e-bfcf-a053ec9d0d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:20.987137 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9568124-720f-434e-bfcf-a053ec9d0d28 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:20.987432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9568124-720f-434e-bfcf-a053ec9d0d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:20.987713 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9568124-720f-434e-bfcf-a053ec9d0d28 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:20.988471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9568124-720f-434e-bfcf-a053ec9d0d28 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:20.990413 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9568124-720f-434e-bfcf-a053ec9d0d28 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:21.005049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-eae0962b-7580-454c-9854-9e28fb0558c1 None None] MFA Rules not processed for user `75735451cc6e4ed0a70f7498a0ab71e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:21.006944 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-eae0962b-7580-454c-9854-9e28fb0558c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:21.053258 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 890/1764] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:20 2022] GET /identity/v3/roles => generated 1420 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:21.054448 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9568124-720f-434e-bfcf-a053ec9d0d28 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:21.078447 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9568124-720f-434e-bfcf-a053ec9d0d28 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:21.104713 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16863ae-c2c7-40ea-bd9f-51be3e633c0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:21.105572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16863ae-c2c7-40ea-bd9f-51be3e633c0e admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:21.105758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16863ae-c2c7-40ea-bd9f-51be3e633c0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:21.106042 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16863ae-c2c7-40ea-bd9f-51be3e633c0e admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:21.111510 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16863ae-c2c7-40ea-bd9f-51be3e633c0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:21.117449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16863ae-c2c7-40ea-bd9f-51be3e633c0e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:21.218058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 875/1765] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:21.218058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0962b-7580-454c-9854-9e28fb0558c1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:21.231078 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae0962b-7580-454c-9854-9e28fb0558c1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:21.237861 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2392c4d-d246-4cfa-bbf9-867b70774b21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:21.238490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392c4d-d246-4cfa-bbf9-867b70774b21 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:21.238957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392c4d-d246-4cfa-bbf9-867b70774b21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:21.239427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2392c4d-d246-4cfa-bbf9-867b70774b21 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:21.240145 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2392c4d-d246-4cfa-bbf9-867b70774b21 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:21.242124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2392c4d-d246-4cfa-bbf9-867b70774b21 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:21.253278 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 891/1766] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:21 2022] POST /identity/v3/projects => generated 387 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:21.253823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16863ae-c2c7-40ea-bd9f-51be3e633c0e admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:21.361851 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16863ae-c2c7-40ea-bd9f-51be3e633c0e admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:21.366860 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b95388-45d3-4aa7-bc87-4278eb7277fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:21.367540 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b95388-45d3-4aa7-bc87-4278eb7277fa admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:21.367823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b95388-45d3-4aa7-bc87-4278eb7277fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:21.368098 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b95388-45d3-4aa7-bc87-4278eb7277fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:21.368858 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b95388-45d3-4aa7-bc87-4278eb7277fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:21.370496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b95388-45d3-4aa7-bc87-4278eb7277fa admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:21.382135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 892/1767] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:21.383087 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b95388-45d3-4aa7-bc87-4278eb7277fa admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:21.394406 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b95388-45d3-4aa7-bc87-4278eb7277fa admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:21.403300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f45d99b-7fbb-4efd-93de-687933d6fe52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:21.405122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45d99b-7fbb-4efd-93de-687933d6fe52 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:21.405523 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45d99b-7fbb-4efd-93de-687933d6fe52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:21.406314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f45d99b-7fbb-4efd-93de-687933d6fe52 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:21.407648 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45d99b-7fbb-4efd-93de-687933d6fe52 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:21.411017 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f45d99b-7fbb-4efd-93de-687933d6fe52 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:21.425185 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 876/1768] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:21 2022] POST /identity/v3/projects => generated 383 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:21.425539 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2392c4d-d246-4cfa-bbf9-867b70774b21 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:21.532415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2392c4d-d246-4cfa-bbf9-867b70774b21 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:21.532415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20c0e9-a704-423a-8d6b-4460f0a45650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:21.532415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20c0e9-a704-423a-8d6b-4460f0a45650 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:21.532415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20c0e9-a704-423a-8d6b-4460f0a45650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:21.532736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db20c0e9-a704-423a-8d6b-4460f0a45650 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:21.532736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20c0e9-a704-423a-8d6b-4460f0a45650 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:21.532736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db20c0e9-a704-423a-8d6b-4460f0a45650 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:21.571420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 893/1769] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:21 2022] POST /identity/v3/projects => generated 373 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:21.571420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8e7a3-3766-4d6c-916f-966e175440cc None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:21.571420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8e7a3-3766-4d6c-916f-966e175440cc None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:21.571420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a8e7a3-3766-4d6c-916f-966e175440cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:21.594382 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c1a8e7a3-3766-4d6c-916f-966e175440cc None None] MFA Rules not processed for user `efaba747710744f59d77350e6f78f18b`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:21.595919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c1a8e7a3-3766-4d6c-916f-966e175440cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:21.668826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 877/1770] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:21 2022] POST /identity/v3/users => generated 300 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:21.671270 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20c0e9-a704-423a-8d6b-4460f0a45650 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:21.685847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 894/1771] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:21 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:21.685847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8e7a3-3766-4d6c-916f-966e175440cc None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:21.719517 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db20c0e9-a704-423a-8d6b-4460f0a45650 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:21.825984 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a8e7a3-3766-4d6c-916f-966e175440cc None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:21.831895 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fd752-dff4-4ea5-9d6b-d27ed85e6aa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:21.833105 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fd752-dff4-4ea5-9d6b-d27ed85e6aa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:21.833574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fd752-dff4-4ea5-9d6b-d27ed85e6aa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:21.834113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933fd752-dff4-4ea5-9d6b-d27ed85e6aa1 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:21.835081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933fd752-dff4-4ea5-9d6b-d27ed85e6aa1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:21.839063 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933fd752-dff4-4ea5-9d6b-d27ed85e6aa1 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:21.876405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04083737-f595-475f-9cac-601162eb90b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:21.878007 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04083737-f595-475f-9cac-601162eb90b1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:21.878320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04083737-f595-475f-9cac-601162eb90b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:21.878904 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04083737-f595-475f-9cac-601162eb90b1 admin admin] PATH_INFO: `/v3/projects/8c163ddb24574f82acd9786273ee89f6/users/36180caaca57435b87a586f2f66f5517/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:21.906942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04083737-f595-475f-9cac-601162eb90b1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c163ddb24574f82acd9786273ee89f6, user_id=36180caaca57435b87a586f2f66f5517, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:21.910316 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04083737-f595-475f-9cac-601162eb90b1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:21.964219 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 895/1772] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:21 2022] POST /identity/v3/users => generated 298 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:21.965408 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fd752-dff4-4ea5-9d6b-d27ed85e6aa1 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:21.990399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933fd752-dff4-4ea5-9d6b-d27ed85e6aa1 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:21.996445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699b428e-89ee-4951-86fd-91142f398411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:21.997595 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b428e-89ee-4951-86fd-91142f398411 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:21.997891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b428e-89ee-4951-86fd-91142f398411 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:21.999116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699b428e-89ee-4951-86fd-91142f398411 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:21.999532 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b428e-89ee-4951-86fd-91142f398411 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:22.002027 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699b428e-89ee-4951-86fd-91142f398411 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:22.074316 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 878/1773] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:21 2022] PUT /identity/v3/projects/8c163ddb24574f82acd9786273ee89f6/users/36180caaca57435b87a586f2f66f5517/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 404 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:22.075049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04083737-f595-475f-9cac-601162eb90b1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:22.160364 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 896/1774] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:21 2022] POST /identity/v3/users => generated 293 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:22.162627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a0915-ecc0-4d13-b7cb-6d9c5b202973 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:22.169137 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a0915-ecc0-4d13-b7cb-6d9c5b202973 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:22.173743 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392a0915-ecc0-4d13-b7cb-6d9c5b202973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:22.289017 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04083737-f595-475f-9cac-601162eb90b1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:22.295983 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61020cb6-2aa6-4acc-8d8e-16ce12042f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:22.297225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61020cb6-2aa6-4acc-8d8e-16ce12042f6d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:22.297753 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61020cb6-2aa6-4acc-8d8e-16ce12042f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:22.298404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61020cb6-2aa6-4acc-8d8e-16ce12042f6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:22.312866 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61020cb6-2aa6-4acc-8d8e-16ce12042f6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:22.315244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61020cb6-2aa6-4acc-8d8e-16ce12042f6d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:22.328794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 879/1775] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:22.330051 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61020cb6-2aa6-4acc-8d8e-16ce12042f6d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:22.344954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61020cb6-2aa6-4acc-8d8e-16ce12042f6d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:22.354515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926abb0f-5640-4f07-b243-521de0763674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:22.355614 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926abb0f-5640-4f07-b243-521de0763674 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:22.356100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926abb0f-5640-4f07-b243-521de0763674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:22.356560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926abb0f-5640-4f07-b243-521de0763674 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:22.358262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926abb0f-5640-4f07-b243-521de0763674 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:22.359622 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-392a0915-ecc0-4d13-b7cb-6d9c5b202973 None None] MFA Rules not processed for user `deed55901c264b8da58e57c21840c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:22.360917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-392a0915-ecc0-4d13-b7cb-6d9c5b202973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:22.361476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926abb0f-5640-4f07-b243-521de0763674 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:22.376580 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 880/1776] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:22.378522 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482967e-7e1d-48d7-bb98-27aba09985ab None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:22.379135 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482967e-7e1d-48d7-bb98-27aba09985ab None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:22.379717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c482967e-7e1d-48d7-bb98-27aba09985ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:22.435485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c482967e-7e1d-48d7-bb98-27aba09985ab None None] MFA Rules not processed for user `36180caaca57435b87a586f2f66f5517`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:22.438435 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c482967e-7e1d-48d7-bb98-27aba09985ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:22.499500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 897/1777] 10.222.0.40 () {58 vars in 1009 bytes} [Fri Jul 15 19:37:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:22.500409 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a0915-ecc0-4d13-b7cb-6d9c5b202973 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:22.515567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392a0915-ecc0-4d13-b7cb-6d9c5b202973 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:22.524914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac98ca-e7c8-4d55-ac74-d94fdac9a28a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:22.526282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac98ca-e7c8-4d55-ac74-d94fdac9a28a admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:22.527119 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac98ca-e7c8-4d55-ac74-d94fdac9a28a admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:22.527655 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aac98ca-e7c8-4d55-ac74-d94fdac9a28a admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:22.530287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac98ca-e7c8-4d55-ac74-d94fdac9a28a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:22.532218 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aac98ca-e7c8-4d55-ac74-d94fdac9a28a admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:22.547727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 898/1778] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:22.549509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac98ca-e7c8-4d55-ac74-d94fdac9a28a admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:22.574852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aac98ca-e7c8-4d55-ac74-d94fdac9a28a admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:22.582079 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825d354-deb0-4cea-ae46-f594d60ad27b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:22.583191 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825d354-deb0-4cea-ae46-f594d60ad27b admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:22.583525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825d354-deb0-4cea-ae46-f594d60ad27b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:22.583873 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b825d354-deb0-4cea-ae46-f594d60ad27b admin admin] PATH_INFO: `/v3/projects/a151768fb56d4fe9afaf5d798880035b/users/1d0d842a766348f99c8eb49393d01c0a/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:22.621416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 881/1779] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:22 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:22.627847 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482967e-7e1d-48d7-bb98-27aba09985ab None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:22.650370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c482967e-7e1d-48d7-bb98-27aba09985ab None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:22.662773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825d354-deb0-4cea-ae46-f594d60ad27b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a151768fb56d4fe9afaf5d798880035b, user_id=1d0d842a766348f99c8eb49393d01c0a, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:22.664574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f813318-fd66-4f02-9d5c-8b87665cbbfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:22.665702 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f813318-fd66-4f02-9d5c-8b87665cbbfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:22.665995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f813318-fd66-4f02-9d5c-8b87665cbbfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:22.666261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f813318-fd66-4f02-9d5c-8b87665cbbfb admin admin] PATH_INFO: `/v3/projects/87e9e572f5fe4a4397e6e30749d2405f/users/9c37522d5d4b417196d185a8cefa0ca9/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:22.673423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b825d354-deb0-4cea-ae46-f594d60ad27b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:22.704938 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f813318-fd66-4f02-9d5c-8b87665cbbfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e9e572f5fe4a4397e6e30749d2405f, user_id=9c37522d5d4b417196d185a8cefa0ca9, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:22.708004 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f813318-fd66-4f02-9d5c-8b87665cbbfb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:22.798846 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 899/1780] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:22 2022] PUT /identity/v3/projects/a151768fb56d4fe9afaf5d798880035b/users/1d0d842a766348f99c8eb49393d01c0a/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:22.799680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825d354-deb0-4cea-ae46-f594d60ad27b admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:22.829201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 882/1781] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:22 2022] PUT /identity/v3/projects/87e9e572f5fe4a4397e6e30749d2405f/users/9c37522d5d4b417196d185a8cefa0ca9/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:22.830443 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f813318-fd66-4f02-9d5c-8b87665cbbfb admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:22.937130 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b825d354-deb0-4cea-ae46-f594d60ad27b admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:22.942683 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba564aa-f735-4061-b468-23c81a1f4c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:22.943798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f813318-fd66-4f02-9d5c-8b87665cbbfb admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:22.943936 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba564aa-f735-4061-b468-23c81a1f4c1d admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:22.944230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba564aa-f735-4061-b468-23c81a1f4c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:22.944606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba564aa-f735-4061-b468-23c81a1f4c1d admin admin] PATH_INFO: `/v3/projects/1d08dd0f60474481a043fde52d6166be/users/79fd3a1c0c224ae4a659531f3931de9f/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:22.950287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cdf54-af2c-4090-b48e-4dc2fa78971d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:22.951014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cdf54-af2c-4090-b48e-4dc2fa78971d admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:22.951332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cdf54-af2c-4090-b48e-4dc2fa78971d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:22.951613 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036cdf54-af2c-4090-b48e-4dc2fa78971d admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:22.952331 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cdf54-af2c-4090-b48e-4dc2fa78971d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:22.955200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036cdf54-af2c-4090-b48e-4dc2fa78971d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:22.966623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba564aa-f735-4061-b468-23c81a1f4c1d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d08dd0f60474481a043fde52d6166be, user_id=79fd3a1c0c224ae4a659531f3931de9f, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:22.970260 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dba564aa-f735-4061-b468-23c81a1f4c1d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:23.120508 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 900/1782] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:22 2022] PUT /identity/v3/projects/1d08dd0f60474481a043fde52d6166be/users/79fd3a1c0c224ae4a659531f3931de9f/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:23.121634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba564aa-f735-4061-b468-23c81a1f4c1d admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:23.143862 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 883/1783] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:22 2022] POST /identity/v3/projects => generated 353 bytes in 313 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:23.148149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cdf54-af2c-4090-b48e-4dc2fa78971d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:23.305291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba564aa-f735-4061-b468-23c81a1f4c1d admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:23.351453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036cdf54-af2c-4090-b48e-4dc2fa78971d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:23.366443 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01554165-63f0-4026-b2a8-6f480eaac933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:23.368044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01554165-63f0-4026-b2a8-6f480eaac933 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:23.368509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01554165-63f0-4026-b2a8-6f480eaac933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:23.369477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01554165-63f0-4026-b2a8-6f480eaac933 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:23.371287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01554165-63f0-4026-b2a8-6f480eaac933 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:23.374778 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01554165-63f0-4026-b2a8-6f480eaac933 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:23.391777 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 884/1784] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:23.395871 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01554165-63f0-4026-b2a8-6f480eaac933 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:23.400425 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-01554165-63f0-4026-b2a8-6f480eaac933 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:23.426875 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8dfa46-bc95-44be-963c-ad24b6cb5013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:23.427995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dfa46-bc95-44be-963c-ad24b6cb5013 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:23.427995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dfa46-bc95-44be-963c-ad24b6cb5013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:23.428242 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8dfa46-bc95-44be-963c-ad24b6cb5013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:23.428969 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8dfa46-bc95-44be-963c-ad24b6cb5013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:23.431497 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8dfa46-bc95-44be-963c-ad24b6cb5013 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:23.444410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 901/1785] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:23.449090 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8dfa46-bc95-44be-963c-ad24b6cb5013 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:23.461841 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8dfa46-bc95-44be-963c-ad24b6cb5013 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:23.468092 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb41f2-586d-4aa5-84ab-397e42d3319f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:23.468778 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb41f2-586d-4aa5-84ab-397e42d3319f admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:23.469058 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb41f2-586d-4aa5-84ab-397e42d3319f admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:23.470456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfb41f2-586d-4aa5-84ab-397e42d3319f admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:23.471428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb41f2-586d-4aa5-84ab-397e42d3319f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:23.473393 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfb41f2-586d-4aa5-84ab-397e42d3319f admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:23.489833 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 902/1786] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:23.491293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb41f2-586d-4aa5-84ab-397e42d3319f admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:23.516583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfb41f2-586d-4aa5-84ab-397e42d3319f admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:23.523840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d092ac5d-c101-44a3-8ffd-bcf102f796c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:23.524697 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092ac5d-c101-44a3-8ffd-bcf102f796c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:23.525051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092ac5d-c101-44a3-8ffd-bcf102f796c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:23.525337 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d092ac5d-c101-44a3-8ffd-bcf102f796c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:23.526044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092ac5d-c101-44a3-8ffd-bcf102f796c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:23.529252 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d092ac5d-c101-44a3-8ffd-bcf102f796c1 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:23.582086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01554165-63f0-4026-b2a8-6f480eaac933 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:23.589243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4ff84-1b6e-4592-a23c-4032cf37e105 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0402e1bd20b042cdbdcb890616b22726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:23.589751 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:23.590730 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4ff84-1b6e-4592-a23c-4032cf37e105 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:23.591711 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4ff84-1b6e-4592-a23c-4032cf37e105 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:23.593057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f4ff84-1b6e-4592-a23c-4032cf37e105 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:23.667320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 903/1787] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:23 2022] POST /identity/v3/users => generated 283 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:23.669539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed2055-a99e-4d12-91c2-4e9d8e7e3002 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:23.670033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed2055-a99e-4d12-91c2-4e9d8e7e3002 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:23.672049 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ed2055-a99e-4d12-91c2-4e9d8e7e3002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:23.713223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4ff84-1b6e-4592-a23c-4032cf37e105 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:23.715075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f4ff84-1b6e-4592-a23c-4032cf37e105 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:23.722813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-01ed2055-a99e-4d12-91c2-4e9d8e7e3002 None None] MFA Rules not processed for user `c99418232a0848a1b7a1a73966928769`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:23.724362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-01ed2055-a99e-4d12-91c2-4e9d8e7e3002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:23.749111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 885/1788] 10.222.0.40 () {60 vars in 1384 bytes} [Fri Jul 15 19:37:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:37:23.749111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4ff84-1b6e-4592-a23c-4032cf37e105 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:23.784039 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f4ff84-1b6e-4592-a23c-4032cf37e105 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:23.795492 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dfafc-a603-4c1a-a976-5b028f69c0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:23.797140 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dfafc-a603-4c1a-a976-5b028f69c0ef admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:23.798459 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dfafc-a603-4c1a-a976-5b028f69c0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:23.799050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6dfafc-a603-4c1a-a976-5b028f69c0ef admin admin] PATH_INFO: `/v3/projects/87e9e572f5fe4a4397e6e30749d2405f/users/9c37522d5d4b417196d185a8cefa0ca9/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:23.813163 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dfafc-a603-4c1a-a976-5b028f69c0ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=87e9e572f5fe4a4397e6e30749d2405f, user_id=9c37522d5d4b417196d185a8cefa0ca9, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:23.819470 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6dfafc-a603-4c1a-a976-5b028f69c0ef admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:23.847198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 904/1789] 10.222.0.58 () {58 vars in 1015 bytes} [Fri Jul 15 19:37:23 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:23.848234 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed2055-a99e-4d12-91c2-4e9d8e7e3002 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:23.871069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 886/1790] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:23 2022] PUT /identity/v3/projects/87e9e572f5fe4a4397e6e30749d2405f/users/9c37522d5d4b417196d185a8cefa0ca9/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:23.889577 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dfafc-a603-4c1a-a976-5b028f69c0ef admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:23.893909 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ed2055-a99e-4d12-91c2-4e9d8e7e3002 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:23.989839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:24.053358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6dfafc-a603-4c1a-a976-5b028f69c0ef admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:24.060195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb8a8c-522b-4154-af50-dfaf5ea5df5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:24.062014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8a8c-522b-4154-af50-dfaf5ea5df5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:24.062460 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8a8c-522b-4154-af50-dfaf5ea5df5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:24.062933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fb8a8c-522b-4154-af50-dfaf5ea5df5c admin admin] PATH_INFO: `/v3/projects/1d08dd0f60474481a043fde52d6166be/users/79fd3a1c0c224ae4a659531f3931de9f/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:24.076111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb8a8c-522b-4154-af50-dfaf5ea5df5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d08dd0f60474481a043fde52d6166be, user_id=79fd3a1c0c224ae4a659531f3931de9f, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:24.080714 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fb8a8c-522b-4154-af50-dfaf5ea5df5c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:24.098027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 887/1791] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:23 2022] PUT /identity/v3/projects/1d08dd0f60474481a043fde52d6166be/users/79fd3a1c0c224ae4a659531f3931de9f/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:24.099381 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb8a8c-522b-4154-af50-dfaf5ea5df5c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:24.125584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f51e5f45-736a-407f-94b3-fb2e421c30dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:24.128629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e5f45-736a-407f-94b3-fb2e421c30dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:24.130115 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e5f45-736a-407f-94b3-fb2e421c30dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:24.130429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f51e5f45-736a-407f-94b3-fb2e421c30dd admin admin] PATH_INFO: `/v3/projects/a151768fb56d4fe9afaf5d798880035b/users/1d0d842a766348f99c8eb49393d01c0a/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:24.138185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e5f45-736a-407f-94b3-fb2e421c30dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a151768fb56d4fe9afaf5d798880035b, user_id=1d0d842a766348f99c8eb49393d01c0a, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:24.148324 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f51e5f45-736a-407f-94b3-fb2e421c30dd admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:24.181638 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 905/1792] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:23 2022] PUT /identity/v3/projects/a151768fb56d4fe9afaf5d798880035b/users/1d0d842a766348f99c8eb49393d01c0a/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 334 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:24.188953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb371a-5c2f-448d-bc1c-b7e0c5824044 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:24.189849 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb371a-5c2f-448d-bc1c-b7e0c5824044 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:24.190291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb371a-5c2f-448d-bc1c-b7e0c5824044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:24.299692 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-2feb371a-5c2f-448d-bc1c-b7e0c5824044 None None] MFA Rules not processed for user `9c37522d5d4b417196d185a8cefa0ca9`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:24.301059 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2feb371a-5c2f-448d-bc1c-b7e0c5824044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:24.343016 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fb8a8c-522b-4154-af50-dfaf5ea5df5c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:24.481730 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 906/1793] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:24 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:24.482964 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb371a-5c2f-448d-bc1c-b7e0c5824044 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:24.485532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82aa84c8-3dbd-44fc-92e1-2da6ed989982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:24.486259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa84c8-3dbd-44fc-92e1-2da6ed989982 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:24.486543 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa84c8-3dbd-44fc-92e1-2da6ed989982 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:24.486851 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82aa84c8-3dbd-44fc-92e1-2da6ed989982 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:24.487603 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa84c8-3dbd-44fc-92e1-2da6ed989982 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:24.499613 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82aa84c8-3dbd-44fc-92e1-2da6ed989982 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:24.521717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 888/1794] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:24 2022] GET /identity/v3/roles => generated 1420 bytes in 423 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:24.525653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745463f0-edb2-41cf-a185-0dc1e142c5a0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:24.525653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745463f0-edb2-41cf-a185-0dc1e142c5a0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:24.525653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745463f0-edb2-41cf-a185-0dc1e142c5a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:24.581763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-745463f0-edb2-41cf-a185-0dc1e142c5a0 None None] MFA Rules not processed for user `79fd3a1c0c224ae4a659531f3931de9f`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:24.583416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-745463f0-edb2-41cf-a185-0dc1e142c5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:24.663118 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb371a-5c2f-448d-bc1c-b7e0c5824044 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:24.678083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd446bca-7e2c-4839-8274-469791d209c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:24.678849 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd446bca-7e2c-4839-8274-469791d209c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:24.679159 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd446bca-7e2c-4839-8274-469791d209c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:24.679412 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd446bca-7e2c-4839-8274-469791d209c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:24.734905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd446bca-7e2c-4839-8274-469791d209c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:24.736410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd446bca-7e2c-4839-8274-469791d209c8 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:24.791361 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 907/1795] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:24.793015 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2ef9-2f80-4456-9ae2-98a5a5332550 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:24.793218 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2ef9-2f80-4456-9ae2-98a5a5332550 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:24.793501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7db2ef9-2f80-4456-9ae2-98a5a5332550 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:24.804013 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 889/1796] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:24 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:24.804939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745463f0-edb2-41cf-a185-0dc1e142c5a0 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:24.811717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-745463f0-edb2-41cf-a185-0dc1e142c5a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:24.852771 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745463f0-edb2-41cf-a185-0dc1e142c5a0 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:24.858084 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71ce63-d58a-4658-9bfb-dc5274459fc7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:24.859320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71ce63-d58a-4658-9bfb-dc5274459fc7 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:24.859759 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71ce63-d58a-4658-9bfb-dc5274459fc7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:24.862869 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b71ce63-d58a-4658-9bfb-dc5274459fc7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:24.879383 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71ce63-d58a-4658-9bfb-dc5274459fc7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:24.882226 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b71ce63-d58a-4658-9bfb-dc5274459fc7 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:24.890258 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a7db2ef9-2f80-4456-9ae2-98a5a5332550 None None] MFA Rules not processed for user `1d0d842a766348f99c8eb49393d01c0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:24.896015 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a7db2ef9-2f80-4456-9ae2-98a5a5332550 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:24.905248 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 890/1797] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:24.906280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71ce63-d58a-4658-9bfb-dc5274459fc7 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:24.914037 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5b71ce63-d58a-4658-9bfb-dc5274459fc7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:25.117683 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b71ce63-d58a-4658-9bfb-dc5274459fc7 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:25.160580 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787e9bc-6dd6-4bb6-97b5-90fac1e4094e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:25.163050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787e9bc-6dd6-4bb6-97b5-90fac1e4094e service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:25.164176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787e9bc-6dd6-4bb6-97b5-90fac1e4094e service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:25.164532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a787e9bc-6dd6-4bb6-97b5-90fac1e4094e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:25.193976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787e9bc-6dd6-4bb6-97b5-90fac1e4094e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:25.198325 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a787e9bc-6dd6-4bb6-97b5-90fac1e4094e service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:25.208470 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 908/1798] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 416 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:25.211174 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db2ef9-2f80-4456-9ae2-98a5a5332550 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:25.238774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 891/1799] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:25.355947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7db2ef9-2f80-4456-9ae2-98a5a5332550 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:25.355947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f60046-4ec9-43cc-920d-52b6acfeec8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:25.355947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f60046-4ec9-43cc-920d-52b6acfeec8d admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:25.355947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f60046-4ec9-43cc-920d-52b6acfeec8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:25.357744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f60046-4ec9-43cc-920d-52b6acfeec8d admin admin] PATH_INFO: `/v3/projects/e5b714a32ec646dd9804e2706fa4bf1c/users/9e9995b41de5423088e5272267655302/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:25.357744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f60046-4ec9-43cc-920d-52b6acfeec8d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b714a32ec646dd9804e2706fa4bf1c, user_id=9e9995b41de5423088e5272267655302, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:25.357744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f60046-4ec9-43cc-920d-52b6acfeec8d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:25.437498 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787e9bc-6dd6-4bb6-97b5-90fac1e4094e service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:25.453294 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a787e9bc-6dd6-4bb6-97b5-90fac1e4094e service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:25.468201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d396d-847d-4773-af25-418258d8e714 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:25.470336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d396d-847d-4773-af25-418258d8e714 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:25.472222 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d396d-847d-4773-af25-418258d8e714 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:25.472864 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4d396d-847d-4773-af25-418258d8e714 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:25.565055 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d396d-847d-4773-af25-418258d8e714 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:25.565055 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4d396d-847d-4773-af25-418258d8e714 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:25.603691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 892/1800] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:25 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:37:25.687665 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d396d-847d-4773-af25-418258d8e714 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:25.697640 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4d396d-847d-4773-af25-418258d8e714 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:25.702247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25de5de-f55e-483a-91a5-7bc04eeedf8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:25.704429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25de5de-f55e-483a-91a5-7bc04eeedf8b service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:25.704429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25de5de-f55e-483a-91a5-7bc04eeedf8b service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:25.704638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25de5de-f55e-483a-91a5-7bc04eeedf8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:25.716079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25de5de-f55e-483a-91a5-7bc04eeedf8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:25.717725 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25de5de-f55e-483a-91a5-7bc04eeedf8b service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:25.737196 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 909/1801] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:25 2022] PUT /identity/v3/projects/e5b714a32ec646dd9804e2706fa4bf1c/users/9e9995b41de5423088e5272267655302/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:25.740362 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 893/1802] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:25 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:37:25.750709 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f60046-4ec9-43cc-920d-52b6acfeec8d admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:25.886542 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f60046-4ec9-43cc-920d-52b6acfeec8d admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:25.891900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cbbea7-3290-4f4d-b004-4d90d890af6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:25.892703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbbea7-3290-4f4d-b004-4d90d890af6f admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:25.893072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbbea7-3290-4f4d-b004-4d90d890af6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:25.893384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cbbea7-3290-4f4d-b004-4d90d890af6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:25.894129 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbbea7-3290-4f4d-b004-4d90d890af6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:25.896215 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cbbea7-3290-4f4d-b004-4d90d890af6f admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:25.911135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 910/1803] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:25 2022] GET /identity/v3/roles => generated 1420 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:25.916171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25de5de-f55e-483a-91a5-7bc04eeedf8b service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:25.937134 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25de5de-f55e-483a-91a5-7bc04eeedf8b service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:25.954457 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8133f-54e4-48e9-a6a0-350de908093f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:25.956310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8133f-54e4-48e9-a6a0-350de908093f admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:25.956661 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8133f-54e4-48e9-a6a0-350de908093f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:25.957068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caf8133f-54e4-48e9-a6a0-350de908093f admin admin] PATH_INFO: `/v3/projects/e5b714a32ec646dd9804e2706fa4bf1c/users/9e9995b41de5423088e5272267655302/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:25.959873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8133f-54e4-48e9-a6a0-350de908093f admin admin] RBAC: Authorizing `identity:create_grant(project_id=e5b714a32ec646dd9804e2706fa4bf1c, user_id=9e9995b41de5423088e5272267655302, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:25.964040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caf8133f-54e4-48e9-a6a0-350de908093f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:25.979468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 894/1804] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:25 2022] PUT /identity/v3/projects/e5b714a32ec646dd9804e2706fa4bf1c/users/9e9995b41de5423088e5272267655302/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:25.998068 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e4207-6834-429e-a5fd-3c7e3fd5a41c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:25.999763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e4207-6834-429e-a5fd-3c7e3fd5a41c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:26.001748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07e4207-6834-429e-a5fd-3c7e3fd5a41c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:26.011831 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8133f-54e4-48e9-a6a0-350de908093f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:26.060499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a07e4207-6834-429e-a5fd-3c7e3fd5a41c None None] MFA Rules not processed for user `9e9995b41de5423088e5272267655302`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:26.076582 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a07e4207-6834-429e-a5fd-3c7e3fd5a41c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:26.174966 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caf8133f-54e4-48e9-a6a0-350de908093f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:26.187880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784b24d-3dd0-4c4a-8321-678e8a95cc4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:26.188638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784b24d-3dd0-4c4a-8321-678e8a95cc4d service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:26.189030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784b24d-3dd0-4c4a-8321-678e8a95cc4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:26.189355 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4784b24d-3dd0-4c4a-8321-678e8a95cc4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:26.252288 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 911/1805] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:25 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 263 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:26.315701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784b24d-3dd0-4c4a-8321-678e8a95cc4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:26.317485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4784b24d-3dd0-4c4a-8321-678e8a95cc4d service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:26.333568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 895/1806] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:26 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:26.370526 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e4207-6834-429e-a5fd-3c7e3fd5a41c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:26.384665 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07e4207-6834-429e-a5fd-3c7e3fd5a41c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:26.390509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dce2fdb-3d5a-4d0f-83c4-f5fa3dde0387 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:26.392052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce2fdb-3d5a-4d0f-83c4-f5fa3dde0387 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:26.392512 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce2fdb-3d5a-4d0f-83c4-f5fa3dde0387 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:26.393005 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dce2fdb-3d5a-4d0f-83c4-f5fa3dde0387 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:26.410476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce2fdb-3d5a-4d0f-83c4-f5fa3dde0387 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:26.412832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dce2fdb-3d5a-4d0f-83c4-f5fa3dde0387 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:26.438371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 912/1807] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:26 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:26.871731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:27.024194 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784b24d-3dd0-4c4a-8321-678e8a95cc4d service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:27.035928 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4784b24d-3dd0-4c4a-8321-678e8a95cc4d service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:27.040301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4152686-f36d-456d-8238-911e48c83d1a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:27.041501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4152686-f36d-456d-8238-911e48c83d1a service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:27.041962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4152686-f36d-456d-8238-911e48c83d1a service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:27.042392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4152686-f36d-456d-8238-911e48c83d1a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:27.212101 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4152686-f36d-456d-8238-911e48c83d1a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:27.213995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4152686-f36d-456d-8238-911e48c83d1a service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:27.274536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 896/1808] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:27 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 250 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:27.534154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:28.020760 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003feff-78b0-4469-b69f-8ae4a658f7fa None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:28.033073 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003feff-78b0-4469-b69f-8ae4a658f7fa None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:28.033073 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4003feff-78b0-4469-b69f-8ae4a658f7fa None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:28.033073 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 913/1809] 10.222.0.40 () {54 vars in 921 bytes} [Fri Jul 15 19:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:37:28.228172 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f4df6-9206-4449-a888-edee4d210781 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:28.228663 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f4df6-9206-4449-a888-edee4d210781 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:28.228972 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62f4df6-9206-4449-a888-edee4d210781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:28.270195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d62f4df6-9206-4449-a888-edee4d210781 None None] MFA Rules not processed for user `850a32e590154968bfbbfc404450b70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:28.271721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d62f4df6-9206-4449-a888-edee4d210781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:28.405183 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 897/1810] 10.222.0.40 () {58 vars in 1018 bytes} [Fri Jul 15 19:37:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:28.434960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f883057-7385-4b2d-982e-ad562972df36 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:28.435291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f883057-7385-4b2d-982e-ad562972df36 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:28.435657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f883057-7385-4b2d-982e-ad562972df36 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:28.437417 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 914/1811] 10.222.0.40 () {54 vars in 921 bytes} [Fri Jul 15 19:37:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:37:28.457039 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f782a-921f-4ac4-a25b-9275be0f596e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:28.457587 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f782a-921f-4ac4-a25b-9275be0f596e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:28.458192 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29f782a-921f-4ac4-a25b-9275be0f596e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:28.522231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b29f782a-921f-4ac4-a25b-9275be0f596e None None] MFA Rules not processed for user `850a32e590154968bfbbfc404450b70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:28.526906 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b29f782a-921f-4ac4-a25b-9275be0f596e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:28.547150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f883057-7385-4b2d-982e-ad562972df36 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:28.549621 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1f883057-7385-4b2d-982e-ad562972df36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:28.583996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f883057-7385-4b2d-982e-ad562972df36 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:28.594506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 898/1812] 10.222.0.40 () {58 vars in 1018 bytes} [Fri Jul 15 19:37:28 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:28.603096 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a69e2e-cc7f-4c1a-b08a-887c5765cd18 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:28.603096 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a69e2e-cc7f-4c1a-b08a-887c5765cd18 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:28.603096 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a69e2e-cc7f-4c1a-b08a-887c5765cd18 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:28.603096 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a69e2e-cc7f-4c1a-b08a-887c5765cd18 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:28.648700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a69e2e-cc7f-4c1a-b08a-887c5765cd18 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:28.659280 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a69e2e-cc7f-4c1a-b08a-887c5765cd18 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:28.722660 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 915/1813] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:37:28.832779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f782a-921f-4ac4-a25b-9275be0f596e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:28.834343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b29f782a-921f-4ac4-a25b-9275be0f596e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:28.878666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29f782a-921f-4ac4-a25b-9275be0f596e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:28.910024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabdc6e-da37-465b-b69c-10c7c89d0164 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:28.911009 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabdc6e-da37-465b-b69c-10c7c89d0164 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:28.911505 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabdc6e-da37-465b-b69c-10c7c89d0164 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:28.912035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaabdc6e-da37-465b-b69c-10c7c89d0164 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:28.930298 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabdc6e-da37-465b-b69c-10c7c89d0164 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:28.946986 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaabdc6e-da37-465b-b69c-10c7c89d0164 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:28.990198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 899/1814] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:28 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:28.997792 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:29.591495 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:29.693126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a69e2e-cc7f-4c1a-b08a-887c5765cd18 service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:29.725494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a69e2e-cc7f-4c1a-b08a-887c5765cd18 service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:29.743591 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b365e57-db49-4b27-853b-048c2c27ab2e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:29.743591 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365e57-db49-4b27-853b-048c2c27ab2e service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:29.743591 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365e57-db49-4b27-853b-048c2c27ab2e service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:29.743591 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b365e57-db49-4b27-853b-048c2c27ab2e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:29.748371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8b365e57-db49-4b27-853b-048c2c27ab2e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:29.910536 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b365e57-db49-4b27-853b-048c2c27ab2e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:29.912796 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b365e57-db49-4b27-853b-048c2c27ab2e service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:29.926580 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 916/1815] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:29 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:30.098031 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:30.419795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabdc6e-da37-465b-b69c-10c7c89d0164 service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:30.662728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaabdc6e-da37-465b-b69c-10c7c89d0164 service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:30.683696 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61c3786-6eff-4250-b187-d397d71ad60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:30.684982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c3786-6eff-4250-b187-d397d71ad60d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:30.685538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c3786-6eff-4250-b187-d397d71ad60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:30.686629 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61c3786-6eff-4250-b187-d397d71ad60d admin admin] PATH_INFO: `/v3/users/50be00913b7c42eea4f85d2981326fb6` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:30.688701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c3786-6eff-4250-b187-d397d71ad60d admin admin] RBAC: Authorizing `identity:delete_user(user_id=50be00913b7c42eea4f85d2981326fb6)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:30.691006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61c3786-6eff-4250-b187-d397d71ad60d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:30.792048 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b365e57-db49-4b27-853b-048c2c27ab2e service cinder] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:30.815769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b365e57-db49-4b27-853b-048c2c27ab2e service cinder] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:30.828177 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675e7d35-d085-474f-94cf-d68a3fc5d48c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:30.829069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e7d35-d085-474f-94cf-d68a3fc5d48c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:30.829355 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e7d35-d085-474f-94cf-d68a3fc5d48c admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:30.829636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675e7d35-d085-474f-94cf-d68a3fc5d48c admin admin] PATH_INFO: `/v3/users/75735451cc6e4ed0a70f7498a0ab71e4` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:30.833223 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e7d35-d085-474f-94cf-d68a3fc5d48c admin admin] RBAC: Authorizing `identity:delete_user(user_id=75735451cc6e4ed0a70f7498a0ab71e4)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:30.835322 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675e7d35-d085-474f-94cf-d68a3fc5d48c admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:31.004824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a61c3786-6eff-4250-b187-d397d71ad60d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50be00913b7c42eea4f85d2981326fb6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:31.033634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a61c3786-6eff-4250-b187-d397d71ad60d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50be00913b7c42eea4f85d2981326fb6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:31.035373 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a61c3786-6eff-4250-b187-d397d71ad60d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50be00913b7c42eea4f85d2981326fb6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:31.037142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a61c3786-6eff-4250-b187-d397d71ad60d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50be00913b7c42eea4f85d2981326fb6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:31.055886 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a61c3786-6eff-4250-b187-d397d71ad60d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50be00913b7c42eea4f85d2981326fb6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:31.144571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-675e7d35-d085-474f-94cf-d68a3fc5d48c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '75735451cc6e4ed0a70f7498a0ab71e4'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:31.145331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-675e7d35-d085-474f-94cf-d68a3fc5d48c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '75735451cc6e4ed0a70f7498a0ab71e4'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:31.155827 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 900/1816] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:30 2022] DELETE /identity/v3/users/50be00913b7c42eea4f85d2981326fb6 => generated 0 bytes in 736 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:31.174321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2981112-44ed-489b-9ed4-a178e570786a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:31.176554 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2981112-44ed-489b-9ed4-a178e570786a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:31.176554 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2981112-44ed-489b-9ed4-a178e570786a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:31.254175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-675e7d35-d085-474f-94cf-d68a3fc5d48c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '75735451cc6e4ed0a70f7498a0ab71e4'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:31.255354 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-675e7d35-d085-474f-94cf-d68a3fc5d48c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '75735451cc6e4ed0a70f7498a0ab71e4'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:31.285969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c2981112-44ed-489b-9ed4-a178e570786a None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:31.292534 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c2981112-44ed-489b-9ed4-a178e570786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:31.301257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-675e7d35-d085-474f-94cf-d68a3fc5d48c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '75735451cc6e4ed0a70f7498a0ab71e4'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:31.336171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:31.358724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 917/1817] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:30 2022] DELETE /identity/v3/users/75735451cc6e4ed0a70f7498a0ab71e4 => generated 0 bytes in 567 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:31.364705 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce69c33-81ce-4ffb-9531-df7c9f61a0c4 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:31.365814 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce69c33-81ce-4ffb-9531-df7c9f61a0c4 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:31.366245 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce69c33-81ce-4ffb-9531-df7c9f61a0c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:31.400278 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-2ce69c33-81ce-4ffb-9531-df7c9f61a0c4 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:31.417809 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2ce69c33-81ce-4ffb-9531-df7c9f61a0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:31.494866 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 901/1818] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:37:31.519385 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 918/1819] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:31.550444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2981112-44ed-489b-9ed4-a178e570786a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:31.552592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c2981112-44ed-489b-9ed4-a178e570786a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:31.576283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce69c33-81ce-4ffb-9531-df7c9f61a0c4 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:31.578291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2ce69c33-81ce-4ffb-9531-df7c9f61a0c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:31.745060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce69c33-81ce-4ffb-9531-df7c9f61a0c4 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:31.752128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2981112-44ed-489b-9ed4-a178e570786a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:31.756437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c234e-e91c-4a16-8380-ede10c96747d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:31.757802 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c234e-e91c-4a16-8380-ede10c96747d service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:31.758520 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c234e-e91c-4a16-8380-ede10c96747d service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:31.758823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15c234e-e91c-4a16-8380-ede10c96747d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:31.761196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58402b5-9003-4d5f-9fd7-261127523422 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:31.761855 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58402b5-9003-4d5f-9fd7-261127523422 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:31.762730 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58402b5-9003-4d5f-9fd7-261127523422 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:31.767358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58402b5-9003-4d5f-9fd7-261127523422 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:31.805054 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c234e-e91c-4a16-8380-ede10c96747d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:31.805054 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15c234e-e91c-4a16-8380-ede10c96747d service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:31.806033 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58402b5-9003-4d5f-9fd7-261127523422 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:31.812362 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58402b5-9003-4d5f-9fd7-261127523422 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:31.843397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 919/1820] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:31.849917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 902/1821] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:37:32.897070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:33.851820 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c234e-e91c-4a16-8380-ede10c96747d service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:33.853473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c15c234e-e91c-4a16-8380-ede10c96747d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:33.898358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15c234e-e91c-4a16-8380-ede10c96747d service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:33.924531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cc3f2-afca-4363-bd56-113a2070525d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:33.926053 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cc3f2-afca-4363-bd56-113a2070525d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:33.926521 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cc3f2-afca-4363-bd56-113a2070525d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:33.926992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8cc3f2-afca-4363-bd56-113a2070525d admin admin] PATH_INFO: `/v3/projects/d2438c77eb8d4c1bb999ca142e8084fa` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:33.932093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58402b5-9003-4d5f-9fd7-261127523422 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:33.934411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d58402b5-9003-4d5f-9fd7-261127523422 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:33.942728 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cc3f2-afca-4363-bd56-113a2070525d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2438c77eb8d4c1bb999ca142e8084fa)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:33.960591 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8cc3f2-afca-4363-bd56-113a2070525d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:33.981397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58402b5-9003-4d5f-9fd7-261127523422 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:33.999399 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d64f8-d266-47a3-86a0-e9ad76651c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:34.000893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d64f8-d266-47a3-86a0-e9ad76651c67 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:34.002471 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d64f8-d266-47a3-86a0-e9ad76651c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:34.003932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929d64f8-d266-47a3-86a0-e9ad76651c67 admin admin] PATH_INFO: `/v3/projects/7a90237915404fd796f3f3f0c643cafc` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:34.011337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d64f8-d266-47a3-86a0-e9ad76651c67 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7a90237915404fd796f3f3f0c643cafc)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:34.020828 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929d64f8-d266-47a3-86a0-e9ad76651c67 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:34.055021 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:34.264435 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6f8cc3f2-afca-4363-bd56-113a2070525d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2438c77eb8d4c1bb999ca142e8084fa', 'request_id': 'req-6f8cc3f2-afca-4363-bd56-113a2070525d'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:34.322939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-929d64f8-d266-47a3-86a0-e9ad76651c67 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7a90237915404fd796f3f3f0c643cafc', 'request_id': 'req-929d64f8-d266-47a3-86a0-e9ad76651c67'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:34.343804 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-929d64f8-d266-47a3-86a0-e9ad76651c67 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7a90237915404fd796f3f3f0c643cafc', 'request_id': 'req-929d64f8-d266-47a3-86a0-e9ad76651c67'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:34.366603 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-929d64f8-d266-47a3-86a0-e9ad76651c67 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7a90237915404fd796f3f3f0c643cafc', 'request_id': 'req-929d64f8-d266-47a3-86a0-e9ad76651c67'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:34.379133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6f8cc3f2-afca-4363-bd56-113a2070525d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2438c77eb8d4c1bb999ca142e8084fa', 'request_id': 'req-6f8cc3f2-afca-4363-bd56-113a2070525d'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:34.394050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6f8cc3f2-afca-4363-bd56-113a2070525d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2438c77eb8d4c1bb999ca142e8084fa', 'request_id': 'req-6f8cc3f2-afca-4363-bd56-113a2070525d'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:34.409599 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6f8cc3f2-afca-4363-bd56-113a2070525d admin admin] The token cache is being invalidate because project d2438c77eb8d4c1bb999ca142e8084fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:34.410649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6f8cc3f2-afca-4363-bd56-113a2070525d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:34.413192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6f8cc3f2-afca-4363-bd56-113a2070525d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:34.423059 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 920/1822] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:33 2022] DELETE /identity/v3/projects/d2438c77eb8d4c1bb999ca142e8084fa => generated 0 bytes in 568 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:34.424404 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cc3f2-afca-4363-bd56-113a2070525d admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:34.426043 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6f8cc3f2-afca-4363-bd56-113a2070525d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:34.519892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-929d64f8-d266-47a3-86a0-e9ad76651c67 admin admin] The token cache is being invalidate because project 7a90237915404fd796f3f3f0c643cafc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:34.520726 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-929d64f8-d266-47a3-86a0-e9ad76651c67 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:34.521930 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-929d64f8-d266-47a3-86a0-e9ad76651c67 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:34.526550 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 903/1823] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:33 2022] DELETE /identity/v3/projects/7a90237915404fd796f3f3f0c643cafc => generated 0 bytes in 595 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:37:34.532499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d64f8-d266-47a3-86a0-e9ad76651c67 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:34.535192 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-929d64f8-d266-47a3-86a0-e9ad76651c67 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:34.647093 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8cc3f2-afca-4363-bd56-113a2070525d admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:34.675684 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929d64f8-d266-47a3-86a0-e9ad76651c67 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:34.683334 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29c6ed-5b93-491c-9738-3630d338387d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:34.688143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29c6ed-5b93-491c-9738-3630d338387d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:34.688143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29c6ed-5b93-491c-9738-3630d338387d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:34.688143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb29c6ed-5b93-491c-9738-3630d338387d admin admin] PATH_INFO: `/v3/users/79fd3a1c0c224ae4a659531f3931de9f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:34.688143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29c6ed-5b93-491c-9738-3630d338387d admin admin] RBAC: Authorizing `identity:delete_user(user_id=79fd3a1c0c224ae4a659531f3931de9f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:34.701330 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb29c6ed-5b93-491c-9738-3630d338387d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:34.772269 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce6b69-4bfd-49a9-8c57-534501dd3228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:34.773419 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce6b69-4bfd-49a9-8c57-534501dd3228 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:34.774224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce6b69-4bfd-49a9-8c57-534501dd3228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:34.775428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dce6b69-4bfd-49a9-8c57-534501dd3228 admin admin] PATH_INFO: `/v3/users/9c37522d5d4b417196d185a8cefa0ca9` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:34.778094 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce6b69-4bfd-49a9-8c57-534501dd3228 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c37522d5d4b417196d185a8cefa0ca9)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:34.782452 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dce6b69-4bfd-49a9-8c57-534501dd3228 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:34.936884 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:35.003803 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-eb29c6ed-5b93-491c-9738-3630d338387d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79fd3a1c0c224ae4a659531f3931de9f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:35.066513 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-eb29c6ed-5b93-491c-9738-3630d338387d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79fd3a1c0c224ae4a659531f3931de9f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:35.071018 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-eb29c6ed-5b93-491c-9738-3630d338387d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79fd3a1c0c224ae4a659531f3931de9f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:35.073249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-eb29c6ed-5b93-491c-9738-3630d338387d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79fd3a1c0c224ae4a659531f3931de9f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:35.090625 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-eb29c6ed-5b93-491c-9738-3630d338387d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79fd3a1c0c224ae4a659531f3931de9f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:35.128855 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6dce6b69-4bfd-49a9-8c57-534501dd3228 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c37522d5d4b417196d185a8cefa0ca9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:35.131253 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6dce6b69-4bfd-49a9-8c57-534501dd3228 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c37522d5d4b417196d185a8cefa0ca9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:35.182493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 904/1824] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:34 2022] DELETE /identity/v3/users/79fd3a1c0c224ae4a659531f3931de9f => generated 0 bytes in 651 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:35.340603 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6dce6b69-4bfd-49a9-8c57-534501dd3228 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c37522d5d4b417196d185a8cefa0ca9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:35.341521 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6dce6b69-4bfd-49a9-8c57-534501dd3228 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c37522d5d4b417196d185a8cefa0ca9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:35.372663 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6dce6b69-4bfd-49a9-8c57-534501dd3228 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c37522d5d4b417196d185a8cefa0ca9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:35.412256 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 921/1825] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:34 2022] DELETE /identity/v3/users/9c37522d5d4b417196d185a8cefa0ca9 => generated 0 bytes in 988 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:35.609448 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29c6ed-5b93-491c-9738-3630d338387d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:35.610989 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-eb29c6ed-5b93-491c-9738-3630d338387d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:35.706433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb29c6ed-5b93-491c-9738-3630d338387d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:35.819270 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed216402-9b2a-4e54-98e7-e4967a4e82ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:35.820186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed216402-9b2a-4e54-98e7-e4967a4e82ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:35.820462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed216402-9b2a-4e54-98e7-e4967a4e82ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:35.820761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed216402-9b2a-4e54-98e7-e4967a4e82ff admin admin] PATH_INFO: `/v3/users/abb28b54349b42409831f0c78c05975a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:35.822345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed216402-9b2a-4e54-98e7-e4967a4e82ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=abb28b54349b42409831f0c78c05975a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:35.824180 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed216402-9b2a-4e54-98e7-e4967a4e82ff admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:36.136266 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ed216402-9b2a-4e54-98e7-e4967a4e82ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abb28b54349b42409831f0c78c05975a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:36.161939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ed216402-9b2a-4e54-98e7-e4967a4e82ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abb28b54349b42409831f0c78c05975a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:36.164186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ed216402-9b2a-4e54-98e7-e4967a4e82ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abb28b54349b42409831f0c78c05975a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:36.165790 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ed216402-9b2a-4e54-98e7-e4967a4e82ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abb28b54349b42409831f0c78c05975a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:36.196922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ed216402-9b2a-4e54-98e7-e4967a4e82ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abb28b54349b42409831f0c78c05975a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:36.210712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:36.380351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce6b69-4bfd-49a9-8c57-534501dd3228 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:36.389291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6dce6b69-4bfd-49a9-8c57-534501dd3228 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:36.409667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dce6b69-4bfd-49a9-8c57-534501dd3228 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:36.424166 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3e90a-17bc-4a4e-bffe-fef203e20364 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:36.430798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3e90a-17bc-4a4e-bffe-fef203e20364 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:36.434280 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3e90a-17bc-4a4e-bffe-fef203e20364 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:36.434904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e3e90a-17bc-4a4e-bffe-fef203e20364 admin admin] PATH_INFO: `/v3/projects/1d08dd0f60474481a043fde52d6166be` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:36.438156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3e90a-17bc-4a4e-bffe-fef203e20364 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d08dd0f60474481a043fde52d6166be)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:36.444364 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e3e90a-17bc-4a4e-bffe-fef203e20364 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:36.531523 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 905/1826] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:35 2022] DELETE /identity/v3/users/abb28b54349b42409831f0c78c05975a => generated 0 bytes in 911 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:37:36.534948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88baf64-6991-4a86-a029-e587e588c64a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:36.535244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88baf64-6991-4a86-a029-e587e588c64a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:36.535524 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f88baf64-6991-4a86-a029-e587e588c64a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:36.555297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f88baf64-6991-4a86-a029-e587e588c64a None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:36.556507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f88baf64-6991-4a86-a029-e587e588c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:36.620642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 906/1827] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:37:36.631194 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88baf64-6991-4a86-a029-e587e588c64a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:36.632680 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f88baf64-6991-4a86-a029-e587e588c64a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:36.694106 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f88baf64-6991-4a86-a029-e587e588c64a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:36.697780 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabaf1e-100c-4254-81ed-f467c3529c7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:36.698504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabaf1e-100c-4254-81ed-f467c3529c7c service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:36.698759 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabaf1e-100c-4254-81ed-f467c3529c7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:36.699056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddabaf1e-100c-4254-81ed-f467c3529c7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:36.708789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabaf1e-100c-4254-81ed-f467c3529c7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:36.714922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddabaf1e-100c-4254-81ed-f467c3529c7c service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:36.720746 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 907/1828] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:37:36.721607 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabaf1e-100c-4254-81ed-f467c3529c7c service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:36.723122 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ddabaf1e-100c-4254-81ed-f467c3529c7c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:36.736450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddabaf1e-100c-4254-81ed-f467c3529c7c service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:36.741345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cdf4af2-8876-4947-a622-4781f0154e0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:36.742207 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf4af2-8876-4947-a622-4781f0154e0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:36.742492 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf4af2-8876-4947-a622-4781f0154e0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:36.742796 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cdf4af2-8876-4947-a622-4781f0154e0a admin admin] PATH_INFO: `/v3/projects/87e9e572f5fe4a4397e6e30749d2405f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:36.743987 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf4af2-8876-4947-a622-4781f0154e0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=87e9e572f5fe4a4397e6e30749d2405f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:36.745953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cdf4af2-8876-4947-a622-4781f0154e0a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:36.805664 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f1e3e90a-17bc-4a4e-bffe-fef203e20364 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d08dd0f60474481a043fde52d6166be', 'request_id': 'req-f1e3e90a-17bc-4a4e-bffe-fef203e20364'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:36.906151 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5cdf4af2-8876-4947-a622-4781f0154e0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '87e9e572f5fe4a4397e6e30749d2405f', 'request_id': 'req-5cdf4af2-8876-4947-a622-4781f0154e0a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:36.912313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5cdf4af2-8876-4947-a622-4781f0154e0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '87e9e572f5fe4a4397e6e30749d2405f', 'request_id': 'req-5cdf4af2-8876-4947-a622-4781f0154e0a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:36.917332 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:36.917980 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f1e3e90a-17bc-4a4e-bffe-fef203e20364 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d08dd0f60474481a043fde52d6166be', 'request_id': 'req-f1e3e90a-17bc-4a4e-bffe-fef203e20364'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:36.918125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5cdf4af2-8876-4947-a622-4781f0154e0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '87e9e572f5fe4a4397e6e30749d2405f', 'request_id': 'req-5cdf4af2-8876-4947-a622-4781f0154e0a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:36.925758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f1e3e90a-17bc-4a4e-bffe-fef203e20364 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d08dd0f60474481a043fde52d6166be', 'request_id': 'req-f1e3e90a-17bc-4a4e-bffe-fef203e20364'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:36.936917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f1e3e90a-17bc-4a4e-bffe-fef203e20364 admin admin] The token cache is being invalidate because project 1d08dd0f60474481a043fde52d6166be was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:36.937210 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f1e3e90a-17bc-4a4e-bffe-fef203e20364 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:36.937943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f1e3e90a-17bc-4a4e-bffe-fef203e20364 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:36.939586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 922/1829] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:36 2022] DELETE /identity/v3/projects/1d08dd0f60474481a043fde52d6166be => generated 0 bytes in 560 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:36.940440 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3e90a-17bc-4a4e-bffe-fef203e20364 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:36.941746 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f1e3e90a-17bc-4a4e-bffe-fef203e20364 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:37.005345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e3e90a-17bc-4a4e-bffe-fef203e20364 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:37.022311 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5cdf4af2-8876-4947-a622-4781f0154e0a admin admin] The token cache is being invalidate because project 87e9e572f5fe4a4397e6e30749d2405f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:37.023035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5cdf4af2-8876-4947-a622-4781f0154e0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:37.027892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5cdf4af2-8876-4947-a622-4781f0154e0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:37.032040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 908/1830] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:36 2022] DELETE /identity/v3/projects/87e9e572f5fe4a4397e6e30749d2405f => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:37.034264 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b7f1-66f7-4b29-8786-c68989464269 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:37.034578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b7f1-66f7-4b29-8786-c68989464269 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:37.034948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae2b7f1-66f7-4b29-8786-c68989464269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:37.059256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1ae2b7f1-66f7-4b29-8786-c68989464269 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:37.060793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1ae2b7f1-66f7-4b29-8786-c68989464269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:37.061260 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c2ff75-1459-4dfd-977b-0f6890594650 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:37.061936 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2ff75-1459-4dfd-977b-0f6890594650 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:37.062274 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2ff75-1459-4dfd-977b-0f6890594650 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:37.062496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c2ff75-1459-4dfd-977b-0f6890594650 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:37.064447 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d0c2ff75-1459-4dfd-977b-0f6890594650 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:37.133187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2ff75-1459-4dfd-977b-0f6890594650 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:37.135202 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c2ff75-1459-4dfd-977b-0f6890594650 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:37.163047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 923/1831] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:37.166449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eacf9-6676-4970-b066-d8fbaed436a4 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:37.167062 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 909/1832] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:37.172791 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4ff3a-579f-41b8-8134-cd03cec9b1cf None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:37.173120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eacf9-6676-4970-b066-d8fbaed436a4 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:37.173429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7eacf9-6676-4970-b066-d8fbaed436a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:37.173787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4ff3a-579f-41b8-8134-cd03cec9b1cf None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:37.174189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba4ff3a-579f-41b8-8134-cd03cec9b1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:37.200315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2ba4ff3a-579f-41b8-8134-cd03cec9b1cf None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:37.202789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2ba4ff3a-579f-41b8-8134-cd03cec9b1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:37.208389 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-fe7eacf9-6676-4970-b066-d8fbaed436a4 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:37.209055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-fe7eacf9-6676-4970-b066-d8fbaed436a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:37.212655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 910/1833] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:37.216509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4ff3a-579f-41b8-8134-cd03cec9b1cf None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:37.226503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 924/1834] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:37.231303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba4ff3a-579f-41b8-8134-cd03cec9b1cf None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:37.239670 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e5146-0341-41b3-a414-f3a20de362f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:37.240340 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e5146-0341-41b3-a414-f3a20de362f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:37.240626 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e5146-0341-41b3-a414-f3a20de362f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:37.240803 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ea9f4-0e0c-4192-86ec-3cf68e05219c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:37.240921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79e5146-0341-41b3-a414-f3a20de362f8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:37.241623 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e5146-0341-41b3-a414-f3a20de362f8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:37:37.241818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ea9f4-0e0c-4192-86ec-3cf68e05219c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:37.241931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e5146-0341-41b3-a414-f3a20de362f8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:37.242155 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ea9f4-0e0c-4192-86ec-3cf68e05219c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:37.243642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d79e5146-0341-41b3-a414-f3a20de362f8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:37.262500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 911/1835] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:37:37.268918 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e5146-0341-41b3-a414-f3a20de362f8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:37.289696 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79e5146-0341-41b3-a414-f3a20de362f8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:37.293784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f80ea9f4-0e0c-4192-86ec-3cf68e05219c None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:37.299087 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f80ea9f4-0e0c-4192-86ec-3cf68e05219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:37.308200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e30bd9-90d6-47b5-93e6-ab9ab83ddc7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:37.308944 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e30bd9-90d6-47b5-93e6-ab9ab83ddc7f admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:37.309302 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e30bd9-90d6-47b5-93e6-ab9ab83ddc7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:37.309646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e30bd9-90d6-47b5-93e6-ab9ab83ddc7f admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:37.310529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e30bd9-90d6-47b5-93e6-ab9ab83ddc7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:37.312839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7e30bd9-90d6-47b5-93e6-ab9ab83ddc7f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:37.323715 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 925/1836] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:37.324594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ea9f4-0e0c-4192-86ec-3cf68e05219c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:37.326952 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f80ea9f4-0e0c-4192-86ec-3cf68e05219c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:37.341024 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ea9f4-0e0c-4192-86ec-3cf68e05219c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:37.346818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5f14e-67c0-43ab-a599-ff9da9db1aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:37.347699 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5f14e-67c0-43ab-a599-ff9da9db1aed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:37.348078 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5f14e-67c0-43ab-a599-ff9da9db1aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:37.348250 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e5f14e-67c0-43ab-a599-ff9da9db1aed admin admin] PATH_INFO: `/v3/projects/c2a278c318634c4385e754073f222058` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:37.350147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5f14e-67c0-43ab-a599-ff9da9db1aed admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2a278c318634c4385e754073f222058)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:37.352650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e5f14e-67c0-43ab-a599-ff9da9db1aed admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:37.519400 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 912/1837] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:37 2022] POST /identity/v3/projects => generated 369 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:37:37.520722 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e30bd9-90d6-47b5-93e6-ab9ab83ddc7f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:37.542423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-19e5f14e-67c0-43ab-a599-ff9da9db1aed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2a278c318634c4385e754073f222058', 'request_id': 'req-19e5f14e-67c0-43ab-a599-ff9da9db1aed'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:37.603501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e30bd9-90d6-47b5-93e6-ab9ab83ddc7f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:37.609273 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e99de4-c514-4804-b56b-1e934cd86e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:37.609971 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e99de4-c514-4804-b56b-1e934cd86e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:37.610259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e99de4-c514-4804-b56b-1e934cd86e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:37.610536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e99de4-c514-4804-b56b-1e934cd86e71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:37.611355 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e99de4-c514-4804-b56b-1e934cd86e71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:37:37.611663 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e99de4-c514-4804-b56b-1e934cd86e71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:37.613324 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e99de4-c514-4804-b56b-1e934cd86e71 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:37.629409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 913/1838] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:37:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:37:37.629409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e99de4-c514-4804-b56b-1e934cd86e71 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:37.637157 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e99de4-c514-4804-b56b-1e934cd86e71 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:37.642180 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f17c3-d266-4dd5-ab08-6f5b141ccb47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:37.642867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f17c3-d266-4dd5-ab08-6f5b141ccb47 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:37.643161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f17c3-d266-4dd5-ab08-6f5b141ccb47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:37.643429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2f17c3-d266-4dd5-ab08-6f5b141ccb47 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:37.644116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f17c3-d266-4dd5-ab08-6f5b141ccb47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:37.646116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2f17c3-d266-4dd5-ab08-6f5b141ccb47 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:37.679234 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-19e5f14e-67c0-43ab-a599-ff9da9db1aed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2a278c318634c4385e754073f222058', 'request_id': 'req-19e5f14e-67c0-43ab-a599-ff9da9db1aed'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:37.687687 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-19e5f14e-67c0-43ab-a599-ff9da9db1aed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2a278c318634c4385e754073f222058', 'request_id': 'req-19e5f14e-67c0-43ab-a599-ff9da9db1aed'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:37.698498 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-19e5f14e-67c0-43ab-a599-ff9da9db1aed admin admin] The token cache is being invalidate because project c2a278c318634c4385e754073f222058 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:37.698803 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-19e5f14e-67c0-43ab-a599-ff9da9db1aed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:37.699478 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-19e5f14e-67c0-43ab-a599-ff9da9db1aed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:37.701454 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 926/1839] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:37 2022] DELETE /identity/v3/projects/c2a278c318634c4385e754073f222058 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:37.702287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5f14e-67c0-43ab-a599-ff9da9db1aed admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:37.703792 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-19e5f14e-67c0-43ab-a599-ff9da9db1aed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:37.760135 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 914/1840] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:37 2022] POST /identity/v3/users => generated 285 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:37.761073 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f17c3-d266-4dd5-ab08-6f5b141ccb47 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:37.762660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cf2f17c3-d266-4dd5-ab08-6f5b141ccb47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:37.776118 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e5f14e-67c0-43ab-a599-ff9da9db1aed admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:37.777258 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2f17c3-d266-4dd5-ab08-6f5b141ccb47 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:37.781667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca55dc-9c1c-4e25-a085-7cd9f95ad89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:37.782429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca55dc-9c1c-4e25-a085-7cd9f95ad89a admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:37.782675 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca55dc-9c1c-4e25-a085-7cd9f95ad89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:37.783103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca55dc-9c1c-4e25-a085-7cd9f95ad89a admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:37.783806 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca55dc-9c1c-4e25-a085-7cd9f95ad89a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:37.784610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338886c3-c9fc-4441-846f-d052d4709af4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:37.785541 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338886c3-c9fc-4441-846f-d052d4709af4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:37.785833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338886c3-c9fc-4441-846f-d052d4709af4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:37.785941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ca55dc-9c1c-4e25-a085-7cd9f95ad89a admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:37.786115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338886c3-c9fc-4441-846f-d052d4709af4 admin admin] PATH_INFO: `/v3/users/e0d6ba12950d46be8e6995458c703589` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:37.787615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338886c3-c9fc-4441-846f-d052d4709af4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0d6ba12950d46be8e6995458c703589)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:37.789747 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-338886c3-c9fc-4441-846f-d052d4709af4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:37.888113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 927/1841] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:37 2022] POST /identity/v3/projects => generated 385 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:37.888113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca55dc-9c1c-4e25-a085-7cd9f95ad89a admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:37.890561 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-56ca55dc-9c1c-4e25-a085-7cd9f95ad89a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:37.970739 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca55dc-9c1c-4e25-a085-7cd9f95ad89a admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:37.975817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a190c74-d2c8-4d6d-b82b-226765a7f7dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:37.976499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a190c74-d2c8-4d6d-b82b-226765a7f7dd admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:37.976792 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a190c74-d2c8-4d6d-b82b-226765a7f7dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:37.977167 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a190c74-d2c8-4d6d-b82b-226765a7f7dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:37.977976 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a190c74-d2c8-4d6d-b82b-226765a7f7dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:37.979677 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a190c74-d2c8-4d6d-b82b-226765a7f7dd admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:37.990191 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 928/1842] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:37 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:37.991429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a190c74-d2c8-4d6d-b82b-226765a7f7dd admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:38.002518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a190c74-d2c8-4d6d-b82b-226765a7f7dd admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:38.007299 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8af1a7-f486-4c77-970c-a4f0549753de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:38.007930 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8af1a7-f486-4c77-970c-a4f0549753de admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:38.008208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8af1a7-f486-4c77-970c-a4f0549753de admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:38.008478 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8af1a7-f486-4c77-970c-a4f0549753de admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:38.009435 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8af1a7-f486-4c77-970c-a4f0549753de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:38.011363 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8af1a7-f486-4c77-970c-a4f0549753de admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:38.025568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-338886c3-c9fc-4441-846f-d052d4709af4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0d6ba12950d46be8e6995458c703589'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:38.039364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-338886c3-c9fc-4441-846f-d052d4709af4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0d6ba12950d46be8e6995458c703589'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:38.040364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-338886c3-c9fc-4441-846f-d052d4709af4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0d6ba12950d46be8e6995458c703589'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:38.042998 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-338886c3-c9fc-4441-846f-d052d4709af4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0d6ba12950d46be8e6995458c703589'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:38.051075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-338886c3-c9fc-4441-846f-d052d4709af4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0d6ba12950d46be8e6995458c703589'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:38.108181 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 929/1843] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:37 2022] POST /identity/v3/users => generated 293 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:38.109147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8af1a7-f486-4c77-970c-a4f0549753de admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:38.110726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3a8af1a7-f486-4c77-970c-a4f0549753de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:38.122664 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8af1a7-f486-4c77-970c-a4f0549753de admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:38.127653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab049980-f4af-426d-ab3d-fc7a41801506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:38.128331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab049980-f4af-426d-ab3d-fc7a41801506 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:38.128615 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab049980-f4af-426d-ab3d-fc7a41801506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:38.128890 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab049980-f4af-426d-ab3d-fc7a41801506 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:38.129653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab049980-f4af-426d-ab3d-fc7a41801506 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:38.131536 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab049980-f4af-426d-ab3d-fc7a41801506 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:38.143088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 930/1844] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:38.143935 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab049980-f4af-426d-ab3d-fc7a41801506 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:38.147725 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ab049980-f4af-426d-ab3d-fc7a41801506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:38.162385 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab049980-f4af-426d-ab3d-fc7a41801506 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:38.167296 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074766fe-4e30-404a-90d2-ff37478f47d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:38.167963 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074766fe-4e30-404a-90d2-ff37478f47d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:38.168244 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074766fe-4e30-404a-90d2-ff37478f47d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:38.168518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074766fe-4e30-404a-90d2-ff37478f47d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:38.169342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074766fe-4e30-404a-90d2-ff37478f47d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:38.171215 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074766fe-4e30-404a-90d2-ff37478f47d0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:38.181735 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 931/1845] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:38.182549 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074766fe-4e30-404a-90d2-ff37478f47d0 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:38.193115 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074766fe-4e30-404a-90d2-ff37478f47d0 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:38.198009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4b42dc-7449-403a-85c7-eaa3e34b4eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:38.198938 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b42dc-7449-403a-85c7-eaa3e34b4eb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:38.199247 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b42dc-7449-403a-85c7-eaa3e34b4eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:38.199489 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4b42dc-7449-403a-85c7-eaa3e34b4eb6 admin admin] PATH_INFO: `/v3/projects/2747a9c85c6345ae894087a35f17cc4f/users/60115b5768b046dba13996c87e5715d9/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:38.221318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b42dc-7449-403a-85c7-eaa3e34b4eb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2747a9c85c6345ae894087a35f17cc4f, user_id=60115b5768b046dba13996c87e5715d9, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:38.221935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 915/1846] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:37 2022] DELETE /identity/v3/users/e0d6ba12950d46be8e6995458c703589 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:38.222354 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4b42dc-7449-403a-85c7-eaa3e34b4eb6 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:38.222993 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338886c3-c9fc-4441-846f-d052d4709af4 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:38.294058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-338886c3-c9fc-4441-846f-d052d4709af4 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:38.299636 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315631a1-2126-40b3-9aab-0ca14e6a9752 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:38.300327 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315631a1-2126-40b3-9aab-0ca14e6a9752 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:38.300613 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315631a1-2126-40b3-9aab-0ca14e6a9752 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:38.300890 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315631a1-2126-40b3-9aab-0ca14e6a9752 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:38.301633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315631a1-2126-40b3-9aab-0ca14e6a9752 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:38.303481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-315631a1-2126-40b3-9aab-0ca14e6a9752 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:38.315342 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 916/1847] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:38 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:38.320119 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315631a1-2126-40b3-9aab-0ca14e6a9752 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:38.331422 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315631a1-2126-40b3-9aab-0ca14e6a9752 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:38.336364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fee73c-9024-4e4e-90ae-f80ad1f1a4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:38.337271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fee73c-9024-4e4e-90ae-f80ad1f1a4dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:38.337554 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fee73c-9024-4e4e-90ae-f80ad1f1a4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:38.337832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fee73c-9024-4e4e-90ae-f80ad1f1a4dd admin admin] PATH_INFO: `/v3/projects/b3ce034257b14b24ab66fcbea263101c/users/e2b9a6bf7ab5464fa587ec51a6afa693/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:38.353332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fee73c-9024-4e4e-90ae-f80ad1f1a4dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ce034257b14b24ab66fcbea263101c, user_id=e2b9a6bf7ab5464fa587ec51a6afa693, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:38.356068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fee73c-9024-4e4e-90ae-f80ad1f1a4dd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:38.376260 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 932/1848] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:38 2022] PUT /identity/v3/projects/2747a9c85c6345ae894087a35f17cc4f/users/60115b5768b046dba13996c87e5715d9/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:38.392301 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a72ea-5af9-455d-9ae4-c36c3160e751 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:38.392608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a72ea-5af9-455d-9ae4-c36c3160e751 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:38.392865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5a72ea-5af9-455d-9ae4-c36c3160e751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:38.431018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-6a5a72ea-5af9-455d-9ae4-c36c3160e751 None None] MFA Rules not processed for user `60115b5768b046dba13996c87e5715d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:38.432503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6a5a72ea-5af9-455d-9ae4-c36c3160e751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:38.504155 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 917/1849] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:38 2022] PUT /identity/v3/projects/b3ce034257b14b24ab66fcbea263101c/users/e2b9a6bf7ab5464fa587ec51a6afa693/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:37:38.506393 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 933/1850] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:38 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:37:38.510677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fee73c-9024-4e4e-90ae-f80ad1f1a4dd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:38.516595 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af0c6c-8707-46e4-af22-68806b68b055 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:38.516891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af0c6c-8707-46e4-af22-68806b68b055 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:38.517173 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84af0c6c-8707-46e4-af22-68806b68b055 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:38.547094 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-84af0c6c-8707-46e4-af22-68806b68b055 None None] MFA Rules not processed for user `e2b9a6bf7ab5464fa587ec51a6afa693`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:38.548249 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-84af0c6c-8707-46e4-af22-68806b68b055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:38.581757 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fee73c-9024-4e4e-90ae-f80ad1f1a4dd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:38.589108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3702e40-cc58-4e47-a9f0-86ea6a8ecf69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:38.589948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3702e40-cc58-4e47-a9f0-86ea6a8ecf69 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:38.590338 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3702e40-cc58-4e47-a9f0-86ea6a8ecf69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:38.590744 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3702e40-cc58-4e47-a9f0-86ea6a8ecf69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:38.591869 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3702e40-cc58-4e47-a9f0-86ea6a8ecf69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:38.593927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3702e40-cc58-4e47-a9f0-86ea6a8ecf69 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:38.637509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 934/1851] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:38.649091 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af0c6c-8707-46e4-af22-68806b68b055 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:38.650697 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-84af0c6c-8707-46e4-af22-68806b68b055 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:38.719924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84af0c6c-8707-46e4-af22-68806b68b055 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:38.728431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f83f4-4823-4ddc-a5d7-6841eec3ffe5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:38.728431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f83f4-4823-4ddc-a5d7-6841eec3ffe5 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:38.728431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f83f4-4823-4ddc-a5d7-6841eec3ffe5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:38.728431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499f83f4-4823-4ddc-a5d7-6841eec3ffe5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:38.741700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f83f4-4823-4ddc-a5d7-6841eec3ffe5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:38.743184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499f83f4-4823-4ddc-a5d7-6841eec3ffe5 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:38.753328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 935/1852] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:37:38.873061 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f83f4-4823-4ddc-a5d7-6841eec3ffe5 service cinder] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:38.873745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 918/1853] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:38 2022] POST /identity/v3/projects => generated 369 bytes in 359 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:38.873745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3702e40-cc58-4e47-a9f0-86ea6a8ecf69 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:38.874009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-499f83f4-4823-4ddc-a5d7-6841eec3ffe5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:38.889392 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499f83f4-4823-4ddc-a5d7-6841eec3ffe5 service cinder] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:38.952523 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb4af8cc-4a30-45bb-84e8-642e8fbd1b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:38.952891 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3702e40-cc58-4e47-a9f0-86ea6a8ecf69 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:38.953399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4af8cc-4a30-45bb-84e8-642e8fbd1b9e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:38.953691 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4af8cc-4a30-45bb-84e8-642e8fbd1b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:38.953972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb4af8cc-4a30-45bb-84e8-642e8fbd1b9e admin admin] PATH_INFO: `/v3/projects/e9ee6575e7664d2298d198c2d7710221` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:38.955261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4af8cc-4a30-45bb-84e8-642e8fbd1b9e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ee6575e7664d2298d198c2d7710221)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:38.957222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb4af8cc-4a30-45bb-84e8-642e8fbd1b9e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:38.958068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b6224-def3-4868-903f-9f3b55484db7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:38.958817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b6224-def3-4868-903f-9f3b55484db7 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:38.959129 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b6224-def3-4868-903f-9f3b55484db7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:38.959675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71b6224-def3-4868-903f-9f3b55484db7 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:38.960237 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b6224-def3-4868-903f-9f3b55484db7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:38.962258 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c71b6224-def3-4868-903f-9f3b55484db7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:39.063179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 919/1854] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:38 2022] POST /identity/v3/users => generated 291 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:39.064603 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b6224-def3-4868-903f-9f3b55484db7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:39.075002 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c71b6224-def3-4868-903f-9f3b55484db7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:39.080290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74367e-03b9-4eff-8414-ac8c41a43a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:39.081033 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74367e-03b9-4eff-8414-ac8c41a43a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:39.094202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74367e-03b9-4eff-8414-ac8c41a43a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:39.094701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae74367e-03b9-4eff-8414-ac8c41a43a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:39.095703 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74367e-03b9-4eff-8414-ac8c41a43a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:39.099417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae74367e-03b9-4eff-8414-ac8c41a43a09 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:39.104898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-bb4af8cc-4a30-45bb-84e8-642e8fbd1b9e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ee6575e7664d2298d198c2d7710221', 'request_id': 'req-bb4af8cc-4a30-45bb-84e8-642e8fbd1b9e'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:39.112623 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 920/1855] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:37:39.116952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74367e-03b9-4eff-8414-ac8c41a43a09 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:39.127950 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae74367e-03b9-4eff-8414-ac8c41a43a09 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:39.180952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:39.189223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f180f-c2ae-4ce7-b8e5-37bbd04c142d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:39.190112 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f180f-c2ae-4ce7-b8e5-37bbd04c142d admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:39.190395 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f180f-c2ae-4ce7-b8e5-37bbd04c142d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:39.190674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f180f-c2ae-4ce7-b8e5-37bbd04c142d admin admin] PATH_INFO: `/v3/projects/4cd07efd799547808acf5f1635e33a5f/users/1ddfa22545444ca8849cdb1facf00882/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:39.205136 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f180f-c2ae-4ce7-b8e5-37bbd04c142d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd07efd799547808acf5f1635e33a5f, user_id=1ddfa22545444ca8849cdb1facf00882, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:39.207878 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f180f-c2ae-4ce7-b8e5-37bbd04c142d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:39.210476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-bb4af8cc-4a30-45bb-84e8-642e8fbd1b9e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ee6575e7664d2298d198c2d7710221', 'request_id': 'req-bb4af8cc-4a30-45bb-84e8-642e8fbd1b9e'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:39.219673 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-bb4af8cc-4a30-45bb-84e8-642e8fbd1b9e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ee6575e7664d2298d198c2d7710221', 'request_id': 'req-bb4af8cc-4a30-45bb-84e8-642e8fbd1b9e'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:39.230245 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-bb4af8cc-4a30-45bb-84e8-642e8fbd1b9e admin admin] The token cache is being invalidate because project e9ee6575e7664d2298d198c2d7710221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:39.230535 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-bb4af8cc-4a30-45bb-84e8-642e8fbd1b9e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:39.231237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-bb4af8cc-4a30-45bb-84e8-642e8fbd1b9e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:39.233504 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 936/1856] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:38 2022] DELETE /identity/v3/projects/e9ee6575e7664d2298d198c2d7710221 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:37:39.238264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a251f-cc70-43a1-9416-929ed1b1f191 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:39.238636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a251f-cc70-43a1-9416-929ed1b1f191 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:39.239031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08a251f-cc70-43a1-9416-929ed1b1f191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:39.257615 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d08a251f-cc70-43a1-9416-929ed1b1f191 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:39.258834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d08a251f-cc70-43a1-9416-929ed1b1f191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:39.267766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 937/1857] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:37:39.277191 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6681a7d-eb7f-4156-8242-dcc905c1b0f8 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:39.277502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6681a7d-eb7f-4156-8242-dcc905c1b0f8 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:39.277783 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6681a7d-eb7f-4156-8242-dcc905c1b0f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:39.297724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-e6681a7d-eb7f-4156-8242-dcc905c1b0f8 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:39.301432 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 921/1858] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:39 2022] PUT /identity/v3/projects/4cd07efd799547808acf5f1635e33a5f/users/1ddfa22545444ca8849cdb1facf00882/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:39.301895 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e6681a7d-eb7f-4156-8242-dcc905c1b0f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:39.302113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f180f-c2ae-4ce7-b8e5-37bbd04c142d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:39.303884 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5c9f180f-c2ae-4ce7-b8e5-37bbd04c142d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:39.377793 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 938/1859] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:37:39.382485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6681a7d-eb7f-4156-8242-dcc905c1b0f8 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:39.384171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f180f-c2ae-4ce7-b8e5-37bbd04c142d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:39.389954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a9648-5e6c-4235-9cbf-44b61b5bc665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:39.390783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9648-5e6c-4235-9cbf-44b61b5bc665 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:39.392240 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9648-5e6c-4235-9cbf-44b61b5bc665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:39.392240 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9a9648-5e6c-4235-9cbf-44b61b5bc665 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:39.392572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a9648-5e6c-4235-9cbf-44b61b5bc665 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:39.392909 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6681a7d-eb7f-4156-8242-dcc905c1b0f8 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:39.394375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9a9648-5e6c-4235-9cbf-44b61b5bc665 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:39.399609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda98b7b-cc23-45db-8c9c-4157d97166af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:39.400769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda98b7b-cc23-45db-8c9c-4157d97166af admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:39.400769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda98b7b-cc23-45db-8c9c-4157d97166af admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:39.401128 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda98b7b-cc23-45db-8c9c-4157d97166af admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:39.402103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda98b7b-cc23-45db-8c9c-4157d97166af admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:37:39.402539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda98b7b-cc23-45db-8c9c-4157d97166af admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:39.404946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda98b7b-cc23-45db-8c9c-4157d97166af admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:39.406604 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 922/1860] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:37:39.411974 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a9648-5e6c-4235-9cbf-44b61b5bc665 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:39.418822 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 939/1861] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:37:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:37:39.423336 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:39.424563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9a9648-5e6c-4235-9cbf-44b61b5bc665 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:39.425020 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda98b7b-cc23-45db-8c9c-4157d97166af admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:39.431194 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ef17a1-2ed8-4994-8829-f5ca921e2d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:39.431194 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef17a1-2ed8-4994-8829-f5ca921e2d37 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:39.431194 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef17a1-2ed8-4994-8829-f5ca921e2d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:39.431539 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ef17a1-2ed8-4994-8829-f5ca921e2d37 admin admin] PATH_INFO: `/v3/projects/4cd07efd799547808acf5f1635e33a5f/users/1ddfa22545444ca8849cdb1facf00882/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:39.433873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef17a1-2ed8-4994-8829-f5ca921e2d37 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4cd07efd799547808acf5f1635e33a5f, user_id=1ddfa22545444ca8849cdb1facf00882, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:39.436847 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ef17a1-2ed8-4994-8829-f5ca921e2d37 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:39.438056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda98b7b-cc23-45db-8c9c-4157d97166af admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:39.444574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72293bd1-1c4d-400a-92a9-b340b501ab0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:39.445811 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72293bd1-1c4d-400a-92a9-b340b501ab0b admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:39.446200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72293bd1-1c4d-400a-92a9-b340b501ab0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:39.446581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72293bd1-1c4d-400a-92a9-b340b501ab0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:39.447696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72293bd1-1c4d-400a-92a9-b340b501ab0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:39.449576 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 923/1862] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:39 2022] PUT /identity/v3/projects/4cd07efd799547808acf5f1635e33a5f/users/1ddfa22545444ca8849cdb1facf00882/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:39.451803 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72293bd1-1c4d-400a-92a9-b340b501ab0b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:39.462988 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fd464-c5ec-4995-ac6a-9c2a30611abe None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:39.463327 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fd464-c5ec-4995-ac6a-9c2a30611abe None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:39.463686 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287fd464-c5ec-4995-ac6a-9c2a30611abe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:39.494112 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-287fd464-c5ec-4995-ac6a-9c2a30611abe None None] MFA Rules not processed for user `1ddfa22545444ca8849cdb1facf00882`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:39.495389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-287fd464-c5ec-4995-ac6a-9c2a30611abe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:39.568002 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 924/1863] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:39.630394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 940/1864] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:39 2022] POST /identity/v3/projects => generated 377 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:37:39.634097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fd464-c5ec-4995-ac6a-9c2a30611abe None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:39.697797 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287fd464-c5ec-4995-ac6a-9c2a30611abe None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:39.754427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c2b8e-a26d-4320-905c-9bca90c828f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:39.755156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c2b8e-a26d-4320-905c-9bca90c828f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:39.755377 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c2b8e-a26d-4320-905c-9bca90c828f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:39.755913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105c2b8e-a26d-4320-905c-9bca90c828f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:39.756905 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c2b8e-a26d-4320-905c-9bca90c828f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:39.759050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-105c2b8e-a26d-4320-905c-9bca90c828f7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:39.796002 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72293bd1-1c4d-400a-92a9-b340b501ab0b admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:39.797947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-72293bd1-1c4d-400a-92a9-b340b501ab0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:39.864716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 925/1865] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:39 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:39.871962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c2b8e-a26d-4320-905c-9bca90c828f7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:39.886394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72293bd1-1c4d-400a-92a9-b340b501ab0b admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:39.892003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b617341-309c-4cdc-8d49-ff22adbc9689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:39.893394 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-105c2b8e-a26d-4320-905c-9bca90c828f7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:39.894338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b617341-309c-4cdc-8d49-ff22adbc9689 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:39.894789 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b617341-309c-4cdc-8d49-ff22adbc9689 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:39.895544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b617341-309c-4cdc-8d49-ff22adbc9689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:39.906666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c0714-9ddf-4d17-9e65-3a41e8c7188a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:39.908737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c0714-9ddf-4d17-9e65-3a41e8c7188a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:39.909125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c0714-9ddf-4d17-9e65-3a41e8c7188a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:39.909630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c0714-9ddf-4d17-9e65-3a41e8c7188a admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:39.911267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c0714-9ddf-4d17-9e65-3a41e8c7188a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:39.916039 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c0714-9ddf-4d17-9e65-3a41e8c7188a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:39.938653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 926/1866] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:39.943643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c0714-9ddf-4d17-9e65-3a41e8c7188a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:39.959329 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c0714-9ddf-4d17-9e65-3a41e8c7188a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:39.965327 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c38de2-ace8-4219-ab6d-939c61e8bbd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:39.967090 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c38de2-ace8-4219-ab6d-939c61e8bbd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:39.968016 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c38de2-ace8-4219-ab6d-939c61e8bbd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:39.968574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c38de2-ace8-4219-ab6d-939c61e8bbd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:39.969572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c38de2-ace8-4219-ab6d-939c61e8bbd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:39.973479 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c38de2-ace8-4219-ab6d-939c61e8bbd7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:39.987139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 927/1867] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:40.001577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b617341-309c-4cdc-8d49-ff22adbc9689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:40.001965 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c38de2-ace8-4219-ab6d-939c61e8bbd7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:40.003122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b617341-309c-4cdc-8d49-ff22adbc9689 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:40.012409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c38de2-ace8-4219-ab6d-939c61e8bbd7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:40.015758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 941/1868] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:39 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 220 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:37:40.027216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93250a55-0232-411e-8d2a-e72973da4bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:40.027216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93250a55-0232-411e-8d2a-e72973da4bb4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:40.027216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93250a55-0232-411e-8d2a-e72973da4bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:40.027216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93250a55-0232-411e-8d2a-e72973da4bb4 admin admin] PATH_INFO: `/v3/projects/7f9bf3b737534df986af5f9ebd5b9654/users/ae5682d55b1e477783364752a7d1266d/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:40.044171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93250a55-0232-411e-8d2a-e72973da4bb4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7f9bf3b737534df986af5f9ebd5b9654, user_id=ae5682d55b1e477783364752a7d1266d, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:40.046906 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93250a55-0232-411e-8d2a-e72973da4bb4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:40.200370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 928/1869] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:40 2022] PUT /identity/v3/projects/7f9bf3b737534df986af5f9ebd5b9654/users/ae5682d55b1e477783364752a7d1266d/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:37:40.212598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e24d94-5054-4d4a-a7e4-37e1b6fbed77 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:40.213107 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e24d94-5054-4d4a-a7e4-37e1b6fbed77 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:40.213397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e24d94-5054-4d4a-a7e4-37e1b6fbed77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:40.245289 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-71e24d94-5054-4d4a-a7e4-37e1b6fbed77 None None] MFA Rules not processed for user `ae5682d55b1e477783364752a7d1266d`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:40.246784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-71e24d94-5054-4d4a-a7e4-37e1b6fbed77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:40.315292 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93250a55-0232-411e-8d2a-e72973da4bb4 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:40.353876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 942/1870] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:40.361917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e24d94-5054-4d4a-a7e4-37e1b6fbed77 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:40.393286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93250a55-0232-411e-8d2a-e72973da4bb4 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:40.397284 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d9b72-b226-4500-9d6b-b3e7e76ae414 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:40.397991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d9b72-b226-4500-9d6b-b3e7e76ae414 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:40.398356 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d9b72-b226-4500-9d6b-b3e7e76ae414 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:40.398899 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330d9b72-b226-4500-9d6b-b3e7e76ae414 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:40.400850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-330d9b72-b226-4500-9d6b-b3e7e76ae414 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:40.428907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e24d94-5054-4d4a-a7e4-37e1b6fbed77 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:40.433704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f69ab7-1ad5-4115-84be-cb11bad6ffaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:40.434370 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f69ab7-1ad5-4115-84be-cb11bad6ffaa admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:40.434714 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f69ab7-1ad5-4115-84be-cb11bad6ffaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:40.435005 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f69ab7-1ad5-4115-84be-cb11bad6ffaa admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:40.436286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f69ab7-1ad5-4115-84be-cb11bad6ffaa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:40.438285 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f69ab7-1ad5-4115-84be-cb11bad6ffaa admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:40.463712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d9b72-b226-4500-9d6b-b3e7e76ae414 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:40.465158 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-330d9b72-b226-4500-9d6b-b3e7e76ae414 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:40.474409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 929/1871] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:37:40.544233 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 943/1872] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:40 2022] POST /identity/v3/projects => generated 377 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:40.549924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d9b72-b226-4500-9d6b-b3e7e76ae414 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:40.573127 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330d9b72-b226-4500-9d6b-b3e7e76ae414 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:40.657435 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de6dff-6a48-41de-af7b-6b758a9f967c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:40.658119 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de6dff-6a48-41de-af7b-6b758a9f967c admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:40.660476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de6dff-6a48-41de-af7b-6b758a9f967c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:40.660476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5de6dff-6a48-41de-af7b-6b758a9f967c admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:40.660476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de6dff-6a48-41de-af7b-6b758a9f967c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:40.661832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5de6dff-6a48-41de-af7b-6b758a9f967c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:40.780471 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 930/1873] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:40 2022] POST /identity/v3/users => generated 295 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:37:40.782941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f69ab7-1ad5-4115-84be-cb11bad6ffaa admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:40.792647 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f69ab7-1ad5-4115-84be-cb11bad6ffaa admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:40.799042 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d784fc2-1945-4e11-ab43-375a7da4db6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:40.800245 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d784fc2-1945-4e11-ab43-375a7da4db6d admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:40.800660 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d784fc2-1945-4e11-ab43-375a7da4db6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:40.801232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d784fc2-1945-4e11-ab43-375a7da4db6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:40.802061 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d784fc2-1945-4e11-ab43-375a7da4db6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:40.803794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d784fc2-1945-4e11-ab43-375a7da4db6d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:40.815822 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 944/1874] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:40.820341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de6dff-6a48-41de-af7b-6b758a9f967c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:40.831769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5de6dff-6a48-41de-af7b-6b758a9f967c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:40.837206 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be687b4-0039-42c4-810d-58373bb224f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:40.838295 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be687b4-0039-42c4-810d-58373bb224f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:40.838666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be687b4-0039-42c4-810d-58373bb224f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:40.839083 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be687b4-0039-42c4-810d-58373bb224f0 admin admin] PATH_INFO: `/v3/projects/8bb56e7d90d04a60b0948ab02a0f0e96/users/ca40319f65954420b6cb1b7f57d6f9ea/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:40.861783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be687b4-0039-42c4-810d-58373bb224f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb56e7d90d04a60b0948ab02a0f0e96, user_id=ca40319f65954420b6cb1b7f57d6f9ea, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:40.864879 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be687b4-0039-42c4-810d-58373bb224f0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:40.989691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 931/1875] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:40 2022] PUT /identity/v3/projects/8bb56e7d90d04a60b0948ab02a0f0e96/users/ca40319f65954420b6cb1b7f57d6f9ea/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:40.993552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d784fc2-1945-4e11-ab43-375a7da4db6d admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:41.004527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d784fc2-1945-4e11-ab43-375a7da4db6d admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:41.076976 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02efe1a0-29a7-4538-8eae-beb0f8a7d305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:41.078224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efe1a0-29a7-4538-8eae-beb0f8a7d305 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:41.078224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efe1a0-29a7-4538-8eae-beb0f8a7d305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:41.078224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02efe1a0-29a7-4538-8eae-beb0f8a7d305 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:41.083818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efe1a0-29a7-4538-8eae-beb0f8a7d305 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:41.083818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02efe1a0-29a7-4538-8eae-beb0f8a7d305 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:41.091291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 945/1876] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:40 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:41.095924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be687b4-0039-42c4-810d-58373bb224f0 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:41.118864 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be687b4-0039-42c4-810d-58373bb224f0 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:41.121634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3d346-18cf-451f-8b57-7047bab9188e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:41.122701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3d346-18cf-451f-8b57-7047bab9188e admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:41.124108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3d346-18cf-451f-8b57-7047bab9188e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:41.124488 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f3d346-18cf-451f-8b57-7047bab9188e admin admin] PATH_INFO: `/v3/projects/8bb56e7d90d04a60b0948ab02a0f0e96/users/ca40319f65954420b6cb1b7f57d6f9ea/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:41.126716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3d346-18cf-451f-8b57-7047bab9188e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8bb56e7d90d04a60b0948ab02a0f0e96, user_id=ca40319f65954420b6cb1b7f57d6f9ea, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:41.131274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f3d346-18cf-451f-8b57-7047bab9188e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:41.152798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 932/1877] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:41 2022] PUT /identity/v3/projects/8bb56e7d90d04a60b0948ab02a0f0e96/users/ca40319f65954420b6cb1b7f57d6f9ea/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:41.159392 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953df99-1423-4dc2-b77a-f1979c7ca8ac None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:41.159742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953df99-1423-4dc2-b77a-f1979c7ca8ac None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:41.160034 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3953df99-1423-4dc2-b77a-f1979c7ca8ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:41.194886 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-3953df99-1423-4dc2-b77a-f1979c7ca8ac None None] MFA Rules not processed for user `ca40319f65954420b6cb1b7f57d6f9ea`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:41.197282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3953df99-1423-4dc2-b77a-f1979c7ca8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:41.281671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 946/1878] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:41 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:37:41.293396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3d346-18cf-451f-8b57-7047bab9188e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:41.382564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f3d346-18cf-451f-8b57-7047bab9188e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:41.382564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ed2eb-77d0-469b-9d0b-833256033e8e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:41.382564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed2eb-77d0-469b-9d0b-833256033e8e service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:41.382564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed2eb-77d0-469b-9d0b-833256033e8e service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:41.383449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026ed2eb-77d0-469b-9d0b-833256033e8e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:41.444597 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ed2eb-77d0-469b-9d0b-833256033e8e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:41.446013 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-026ed2eb-77d0-469b-9d0b-833256033e8e service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:41.455623 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 933/1879] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:42.879665 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:43.245282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:43.895889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953df99-1423-4dc2-b77a-f1979c7ca8ac None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:43.901275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3953df99-1423-4dc2-b77a-f1979c7ca8ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:43.979837 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3953df99-1423-4dc2-b77a-f1979c7ca8ac None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:43.985082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9649e67-de20-49f6-b273-b7e4db19ea2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:43.986012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9649e67-de20-49f6-b273-b7e4db19ea2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:43.986298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9649e67-de20-49f6-b273-b7e4db19ea2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:43.986595 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9649e67-de20-49f6-b273-b7e4db19ea2b admin admin] PATH_INFO: `/v3/users/fa5950bf32f54c889a07cafdb4179180` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:43.987923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9649e67-de20-49f6-b273-b7e4db19ea2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa5950bf32f54c889a07cafdb4179180)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:43.989808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9649e67-de20-49f6-b273-b7e4db19ea2b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:44.474353 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c9649e67-de20-49f6-b273-b7e4db19ea2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa5950bf32f54c889a07cafdb4179180'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:44.475517 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c9649e67-de20-49f6-b273-b7e4db19ea2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa5950bf32f54c889a07cafdb4179180'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:44.506592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ed2eb-77d0-469b-9d0b-833256033e8e service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:44.508146 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-026ed2eb-77d0-469b-9d0b-833256033e8e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:44.523273 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-026ed2eb-77d0-469b-9d0b-833256033e8e service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:44.527754 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0127171-3818-44b7-9032-bf317469d790 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:44.528993 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0127171-3818-44b7-9032-bf317469d790 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:44.529280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0127171-3818-44b7-9032-bf317469d790 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:44.529558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0127171-3818-44b7-9032-bf317469d790 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:44.536244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e0127171-3818-44b7-9032-bf317469d790 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:44.553603 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0127171-3818-44b7-9032-bf317469d790 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:44.555662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0127171-3818-44b7-9032-bf317469d790 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:44.567901 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 934/1880] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:44 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:37:44.599359 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c9649e67-de20-49f6-b273-b7e4db19ea2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa5950bf32f54c889a07cafdb4179180'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:44.600241 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c9649e67-de20-49f6-b273-b7e4db19ea2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa5950bf32f54c889a07cafdb4179180'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:44.618606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c9649e67-de20-49f6-b273-b7e4db19ea2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa5950bf32f54c889a07cafdb4179180'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:44.636590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 947/1881] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:43 2022] DELETE /identity/v3/users/fa5950bf32f54c889a07cafdb4179180 => generated 0 bytes in 742 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:44.641435 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b6427-4353-4627-b376-f321d75d0aaf None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:44.642009 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b6427-4353-4627-b376-f321d75d0aaf None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:44.642491 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b6427-4353-4627-b376-f321d75d0aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:44.665133 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6c3b6427-4353-4627-b376-f321d75d0aaf None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:44.666383 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6c3b6427-4353-4627-b376-f321d75d0aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:44.740865 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 935/1882] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:37:44.755314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9649e67-de20-49f6-b273-b7e4db19ea2b admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:44.757814 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c9649e67-de20-49f6-b273-b7e4db19ea2b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:44.828441 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9649e67-de20-49f6-b273-b7e4db19ea2b admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:44.833312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381417c-9cb2-4f27-9a86-91f8ff7bc9d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:44.833892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381417c-9cb2-4f27-9a86-91f8ff7bc9d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:44.834157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381417c-9cb2-4f27-9a86-91f8ff7bc9d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:44.834435 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5381417c-9cb2-4f27-9a86-91f8ff7bc9d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:44.844509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381417c-9cb2-4f27-9a86-91f8ff7bc9d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:44.845953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5381417c-9cb2-4f27-9a86-91f8ff7bc9d6 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:44.856381 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 948/1883] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:45.390566 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b6427-4353-4627-b376-f321d75d0aaf None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:45.392847 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6c3b6427-4353-4627-b376-f321d75d0aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:45.411999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b6427-4353-4627-b376-f321d75d0aaf None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:45.423459 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a357644e-3809-42af-bfd8-bc7585b3b978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:45.423819 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357644e-3809-42af-bfd8-bc7585b3b978 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:45.423819 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357644e-3809-42af-bfd8-bc7585b3b978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:45.424801 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a357644e-3809-42af-bfd8-bc7585b3b978 admin admin] PATH_INFO: `/v3/projects/891be9ba555c4de6a336f62c8b020fa4` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:45.427866 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357644e-3809-42af-bfd8-bc7585b3b978 admin admin] RBAC: Authorizing `identity:delete_project(project_id=891be9ba555c4de6a336f62c8b020fa4)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:45.432497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a357644e-3809-42af-bfd8-bc7585b3b978 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:45.635915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a357644e-3809-42af-bfd8-bc7585b3b978 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891be9ba555c4de6a336f62c8b020fa4', 'request_id': 'req-a357644e-3809-42af-bfd8-bc7585b3b978'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:45.643416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a357644e-3809-42af-bfd8-bc7585b3b978 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891be9ba555c4de6a336f62c8b020fa4', 'request_id': 'req-a357644e-3809-42af-bfd8-bc7585b3b978'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:45.650098 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a357644e-3809-42af-bfd8-bc7585b3b978 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891be9ba555c4de6a336f62c8b020fa4', 'request_id': 'req-a357644e-3809-42af-bfd8-bc7585b3b978'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:45.722901 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a357644e-3809-42af-bfd8-bc7585b3b978 admin admin] The token cache is being invalidate because project 891be9ba555c4de6a336f62c8b020fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:45.723573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a357644e-3809-42af-bfd8-bc7585b3b978 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:45.725202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a357644e-3809-42af-bfd8-bc7585b3b978 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:45.728483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 936/1884] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:45 2022] DELETE /identity/v3/projects/891be9ba555c4de6a336f62c8b020fa4 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:45.729720 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381417c-9cb2-4f27-9a86-91f8ff7bc9d6 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:45.743493 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5381417c-9cb2-4f27-9a86-91f8ff7bc9d6 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:45.814574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:45.835060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4df8e-e576-4ac1-9c57-96820deb918a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:45.837276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4df8e-e576-4ac1-9c57-96820deb918a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:45.837782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4df8e-e576-4ac1-9c57-96820deb918a admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:45.838140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f4df8e-e576-4ac1-9c57-96820deb918a admin admin] PATH_INFO: `/v3/users/bbbbc17bf28f4a5dbfd8bf59a2393aac` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:45.841028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4df8e-e576-4ac1-9c57-96820deb918a admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbbbc17bf28f4a5dbfd8bf59a2393aac)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:45.848863 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f4df8e-e576-4ac1-9c57-96820deb918a admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:45.898931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6567c-3f37-4fb0-a108-b451cd399300 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:45.899351 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6567c-3f37-4fb0-a108-b451cd399300 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:45.899700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec6567c-3f37-4fb0-a108-b451cd399300 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:45.901260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 937/1885] 10.222.0.40 () {54 vars in 921 bytes} [Fri Jul 15 19:37:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:37:45.911119 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49befc-081d-46f0-aaf3-9e57133e0aa5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:45.911411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49befc-081d-46f0-aaf3-9e57133e0aa5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:45.911728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f49befc-081d-46f0-aaf3-9e57133e0aa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:45.937002 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6f49befc-081d-46f0-aaf3-9e57133e0aa5 None None] MFA Rules not processed for user `850a32e590154968bfbbfc404450b70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:45.939066 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6f49befc-081d-46f0-aaf3-9e57133e0aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:46.010186 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:46.052639 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 938/1886] 10.222.0.40 () {58 vars in 1018 bytes} [Fri Jul 15 19:37:45 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:37:46.142739 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-44f4df8e-e576-4ac1-9c57-96820deb918a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbbbc17bf28f4a5dbfd8bf59a2393aac'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:46.144125 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-44f4df8e-e576-4ac1-9c57-96820deb918a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbbbc17bf28f4a5dbfd8bf59a2393aac'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:46.160193 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49befc-081d-46f0-aaf3-9e57133e0aa5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:46.162054 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6f49befc-081d-46f0-aaf3-9e57133e0aa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:46.177758 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f49befc-081d-46f0-aaf3-9e57133e0aa5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:46.183828 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdcf0c-684c-4fbc-93f7-93b28265114a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:46.184492 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdcf0c-684c-4fbc-93f7-93b28265114a service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:46.184777 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdcf0c-684c-4fbc-93f7-93b28265114a service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:46.185057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fdcf0c-684c-4fbc-93f7-93b28265114a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:46.186965 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-61fdcf0c-684c-4fbc-93f7-93b28265114a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:46.205942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdcf0c-684c-4fbc-93f7-93b28265114a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:46.207826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fdcf0c-684c-4fbc-93f7-93b28265114a service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:46.232040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 939/1887] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:46 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 73 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:37:46.360049 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-44f4df8e-e576-4ac1-9c57-96820deb918a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbbbc17bf28f4a5dbfd8bf59a2393aac'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:46.360956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-44f4df8e-e576-4ac1-9c57-96820deb918a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbbbc17bf28f4a5dbfd8bf59a2393aac'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:46.378421 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-44f4df8e-e576-4ac1-9c57-96820deb918a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbbbc17bf28f4a5dbfd8bf59a2393aac'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:46.392723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 949/1888] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:45 2022] DELETE /identity/v3/users/bbbbc17bf28f4a5dbfd8bf59a2393aac => generated 0 bytes in 663 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:47.130789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdcf0c-684c-4fbc-93f7-93b28265114a service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:47.132241 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-61fdcf0c-684c-4fbc-93f7-93b28265114a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:47.156453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fdcf0c-684c-4fbc-93f7-93b28265114a service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:47.262198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5339698-6c04-4688-88a3-a043fb927102 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:47.263111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5339698-6c04-4688-88a3-a043fb927102 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:47.263391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5339698-6c04-4688-88a3-a043fb927102 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:47.263664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5339698-6c04-4688-88a3-a043fb927102 admin admin] PATH_INFO: `/v3/projects/b23b4fb488de415c8e2edddc568f34e0` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:47.264957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5339698-6c04-4688-88a3-a043fb927102 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b23b4fb488de415c8e2edddc568f34e0)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:47.267109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5339698-6c04-4688-88a3-a043fb927102 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:47.476652 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c5339698-6c04-4688-88a3-a043fb927102 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b23b4fb488de415c8e2edddc568f34e0', 'request_id': 'req-c5339698-6c04-4688-88a3-a043fb927102'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:47.483661 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c5339698-6c04-4688-88a3-a043fb927102 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b23b4fb488de415c8e2edddc568f34e0', 'request_id': 'req-c5339698-6c04-4688-88a3-a043fb927102'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:47.493059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c5339698-6c04-4688-88a3-a043fb927102 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b23b4fb488de415c8e2edddc568f34e0', 'request_id': 'req-c5339698-6c04-4688-88a3-a043fb927102'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:47.570034 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c5339698-6c04-4688-88a3-a043fb927102 admin admin] The token cache is being invalidate because project b23b4fb488de415c8e2edddc568f34e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:47.574223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c5339698-6c04-4688-88a3-a043fb927102 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:47.574223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c5339698-6c04-4688-88a3-a043fb927102 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:47.574223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 940/1889] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:47 2022] DELETE /identity/v3/projects/b23b4fb488de415c8e2edddc568f34e0 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:47.576788 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4df8e-e576-4ac1-9c57-96820deb918a admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:47.588060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f4df8e-e576-4ac1-9c57-96820deb918a admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:47.648962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4c2b3-110c-418f-bc4c-cc6def3f884a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:47.649521 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4c2b3-110c-418f-bc4c-cc6def3f884a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:47.649811 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4c2b3-110c-418f-bc4c-cc6def3f884a admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:47.650090 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dc4c2b3-110c-418f-bc4c-cc6def3f884a admin admin] PATH_INFO: `/v3/users/1d0d842a766348f99c8eb49393d01c0a` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:47.651401 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4c2b3-110c-418f-bc4c-cc6def3f884a admin admin] RBAC: Authorizing `identity:delete_user(user_id=1d0d842a766348f99c8eb49393d01c0a)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:47.658169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dc4c2b3-110c-418f-bc4c-cc6def3f884a admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:47.901676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0dc4c2b3-110c-418f-bc4c-cc6def3f884a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1d0d842a766348f99c8eb49393d01c0a'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:47.902392 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0dc4c2b3-110c-418f-bc4c-cc6def3f884a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1d0d842a766348f99c8eb49393d01c0a'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:48.002033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0dc4c2b3-110c-418f-bc4c-cc6def3f884a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1d0d842a766348f99c8eb49393d01c0a'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:48.002698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0dc4c2b3-110c-418f-bc4c-cc6def3f884a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1d0d842a766348f99c8eb49393d01c0a'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:48.016193 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0dc4c2b3-110c-418f-bc4c-cc6def3f884a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1d0d842a766348f99c8eb49393d01c0a'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:48.028829 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 950/1890] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:47 2022] DELETE /identity/v3/users/1d0d842a766348f99c8eb49393d01c0a => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:48.385697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:48.542071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:48.687282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5339698-6c04-4688-88a3-a043fb927102 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:48.693202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c5339698-6c04-4688-88a3-a043fb927102 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:48.713691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5339698-6c04-4688-88a3-a043fb927102 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:48.822128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe587dc-6c0f-4f4e-9dca-d1b66de2adb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:48.823076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe587dc-6c0f-4f4e-9dca-d1b66de2adb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:48.823363 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe587dc-6c0f-4f4e-9dca-d1b66de2adb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:48.823815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe587dc-6c0f-4f4e-9dca-d1b66de2adb0 admin admin] PATH_INFO: `/v3/projects/a151768fb56d4fe9afaf5d798880035b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:48.826514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe587dc-6c0f-4f4e-9dca-d1b66de2adb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a151768fb56d4fe9afaf5d798880035b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:48.831510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe587dc-6c0f-4f4e-9dca-d1b66de2adb0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:48.908750 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4c2b3-110c-418f-bc4c-cc6def3f884a admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:48.912148 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0dc4c2b3-110c-418f-bc4c-cc6def3f884a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:48.935055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dc4c2b3-110c-418f-bc4c-cc6def3f884a admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:48.944018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deda631-5130-4a46-823c-db17830ca84d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:48.945780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deda631-5130-4a46-823c-db17830ca84d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:48.946384 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deda631-5130-4a46-823c-db17830ca84d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:48.947103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deda631-5130-4a46-823c-db17830ca84d admin admin] PATH_INFO: `/v3/users/60115b5768b046dba13996c87e5715d9` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:48.949696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deda631-5130-4a46-823c-db17830ca84d admin admin] RBAC: Authorizing `identity:delete_user(user_id=60115b5768b046dba13996c87e5715d9)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:48.955834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deda631-5130-4a46-823c-db17830ca84d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:48.994225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4fe587dc-6c0f-4f4e-9dca-d1b66de2adb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a151768fb56d4fe9afaf5d798880035b', 'request_id': 'req-4fe587dc-6c0f-4f4e-9dca-d1b66de2adb0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:49.014624 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4fe587dc-6c0f-4f4e-9dca-d1b66de2adb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a151768fb56d4fe9afaf5d798880035b', 'request_id': 'req-4fe587dc-6c0f-4f4e-9dca-d1b66de2adb0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:49.026006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4fe587dc-6c0f-4f4e-9dca-d1b66de2adb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a151768fb56d4fe9afaf5d798880035b', 'request_id': 'req-4fe587dc-6c0f-4f4e-9dca-d1b66de2adb0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:49.109198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4fe587dc-6c0f-4f4e-9dca-d1b66de2adb0 admin admin] The token cache is being invalidate because project a151768fb56d4fe9afaf5d798880035b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:49.110185 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4fe587dc-6c0f-4f4e-9dca-d1b66de2adb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:49.111204 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4fe587dc-6c0f-4f4e-9dca-d1b66de2adb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:49.113761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 941/1891] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:48 2022] DELETE /identity/v3/projects/a151768fb56d4fe9afaf5d798880035b => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:49.120235 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac19f4-8d6e-41fc-8116-ff2910749728 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:49.120526 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac19f4-8d6e-41fc-8116-ff2910749728 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:49.120843 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eac19f4-8d6e-41fc-8116-ff2910749728 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:49.139835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8eac19f4-8d6e-41fc-8116-ff2910749728 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:49.141575 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8eac19f4-8d6e-41fc-8116-ff2910749728 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:49.199901 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 942/1892] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:49.208769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97569f04-2c98-4807-ad9b-153f6d3d8e15 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:49.209078 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97569f04-2c98-4807-ad9b-153f6d3d8e15 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:49.209356 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97569f04-2c98-4807-ad9b-153f6d3d8e15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:49.228144 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-97569f04-2c98-4807-ad9b-153f6d3d8e15 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:49.229346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-97569f04-2c98-4807-ad9b-153f6d3d8e15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:49.237469 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 943/1893] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:37:49.241792 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97569f04-2c98-4807-ad9b-153f6d3d8e15 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:49.250505 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97569f04-2c98-4807-ad9b-153f6d3d8e15 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:49.255825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428216e-3398-45ca-af75-d0be0d971f01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:49.256474 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428216e-3398-45ca-af75-d0be0d971f01 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:49.256752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428216e-3398-45ca-af75-d0be0d971f01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:49.256854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-1deda631-5130-4a46-823c-db17830ca84d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60115b5768b046dba13996c87e5715d9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:49.257026 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e428216e-3398-45ca-af75-d0be0d971f01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:49.257422 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-1deda631-5130-4a46-823c-db17830ca84d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60115b5768b046dba13996c87e5715d9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:49.257754 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428216e-3398-45ca-af75-d0be0d971f01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:37:49.258057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428216e-3398-45ca-af75-d0be0d971f01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:49.259702 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e428216e-3398-45ca-af75-d0be0d971f01 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:49.271975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 944/1894] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:37:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:37:49.276962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428216e-3398-45ca-af75-d0be0d971f01 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:49.278243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e428216e-3398-45ca-af75-d0be0d971f01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:49.291745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e428216e-3398-45ca-af75-d0be0d971f01 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:49.297693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8047051-942e-4f9e-a669-9c19eb70e3da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:49.299339 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8047051-942e-4f9e-a669-9c19eb70e3da admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:49.299643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8047051-942e-4f9e-a669-9c19eb70e3da admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:49.299981 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8047051-942e-4f9e-a669-9c19eb70e3da admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:49.300684 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8047051-942e-4f9e-a669-9c19eb70e3da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:49.302612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8047051-942e-4f9e-a669-9c19eb70e3da admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:49.424502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-1deda631-5130-4a46-823c-db17830ca84d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60115b5768b046dba13996c87e5715d9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:49.425291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-1deda631-5130-4a46-823c-db17830ca84d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60115b5768b046dba13996c87e5715d9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:49.441525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-1deda631-5130-4a46-823c-db17830ca84d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60115b5768b046dba13996c87e5715d9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:49.457649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 951/1895] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:48 2022] DELETE /identity/v3/users/60115b5768b046dba13996c87e5715d9 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:49.457649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deda631-5130-4a46-823c-db17830ca84d admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:49.457649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1deda631-5130-4a46-823c-db17830ca84d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:49.516971 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 945/1896] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:49 2022] POST /identity/v3/projects => generated 391 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:37:49.520229 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c830c6-74b3-43a9-9cc9-b979e1335abc None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:49.521240 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c830c6-74b3-43a9-9cc9-b979e1335abc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:49.521240 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c830c6-74b3-43a9-9cc9-b979e1335abc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:49.533283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deda631-5130-4a46-823c-db17830ca84d admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:49.541964 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-81c830c6-74b3-43a9-9cc9-b979e1335abc None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:49.543445 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-81c830c6-74b3-43a9-9cc9-b979e1335abc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:49.605453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d5a98-8837-4dce-92bf-f57061b56623 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:49.606327 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d5a98-8837-4dce-92bf-f57061b56623 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:49.606615 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d5a98-8837-4dce-92bf-f57061b56623 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:49.606933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d5a98-8837-4dce-92bf-f57061b56623 admin admin] PATH_INFO: `/v3/users/e2b9a6bf7ab5464fa587ec51a6afa693` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:49.608112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d5a98-8837-4dce-92bf-f57061b56623 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2b9a6bf7ab5464fa587ec51a6afa693)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:49.610912 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d5a98-8837-4dce-92bf-f57061b56623 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:49.613215 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 946/1897] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:49.614059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c830c6-74b3-43a9-9cc9-b979e1335abc None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:49.624054 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c830c6-74b3-43a9-9cc9-b979e1335abc None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:49.629490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9287c77-a512-44ad-9f1b-71674245ec1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:49.630163 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9287c77-a512-44ad-9f1b-71674245ec1e admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:49.630743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9287c77-a512-44ad-9f1b-71674245ec1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:49.631060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9287c77-a512-44ad-9f1b-71674245ec1e admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:49.631767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9287c77-a512-44ad-9f1b-71674245ec1e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:49.633716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9287c77-a512-44ad-9f1b-71674245ec1e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:49.782426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 947/1898] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:49 2022] POST /identity/v3/users => generated 296 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:49.783547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9287c77-a512-44ad-9f1b-71674245ec1e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:49.785583 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e9287c77-a512-44ad-9f1b-71674245ec1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:49.853124 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-ac1d5a98-8837-4dce-92bf-f57061b56623 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2b9a6bf7ab5464fa587ec51a6afa693'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:49.854229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-ac1d5a98-8837-4dce-92bf-f57061b56623 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2b9a6bf7ab5464fa587ec51a6afa693'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:49.871691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9287c77-a512-44ad-9f1b-71674245ec1e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:49.878386 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9d0b3-4234-4dec-93c7-6ab663c55148 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:49.883748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9d0b3-4234-4dec-93c7-6ab663c55148 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:49.884250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9d0b3-4234-4dec-93c7-6ab663c55148 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:49.884553 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b9d0b3-4234-4dec-93c7-6ab663c55148 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:49.886985 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f8b9d0b3-4234-4dec-93c7-6ab663c55148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:49.901256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9d0b3-4234-4dec-93c7-6ab663c55148 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:49.902974 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8b9d0b3-4234-4dec-93c7-6ab663c55148 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:49.916734 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 948/1899] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:49.917641 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9d0b3-4234-4dec-93c7-6ab663c55148 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:49.924643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f8b9d0b3-4234-4dec-93c7-6ab663c55148 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:49.940997 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8b9d0b3-4234-4dec-93c7-6ab663c55148 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:49.949264 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5a8e0-1bf7-402c-be4b-bed0e40fd6f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:49.950184 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5a8e0-1bf7-402c-be4b-bed0e40fd6f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:49.950294 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5a8e0-1bf7-402c-be4b-bed0e40fd6f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:49.951290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a5a8e0-1bf7-402c-be4b-bed0e40fd6f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:49.952062 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5a8e0-1bf7-402c-be4b-bed0e40fd6f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:49.954460 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a5a8e0-1bf7-402c-be4b-bed0e40fd6f3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:49.958055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-ac1d5a98-8837-4dce-92bf-f57061b56623 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2b9a6bf7ab5464fa587ec51a6afa693'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:49.959912 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-ac1d5a98-8837-4dce-92bf-f57061b56623 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2b9a6bf7ab5464fa587ec51a6afa693'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:49.969131 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 949/1900] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:49.973162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5a8e0-1bf7-402c-be4b-bed0e40fd6f3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:49.982078 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-ac1d5a98-8837-4dce-92bf-f57061b56623 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2b9a6bf7ab5464fa587ec51a6afa693'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:49.999399 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a5a8e0-1bf7-402c-be4b-bed0e40fd6f3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:50.001568 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 952/1901] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:49 2022] DELETE /identity/v3/users/e2b9a6bf7ab5464fa587ec51a6afa693 => generated 0 bytes in 546 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:50.002994 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d5a98-8837-4dce-92bf-f57061b56623 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:50.005318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ac1d5a98-8837-4dce-92bf-f57061b56623 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:50.091272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f296edad-d7f7-4588-b39f-0633b567cc9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:50.092523 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296edad-d7f7-4588-b39f-0633b567cc9d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:50.092812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296edad-d7f7-4588-b39f-0633b567cc9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:50.093189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f296edad-d7f7-4588-b39f-0633b567cc9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:50.095217 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d5a98-8837-4dce-92bf-f57061b56623 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:50.095837 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296edad-d7f7-4588-b39f-0633b567cc9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:50.098231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f296edad-d7f7-4588-b39f-0633b567cc9d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:50.102182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d8445-9708-4107-a7e6-103dbd738797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:50.103426 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d8445-9708-4107-a7e6-103dbd738797 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:50.103889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d8445-9708-4107-a7e6-103dbd738797 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:50.104311 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4d8445-9708-4107-a7e6-103dbd738797 admin admin] PATH_INFO: `/v3/users/ae5682d55b1e477783364752a7d1266d` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:50.105816 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d8445-9708-4107-a7e6-103dbd738797 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae5682d55b1e477783364752a7d1266d)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:50.108061 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4d8445-9708-4107-a7e6-103dbd738797 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:50.118541 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 950/1902] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:49 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:50.118541 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd7be2-3d52-4885-a760-e4748d7dc746 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:50.118541 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd7be2-3d52-4885-a760-e4748d7dc746 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:50.118541 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccd7be2-3d52-4885-a760-e4748d7dc746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:50.138391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fccd7be2-3d52-4885-a760-e4748d7dc746 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:50.141585 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fccd7be2-3d52-4885-a760-e4748d7dc746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:50.148456 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 951/1903] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:50.151829 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd7be2-3d52-4885-a760-e4748d7dc746 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:50.159730 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccd7be2-3d52-4885-a760-e4748d7dc746 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:50.164339 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee004570-a11a-4a53-b958-a2f11cb24d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:50.165234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004570-a11a-4a53-b958-a2f11cb24d69 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:50.165536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004570-a11a-4a53-b958-a2f11cb24d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:50.165791 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee004570-a11a-4a53-b958-a2f11cb24d69 admin admin] PATH_INFO: `/v3/projects/f40136e9baa1404ba612c059f459bded/users/f7b24819c4d346e993cbeac41bd29bc7/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:50.181808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee004570-a11a-4a53-b958-a2f11cb24d69 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f40136e9baa1404ba612c059f459bded, user_id=f7b24819c4d346e993cbeac41bd29bc7, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:50.186507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee004570-a11a-4a53-b958-a2f11cb24d69 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:50.331890 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 952/1904] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:50 2022] PUT /identity/v3/projects/f40136e9baa1404ba612c059f459bded/users/f7b24819c4d346e993cbeac41bd29bc7/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:50.333459 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee004570-a11a-4a53-b958-a2f11cb24d69 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:50.335458 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ee004570-a11a-4a53-b958-a2f11cb24d69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:50.363642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-9c4d8445-9708-4107-a7e6-103dbd738797 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae5682d55b1e477783364752a7d1266d'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:50.364321 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-9c4d8445-9708-4107-a7e6-103dbd738797 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae5682d55b1e477783364752a7d1266d'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:50.410877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee004570-a11a-4a53-b958-a2f11cb24d69 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:50.415084 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23341179-7426-4c47-9b57-0bfca2afe88c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:50.415804 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23341179-7426-4c47-9b57-0bfca2afe88c service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:50.416094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23341179-7426-4c47-9b57-0bfca2afe88c service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:50.416369 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23341179-7426-4c47-9b57-0bfca2afe88c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:50.418277 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-23341179-7426-4c47-9b57-0bfca2afe88c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:50.458358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:50.498964 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-9c4d8445-9708-4107-a7e6-103dbd738797 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae5682d55b1e477783364752a7d1266d'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:50.499271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23341179-7426-4c47-9b57-0bfca2afe88c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:50.499271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23341179-7426-4c47-9b57-0bfca2afe88c service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:50.501170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-9c4d8445-9708-4107-a7e6-103dbd738797 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae5682d55b1e477783364752a7d1266d'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:50.511524 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 953/1905] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:50.512918 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642f17b-37c5-43cf-99c5-419f53224f25 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:50.513204 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642f17b-37c5-43cf-99c5-419f53224f25 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:50.513478 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0642f17b-37c5-43cf-99c5-419f53224f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:50.519991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-9c4d8445-9708-4107-a7e6-103dbd738797 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae5682d55b1e477783364752a7d1266d'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:50.557284 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 953/1906] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:50 2022] DELETE /identity/v3/users/ae5682d55b1e477783364752a7d1266d => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:50.558638 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d8445-9708-4107-a7e6-103dbd738797 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:50.565229 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0642f17b-37c5-43cf-99c5-419f53224f25 None None] MFA Rules not processed for user `f7b24819c4d346e993cbeac41bd29bc7`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:50.565735 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9c4d8445-9708-4107-a7e6-103dbd738797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:50.565868 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0642f17b-37c5-43cf-99c5-419f53224f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:50.619979 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:50.646404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 954/1907] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:50 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:50.646404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16c976-0f3b-4860-a9f0-88ac9d2da0f3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:50.646404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16c976-0f3b-4860-a9f0-88ac9d2da0f3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:50.646404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d16c976-0f3b-4860-a9f0-88ac9d2da0f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:50.665743 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4d8445-9708-4107-a7e6-103dbd738797 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:50.665951 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9d16c976-0f3b-4860-a9f0-88ac9d2da0f3 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:50.667106 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9d16c976-0f3b-4860-a9f0-88ac9d2da0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:50.670601 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4020cc-c87a-4815-969c-f32155d7a68f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:50.671729 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4020cc-c87a-4815-969c-f32155d7a68f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:50.672775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4020cc-c87a-4815-969c-f32155d7a68f admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:50.673055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4020cc-c87a-4815-969c-f32155d7a68f admin admin] PATH_INFO: `/v3/projects/2747a9c85c6345ae894087a35f17cc4f` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:50.674316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4020cc-c87a-4815-969c-f32155d7a68f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2747a9c85c6345ae894087a35f17cc4f)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:50.679073 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 955/1908] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:50.679230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4020cc-c87a-4815-969c-f32155d7a68f admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:50.679357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16c976-0f3b-4860-a9f0-88ac9d2da0f3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:50.679357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9d16c976-0f3b-4860-a9f0-88ac9d2da0f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:50.691964 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d16c976-0f3b-4860-a9f0-88ac9d2da0f3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:50.700537 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89c1cf-6a6e-49ce-a4b2-2210fd5e9b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:50.701826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89c1cf-6a6e-49ce-a4b2-2210fd5e9b47 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:50.702038 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89c1cf-6a6e-49ce-a4b2-2210fd5e9b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:50.702311 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c89c1cf-6a6e-49ce-a4b2-2210fd5e9b47 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:50.703642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89c1cf-6a6e-49ce-a4b2-2210fd5e9b47 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:50.706435 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c89c1cf-6a6e-49ce-a4b2-2210fd5e9b47 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:50.810241 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4d4020cc-c87a-4815-969c-f32155d7a68f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2747a9c85c6345ae894087a35f17cc4f', 'request_id': 'req-4d4020cc-c87a-4815-969c-f32155d7a68f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:50.891193 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 956/1909] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:50 2022] POST /identity/v3/projects => generated 391 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:50.894393 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89c1cf-6a6e-49ce-a4b2-2210fd5e9b47 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:50.896684 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9c89c1cf-6a6e-49ce-a4b2-2210fd5e9b47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:50.933613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4d4020cc-c87a-4815-969c-f32155d7a68f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2747a9c85c6345ae894087a35f17cc4f', 'request_id': 'req-4d4020cc-c87a-4815-969c-f32155d7a68f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:50.943153 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4d4020cc-c87a-4815-969c-f32155d7a68f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2747a9c85c6345ae894087a35f17cc4f', 'request_id': 'req-4d4020cc-c87a-4815-969c-f32155d7a68f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:50.955108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4d4020cc-c87a-4815-969c-f32155d7a68f admin admin] The token cache is being invalidate because project 2747a9c85c6345ae894087a35f17cc4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:50.955720 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4d4020cc-c87a-4815-969c-f32155d7a68f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:50.956715 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4d4020cc-c87a-4815-969c-f32155d7a68f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:50.961697 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 954/1910] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:50 2022] DELETE /identity/v3/projects/2747a9c85c6345ae894087a35f17cc4f => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:50.963262 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4020cc-c87a-4815-969c-f32155d7a68f admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:50.965369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4d4020cc-c87a-4815-969c-f32155d7a68f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:50.998924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c89c1cf-6a6e-49ce-a4b2-2210fd5e9b47 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:51.004597 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d8542-8558-415d-b0ee-93c7933b3368 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:51.005261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d8542-8558-415d-b0ee-93c7933b3368 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:51.005800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d8542-8558-415d-b0ee-93c7933b3368 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:51.006196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837d8542-8558-415d-b0ee-93c7933b3368 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:51.009788 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-837d8542-8558-415d-b0ee-93c7933b3368 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:51.054195 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4020cc-c87a-4815-969c-f32155d7a68f admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:51.117776 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d8542-8558-415d-b0ee-93c7933b3368 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:51.119271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837d8542-8558-415d-b0ee-93c7933b3368 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:51.122175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9e395-6de3-46e3-8221-30b9c5071ae2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:51.122894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9e395-6de3-46e3-8221-30b9c5071ae2 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:51.123236 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9e395-6de3-46e3-8221-30b9c5071ae2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:51.123572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe9e395-6de3-46e3-8221-30b9c5071ae2 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:51.124414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9e395-6de3-46e3-8221-30b9c5071ae2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:51.126391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe9e395-6de3-46e3-8221-30b9c5071ae2 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:51.131327 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 957/1911] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 238 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:51.132299 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d8542-8558-415d-b0ee-93c7933b3368 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:51.135908 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-837d8542-8558-415d-b0ee-93c7933b3368 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:51.148934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837d8542-8558-415d-b0ee-93c7933b3368 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:51.157231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39174423-32b6-4287-b404-70f921f27cdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:51.158142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39174423-32b6-4287-b404-70f921f27cdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:51.159873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39174423-32b6-4287-b404-70f921f27cdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:51.159873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39174423-32b6-4287-b404-70f921f27cdf admin admin] PATH_INFO: `/v3/users/1ddfa22545444ca8849cdb1facf00882` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:51.160035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39174423-32b6-4287-b404-70f921f27cdf admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ddfa22545444ca8849cdb1facf00882)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:51.161886 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39174423-32b6-4287-b404-70f921f27cdf admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:51.355286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 955/1912] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:50 2022] POST /identity/v3/users => generated 302 bytes in 389 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:51.355286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9e395-6de3-46e3-8221-30b9c5071ae2 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:51.356944 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-7fe9e395-6de3-46e3-8221-30b9c5071ae2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:51.369368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe9e395-6de3-46e3-8221-30b9c5071ae2 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:51.374393 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:51.375344 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:51.375628 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:51.375905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9 admin admin] PATH_INFO: `/v3/projects/b3ce034257b14b24ab66fcbea263101c` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:51.378113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ce034257b14b24ab66fcbea263101c)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:51.379124 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:51.566502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ce034257b14b24ab66fcbea263101c', 'request_id': 'req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:51.569098 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-39174423-32b6-4287-b404-70f921f27cdf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ddfa22545444ca8849cdb1facf00882'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:51.586531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-39174423-32b6-4287-b404-70f921f27cdf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ddfa22545444ca8849cdb1facf00882'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:51.587403 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-39174423-32b6-4287-b404-70f921f27cdf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ddfa22545444ca8849cdb1facf00882'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:51.588017 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-39174423-32b6-4287-b404-70f921f27cdf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ddfa22545444ca8849cdb1facf00882'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:51.596672 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-39174423-32b6-4287-b404-70f921f27cdf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ddfa22545444ca8849cdb1facf00882'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:51.661790 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ce034257b14b24ab66fcbea263101c', 'request_id': 'req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:51.669389 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ce034257b14b24ab66fcbea263101c', 'request_id': 'req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:51.680548 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9 admin admin] The token cache is being invalidate because project b3ce034257b14b24ab66fcbea263101c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:51.681023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:51.681697 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:51.683325 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 956/1913] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:51 2022] DELETE /identity/v3/projects/b3ce034257b14b24ab66fcbea263101c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:51.686785 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:51.686785 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:51.759373 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 958/1914] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:51 2022] DELETE /identity/v3/users/1ddfa22545444ca8849cdb1facf00882 => generated 0 bytes in 624 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:51.761310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730572b-23c6-4403-ac90-6a9f19bac311 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:51.761856 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730572b-23c6-4403-ac90-6a9f19bac311 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:51.762241 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e730572b-23c6-4403-ac90-6a9f19bac311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:51.790621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e730572b-23c6-4403-ac90-6a9f19bac311 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:51.792498 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e730572b-23c6-4403-ac90-6a9f19bac311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:51.807254 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef9d6a-9748-40eb-8508-97ec2d8300b9 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:51.904164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 959/1915] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:51.907705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730572b-23c6-4403-ac90-6a9f19bac311 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:51.912957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e730572b-23c6-4403-ac90-6a9f19bac311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:51.934210 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e730572b-23c6-4403-ac90-6a9f19bac311 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:51.941719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bba0a-bc14-428c-b82c-a90afaa22c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:51.942681 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bba0a-bc14-428c-b82c-a90afaa22c36 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:51.943092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bba0a-bc14-428c-b82c-a90afaa22c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:51.943438 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e4bba0a-bc14-428c-b82c-a90afaa22c36 admin admin] PATH_INFO: `/v3/projects/7f9bf3b737534df986af5f9ebd5b9654` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:51.944817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4bba0a-bc14-428c-b82c-a90afaa22c36 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7f9bf3b737534df986af5f9ebd5b9654)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:51.947659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e4bba0a-bc14-428c-b82c-a90afaa22c36 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:51.982699 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1046f37f-acea-4fea-b7b4-e4da860cc430 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:51.983421 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046f37f-acea-4fea-b7b4-e4da860cc430 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:51.983711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046f37f-acea-4fea-b7b4-e4da860cc430 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:51.984060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1046f37f-acea-4fea-b7b4-e4da860cc430 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:51.984871 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046f37f-acea-4fea-b7b4-e4da860cc430 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:51.986644 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1046f37f-acea-4fea-b7b4-e4da860cc430 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:52.002033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 957/1916] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:51 2022] GET /identity/v3/roles => generated 1420 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:52.002033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f4e48-4dca-4e73-9df8-e973b4648308 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:52.002033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f4e48-4dca-4e73-9df8-e973b4648308 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:52.002033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185f4e48-4dca-4e73-9df8-e973b4648308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:52.022605 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-185f4e48-4dca-4e73-9df8-e973b4648308 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:52.023898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-185f4e48-4dca-4e73-9df8-e973b4648308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:52.033081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 958/1917] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:52.033967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f4e48-4dca-4e73-9df8-e973b4648308 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:52.044056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185f4e48-4dca-4e73-9df8-e973b4648308 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:52.049842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c52c1-5536-448d-a4ce-8acbb9bf5f27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:52.050743 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c52c1-5536-448d-a4ce-8acbb9bf5f27 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:52.051050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c52c1-5536-448d-a4ce-8acbb9bf5f27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:52.051318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28c52c1-5536-448d-a4ce-8acbb9bf5f27 admin admin] PATH_INFO: `/v3/projects/01d89c8f546e433f83dd38fe2192cc0e/users/39c63d48ff3d4dafa59289b329651a51/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:52.087927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c52c1-5536-448d-a4ce-8acbb9bf5f27 admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d89c8f546e433f83dd38fe2192cc0e, user_id=39c63d48ff3d4dafa59289b329651a51, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:52.090982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28c52c1-5536-448d-a4ce-8acbb9bf5f27 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:52.215914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 959/1918] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:52 2022] PUT /identity/v3/projects/01d89c8f546e433f83dd38fe2192cc0e/users/39c63d48ff3d4dafa59289b329651a51/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:52.215914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c52c1-5536-448d-a4ce-8acbb9bf5f27 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:52.236340 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3e4bba0a-bc14-428c-b82c-a90afaa22c36 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f9bf3b737534df986af5f9ebd5b9654', 'request_id': 'req-3e4bba0a-bc14-428c-b82c-a90afaa22c36'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:52.261843 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3e4bba0a-bc14-428c-b82c-a90afaa22c36 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f9bf3b737534df986af5f9ebd5b9654', 'request_id': 'req-3e4bba0a-bc14-428c-b82c-a90afaa22c36'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:52.270141 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3e4bba0a-bc14-428c-b82c-a90afaa22c36 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f9bf3b737534df986af5f9ebd5b9654', 'request_id': 'req-3e4bba0a-bc14-428c-b82c-a90afaa22c36'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:52.299358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28c52c1-5536-448d-a4ce-8acbb9bf5f27 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:52.354805 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3e4bba0a-bc14-428c-b82c-a90afaa22c36 admin admin] The token cache is being invalidate because project 7f9bf3b737534df986af5f9ebd5b9654 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:52.355081 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3e4bba0a-bc14-428c-b82c-a90afaa22c36 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:52.356129 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3e4bba0a-bc14-428c-b82c-a90afaa22c36 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:52.358365 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 960/1919] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:51 2022] DELETE /identity/v3/projects/7f9bf3b737534df986af5f9ebd5b9654 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:52.363054 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bba0a-bc14-428c-b82c-a90afaa22c36 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:52.364706 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3e4bba0a-bc14-428c-b82c-a90afaa22c36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:52.383584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af9dd1-cc6a-4c1f-b160-2a0215412910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:52.384592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af9dd1-cc6a-4c1f-b160-2a0215412910 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:52.384731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af9dd1-cc6a-4c1f-b160-2a0215412910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:52.384972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10af9dd1-cc6a-4c1f-b160-2a0215412910 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:52.385943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af9dd1-cc6a-4c1f-b160-2a0215412910 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:37:52.386182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af9dd1-cc6a-4c1f-b160-2a0215412910 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:52.387828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10af9dd1-cc6a-4c1f-b160-2a0215412910 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:52.400305 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 960/1920] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:37:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:37:52.401204 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af9dd1-cc6a-4c1f-b160-2a0215412910 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:52.402912 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-10af9dd1-cc6a-4c1f-b160-2a0215412910 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:52.426935 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10af9dd1-cc6a-4c1f-b160-2a0215412910 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:52.432771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4747de3-b412-434d-bc6e-591bbbf0f490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:52.433815 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4747de3-b412-434d-bc6e-591bbbf0f490 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:52.434105 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4747de3-b412-434d-bc6e-591bbbf0f490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:52.434378 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4747de3-b412-434d-bc6e-591bbbf0f490 admin admin] PATH_INFO: `/v3/users/36180caaca57435b87a586f2f66f5517` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:52.435772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4747de3-b412-434d-bc6e-591bbbf0f490 admin admin] RBAC: Authorizing `identity:delete_user(user_id=36180caaca57435b87a586f2f66f5517)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:52.438358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4747de3-b412-434d-bc6e-591bbbf0f490 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:52.479415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e4bba0a-bc14-428c-b82c-a90afaa22c36 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:52.486277 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8983c-1bb7-40aa-85d0-8301812cb28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:52.487800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8983c-1bb7-40aa-85d0-8301812cb28c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:52.488087 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8983c-1bb7-40aa-85d0-8301812cb28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:52.488413 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d8983c-1bb7-40aa-85d0-8301812cb28c admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:52.490196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8983c-1bb7-40aa-85d0-8301812cb28c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:52.492330 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d8983c-1bb7-40aa-85d0-8301812cb28c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:52.515893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 961/1921] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:52 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:52.515893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8983c-1bb7-40aa-85d0-8301812cb28c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:52.517198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-44d8983c-1bb7-40aa-85d0-8301812cb28c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:52.540786 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d8983c-1bb7-40aa-85d0-8301812cb28c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:52.551620 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f3081-b0c4-4449-92b3-ec1ed81870ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:52.554386 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f3081-b0c4-4449-92b3-ec1ed81870ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:52.557292 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f3081-b0c4-4449-92b3-ec1ed81870ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:52.557639 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201f3081-b0c4-4449-92b3-ec1ed81870ca admin admin] PATH_INFO: `/v3/users/ca40319f65954420b6cb1b7f57d6f9ea` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:52.559254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f3081-b0c4-4449-92b3-ec1ed81870ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca40319f65954420b6cb1b7f57d6f9ea)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:52.561370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201f3081-b0c4-4449-92b3-ec1ed81870ca admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:52.696570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f4747de3-b412-434d-bc6e-591bbbf0f490 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '36180caaca57435b87a586f2f66f5517'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:52.697230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f4747de3-b412-434d-bc6e-591bbbf0f490 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '36180caaca57435b87a586f2f66f5517'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:52.842117 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f4747de3-b412-434d-bc6e-591bbbf0f490 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '36180caaca57435b87a586f2f66f5517'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:52.842743 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f4747de3-b412-434d-bc6e-591bbbf0f490 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '36180caaca57435b87a586f2f66f5517'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:52.856362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f4747de3-b412-434d-bc6e-591bbbf0f490 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '36180caaca57435b87a586f2f66f5517'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:52.869160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 961/1922] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:52 2022] DELETE /identity/v3/users/36180caaca57435b87a586f2f66f5517 => generated 0 bytes in 468 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:52.870079 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4747de3-b412-434d-bc6e-591bbbf0f490 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:52.871631 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f4747de3-b412-434d-bc6e-591bbbf0f490 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:52.912447 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-201f3081-b0c4-4449-92b3-ec1ed81870ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca40319f65954420b6cb1b7f57d6f9ea'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:52.932373 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-201f3081-b0c4-4449-92b3-ec1ed81870ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca40319f65954420b6cb1b7f57d6f9ea'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:52.933195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-201f3081-b0c4-4449-92b3-ec1ed81870ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca40319f65954420b6cb1b7f57d6f9ea'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:52.933873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-201f3081-b0c4-4449-92b3-ec1ed81870ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca40319f65954420b6cb1b7f57d6f9ea'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:52.941675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-201f3081-b0c4-4449-92b3-ec1ed81870ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca40319f65954420b6cb1b7f57d6f9ea'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:52.948543 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4747de3-b412-434d-bc6e-591bbbf0f490 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:52.955308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd946b-ff5c-40a5-8f19-39dd9dba03e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:52.956136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd946b-ff5c-40a5-8f19-39dd9dba03e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:52.956551 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd946b-ff5c-40a5-8f19-39dd9dba03e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:52.956971 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbd946b-ff5c-40a5-8f19-39dd9dba03e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:52.957788 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd946b-ff5c-40a5-8f19-39dd9dba03e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:52.960088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbbd946b-ff5c-40a5-8f19-39dd9dba03e9 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:52.963022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:53.053970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 962/1923] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:52 2022] DELETE /identity/v3/users/ca40319f65954420b6cb1b7f57d6f9ea => generated 0 bytes in 541 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:53.054955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f3081-b0c4-4449-92b3-ec1ed81870ca admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:53.056585 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-201f3081-b0c4-4449-92b3-ec1ed81870ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:53.113163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 962/1924] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:52 2022] POST /identity/v3/projects => generated 369 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:53.114381 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd946b-ff5c-40a5-8f19-39dd9dba03e9 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:53.116595 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-bbbd946b-ff5c-40a5-8f19-39dd9dba03e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:53.169031 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201f3081-b0c4-4449-92b3-ec1ed81870ca admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:53.188056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbbd946b-ff5c-40a5-8f19-39dd9dba03e9 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:53.193429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd5a795-511e-49d2-84a6-f2dd5a064ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:53.194414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5a795-511e-49d2-84a6-f2dd5a064ded admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:53.194779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5a795-511e-49d2-84a6-f2dd5a064ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:53.195141 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd5a795-511e-49d2-84a6-f2dd5a064ded admin admin] PATH_INFO: `/v3/projects/01d89c8f546e433f83dd38fe2192cc0e/users/39c63d48ff3d4dafa59289b329651a51/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:53.197619 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5a795-511e-49d2-84a6-f2dd5a064ded admin admin] RBAC: Authorizing `identity:create_grant(project_id=01d89c8f546e433f83dd38fe2192cc0e, user_id=39c63d48ff3d4dafa59289b329651a51, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:53.200483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd5a795-511e-49d2-84a6-f2dd5a064ded admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:53.218993 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 963/1925] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:53 2022] PUT /identity/v3/projects/01d89c8f546e433f83dd38fe2192cc0e/users/39c63d48ff3d4dafa59289b329651a51/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:53.220495 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba117b79-0e00-45e7-b0e1-4f5e8c061a5b None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:53.221091 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba117b79-0e00-45e7-b0e1-4f5e8c061a5b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:53.221648 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba117b79-0e00-45e7-b0e1-4f5e8c061a5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:53.240610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-ba117b79-0e00-45e7-b0e1-4f5e8c061a5b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:53.241916 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ba117b79-0e00-45e7-b0e1-4f5e8c061a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:53.247634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bb61b-dbcf-471b-ac1b-829602db3c51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:53.249282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bb61b-dbcf-471b-ac1b-829602db3c51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:53.249743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bb61b-dbcf-471b-ac1b-829602db3c51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:53.251566 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5bb61b-dbcf-471b-ac1b-829602db3c51 admin admin] PATH_INFO: `/v3/projects/4cd07efd799547808acf5f1635e33a5f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:53.256187 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bb61b-dbcf-471b-ac1b-829602db3c51 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4cd07efd799547808acf5f1635e33a5f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:53.259798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5bb61b-dbcf-471b-ac1b-829602db3c51 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:53.264036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:53.314876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 964/1926] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:53.314876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba117b79-0e00-45e7-b0e1-4f5e8c061a5b None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:53.316640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ba117b79-0e00-45e7-b0e1-4f5e8c061a5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:53.329895 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba117b79-0e00-45e7-b0e1-4f5e8c061a5b None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:53.334688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f623e20a-5392-4a86-908d-3c58aa0eaf20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:53.335402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623e20a-5392-4a86-908d-3c58aa0eaf20 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:53.335680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623e20a-5392-4a86-908d-3c58aa0eaf20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:53.336117 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f623e20a-5392-4a86-908d-3c58aa0eaf20 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:53.336827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623e20a-5392-4a86-908d-3c58aa0eaf20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:53.338889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f623e20a-5392-4a86-908d-3c58aa0eaf20 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:53.496082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 965/1927] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:53 2022] POST /identity/v3/users => generated 285 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:53.507078 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777e7aa-cbb2-4a48-88be-4558dc17038e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:53.507420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777e7aa-cbb2-4a48-88be-4558dc17038e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:53.507707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c777e7aa-cbb2-4a48-88be-4558dc17038e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:53.520892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aa5bb61b-dbcf-471b-ac1b-829602db3c51 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cd07efd799547808acf5f1635e33a5f', 'request_id': 'req-aa5bb61b-dbcf-471b-ac1b-829602db3c51'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:53.529303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aa5bb61b-dbcf-471b-ac1b-829602db3c51 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cd07efd799547808acf5f1635e33a5f', 'request_id': 'req-aa5bb61b-dbcf-471b-ac1b-829602db3c51'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:53.540642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aa5bb61b-dbcf-471b-ac1b-829602db3c51 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cd07efd799547808acf5f1635e33a5f', 'request_id': 'req-aa5bb61b-dbcf-471b-ac1b-829602db3c51'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:53.551349 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c777e7aa-cbb2-4a48-88be-4558dc17038e None None] MFA Rules not processed for user `39c63d48ff3d4dafa59289b329651a51`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:53.553224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c777e7aa-cbb2-4a48-88be-4558dc17038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:53.670684 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aa5bb61b-dbcf-471b-ac1b-829602db3c51 admin admin] The token cache is being invalidate because project 4cd07efd799547808acf5f1635e33a5f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:53.670936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aa5bb61b-dbcf-471b-ac1b-829602db3c51 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:53.671605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aa5bb61b-dbcf-471b-ac1b-829602db3c51 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:53.676860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 963/1928] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:53 2022] DELETE /identity/v3/projects/4cd07efd799547808acf5f1635e33a5f => generated 0 bytes in 622 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:53.678244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bb61b-dbcf-471b-ac1b-829602db3c51 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:53.682713 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-aa5bb61b-dbcf-471b-ac1b-829602db3c51 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:53.715281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 966/1929] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:53.716548 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777e7aa-cbb2-4a48-88be-4558dc17038e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:53.717538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c777e7aa-cbb2-4a48-88be-4558dc17038e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:53.780768 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5bb61b-dbcf-471b-ac1b-829602db3c51 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:53.785311 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feff1a-58ba-4da0-bd1d-cc79c2bfc39d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:53.786054 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feff1a-58ba-4da0-bd1d-cc79c2bfc39d service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:53.786329 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feff1a-58ba-4da0-bd1d-cc79c2bfc39d service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:53.786609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15feff1a-58ba-4da0-bd1d-cc79c2bfc39d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:53.789681 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-15feff1a-58ba-4da0-bd1d-cc79c2bfc39d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:53.827626 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c777e7aa-cbb2-4a48-88be-4558dc17038e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:53.835085 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bf97a9-45d6-4773-afe2-d198d23268fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:53.835955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf97a9-45d6-4773-afe2-d198d23268fe admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:53.836408 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf97a9-45d6-4773-afe2-d198d23268fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:53.836837 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bf97a9-45d6-4773-afe2-d198d23268fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:53.837738 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf97a9-45d6-4773-afe2-d198d23268fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:53.839563 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bf97a9-45d6-4773-afe2-d198d23268fe admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:53.853245 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 967/1930] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:53.855820 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72423106-5b6a-448c-a1fa-dd77bad1a42c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:53.856116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72423106-5b6a-448c-a1fa-dd77bad1a42c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:53.856403 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72423106-5b6a-448c-a1fa-dd77bad1a42c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:53.883091 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15feff1a-58ba-4da0-bd1d-cc79c2bfc39d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:53.889138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-72423106-5b6a-448c-a1fa-dd77bad1a42c None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:53.889535 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15feff1a-58ba-4da0-bd1d-cc79c2bfc39d service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:53.891589 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-72423106-5b6a-448c-a1fa-dd77bad1a42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:53.903252 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 968/1931] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:53.903252 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72423106-5b6a-448c-a1fa-dd77bad1a42c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:53.912107 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-72423106-5b6a-448c-a1fa-dd77bad1a42c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:53.914485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 964/1932] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:53.915298 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feff1a-58ba-4da0-bd1d-cc79c2bfc39d service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:53.918731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72423106-5b6a-448c-a1fa-dd77bad1a42c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:53.920530 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-15feff1a-58ba-4da0-bd1d-cc79c2bfc39d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:53.925391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f18c8573-8092-41e3-8383-e716b399ec0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:53.926375 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c8573-8092-41e3-8383-e716b399ec0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:53.926735 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c8573-8092-41e3-8383-e716b399ec0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:53.927125 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f18c8573-8092-41e3-8383-e716b399ec0d admin admin] PATH_INFO: `/v3/projects/8bb56e7d90d04a60b0948ab02a0f0e96` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:53.928460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c8573-8092-41e3-8383-e716b399ec0d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8bb56e7d90d04a60b0948ab02a0f0e96)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:53.934766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f18c8573-8092-41e3-8383-e716b399ec0d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:54.027404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15feff1a-58ba-4da0-bd1d-cc79c2bfc39d service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:54.058599 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f441d7-1ada-4262-8de4-cf774edf26bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:54.059305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f441d7-1ada-4262-8de4-cf774edf26bf service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:54.066880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f441d7-1ada-4262-8de4-cf774edf26bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:54.067327 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f441d7-1ada-4262-8de4-cf774edf26bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:54.090587 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f18c8573-8092-41e3-8383-e716b399ec0d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8bb56e7d90d04a60b0948ab02a0f0e96', 'request_id': 'req-f18c8573-8092-41e3-8383-e716b399ec0d'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:54.100363 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f441d7-1ada-4262-8de4-cf774edf26bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:54.102149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f441d7-1ada-4262-8de4-cf774edf26bf service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:54.129485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 965/1933] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:54.131463 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f441d7-1ada-4262-8de4-cf774edf26bf service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:54.162727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f441d7-1ada-4262-8de4-cf774edf26bf service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:54.188433 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f18c8573-8092-41e3-8383-e716b399ec0d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8bb56e7d90d04a60b0948ab02a0f0e96', 'request_id': 'req-f18c8573-8092-41e3-8383-e716b399ec0d'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:54.198669 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f18c8573-8092-41e3-8383-e716b399ec0d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8bb56e7d90d04a60b0948ab02a0f0e96', 'request_id': 'req-f18c8573-8092-41e3-8383-e716b399ec0d'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:54.228138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f18c8573-8092-41e3-8383-e716b399ec0d admin admin] The token cache is being invalidate because project 8bb56e7d90d04a60b0948ab02a0f0e96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:54.228934 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f18c8573-8092-41e3-8383-e716b399ec0d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:54.229750 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f18c8573-8092-41e3-8383-e716b399ec0d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:54.232136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 969/1934] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:53 2022] DELETE /identity/v3/projects/8bb56e7d90d04a60b0948ab02a0f0e96 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:54.233395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814954f-9aa7-44b8-85da-16f603be4448 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:54.234276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814954f-9aa7-44b8-85da-16f603be4448 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:54.234276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d814954f-9aa7-44b8-85da-16f603be4448 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:54.260950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d814954f-9aa7-44b8-85da-16f603be4448 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:54.263102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d814954f-9aa7-44b8-85da-16f603be4448 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:54.274974 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8090d19-322d-413e-b778-e741abb7602d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:54.275758 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8090d19-322d-413e-b778-e741abb7602d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:54.276112 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8090d19-322d-413e-b778-e741abb7602d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:54.276456 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8090d19-322d-413e-b778-e741abb7602d admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:54.277384 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8090d19-322d-413e-b778-e741abb7602d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:54.279115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8090d19-322d-413e-b778-e741abb7602d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:54.294021 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 966/1935] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:54 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:54.294021 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8090d19-322d-413e-b778-e741abb7602d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:54.296397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a8090d19-322d-413e-b778-e741abb7602d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:54.351022 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 970/1936] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:54.352438 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c62130-33e1-461a-b640-8699bec2889f None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:54.352731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c62130-33e1-461a-b640-8699bec2889f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:54.353044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89c62130-33e1-461a-b640-8699bec2889f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:54.381553 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8090d19-322d-413e-b778-e741abb7602d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:54.386139 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dde14-4dfe-4b19-85d6-0098b83d4fc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:54.386934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dde14-4dfe-4b19-85d6-0098b83d4fc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:54.387181 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dde14-4dfe-4b19-85d6-0098b83d4fc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:54.387505 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18dde14-4dfe-4b19-85d6-0098b83d4fc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:54.390399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-89c62130-33e1-461a-b640-8699bec2889f None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:54.393222 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e18dde14-4dfe-4b19-85d6-0098b83d4fc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:54.393358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-89c62130-33e1-461a-b640-8699bec2889f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:54.403087 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 971/1937] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:54.404075 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c62130-33e1-461a-b640-8699bec2889f None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:54.405552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-89c62130-33e1-461a-b640-8699bec2889f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:54.421267 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89c62130-33e1-461a-b640-8699bec2889f None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:54.428975 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6997c9aa-8a75-4548-a64a-a3e52600d559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:54.430285 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997c9aa-8a75-4548-a64a-a3e52600d559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:54.430285 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997c9aa-8a75-4548-a64a-a3e52600d559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:54.430835 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6997c9aa-8a75-4548-a64a-a3e52600d559 admin admin] PATH_INFO: `/v3/projects/fb3e3f4170a84d2cbd2d15cd80195d4c/users/4f02aa302a9e4c6b82c8d0c9848ffe26/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:54.452678 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997c9aa-8a75-4548-a64a-a3e52600d559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fb3e3f4170a84d2cbd2d15cd80195d4c, user_id=4f02aa302a9e4c6b82c8d0c9848ffe26, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:54.455631 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6997c9aa-8a75-4548-a64a-a3e52600d559 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:54.485346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18dde14-4dfe-4b19-85d6-0098b83d4fc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:54.486910 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18dde14-4dfe-4b19-85d6-0098b83d4fc7 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:54.497224 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 967/1938] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:54 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:54.498148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dde14-4dfe-4b19-85d6-0098b83d4fc7 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:54.527811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18dde14-4dfe-4b19-85d6-0098b83d4fc7 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:54.541274 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 972/1939] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:54 2022] PUT /identity/v3/projects/fb3e3f4170a84d2cbd2d15cd80195d4c/users/4f02aa302a9e4c6b82c8d0c9848ffe26/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:54.542548 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1591a-fe9f-49e8-9b46-426bc7f66624 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:54.542925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1591a-fe9f-49e8-9b46-426bc7f66624 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:54.543223 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad1591a-fe9f-49e8-9b46-426bc7f66624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:54.546027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2bc232-0eb6-49fb-b0cf-35f0bd8a5adf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:54.548836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bc232-0eb6-49fb-b0cf-35f0bd8a5adf admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:54.549055 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bc232-0eb6-49fb-b0cf-35f0bd8a5adf admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:54.549583 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2bc232-0eb6-49fb-b0cf-35f0bd8a5adf admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:54.553201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bc232-0eb6-49fb-b0cf-35f0bd8a5adf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:37:54.553541 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bc232-0eb6-49fb-b0cf-35f0bd8a5adf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:54.555255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2bc232-0eb6-49fb-b0cf-35f0bd8a5adf admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:54.581913 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-cad1591a-fe9f-49e8-9b46-426bc7f66624 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:54.587322 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 968/1940] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:37:54.589673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf9282-c845-4728-bff1-a8a97708c2e9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:54.589966 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf9282-c845-4728-bff1-a8a97708c2e9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:54.590578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf9282-c845-4728-bff1-a8a97708c2e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:54.604727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-cad1591a-fe9f-49e8-9b46-426bc7f66624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:54.634426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:54.652890 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2eaf9282-c845-4728-bff1-a8a97708c2e9 None None] MFA Rules not processed for user `4f02aa302a9e4c6b82c8d0c9848ffe26`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:54.654436 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2eaf9282-c845-4728-bff1-a8a97708c2e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:54.704350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 973/1941] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:54.704350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1591a-fe9f-49e8-9b46-426bc7f66624 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:54.717679 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad1591a-fe9f-49e8-9b46-426bc7f66624 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:54.732041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248fdb5-b257-4783-9e91-08c6670728f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:54.732783 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248fdb5-b257-4783-9e91-08c6670728f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:54.733009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248fdb5-b257-4783-9e91-08c6670728f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:54.733287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9248fdb5-b257-4783-9e91-08c6670728f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:54.733996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248fdb5-b257-4783-9e91-08c6670728f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:54.737635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9248fdb5-b257-4783-9e91-08c6670728f6 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:54.803237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:54.816153 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 969/1942] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:54 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:54.817444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf9282-c845-4728-bff1-a8a97708c2e9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:54.832739 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf9282-c845-4728-bff1-a8a97708c2e9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:54.838207 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea468e57-b0b1-48ba-b7c0-02536eceb7ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:54.839659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea468e57-b0b1-48ba-b7c0-02536eceb7ba admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:54.839971 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea468e57-b0b1-48ba-b7c0-02536eceb7ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:54.840278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea468e57-b0b1-48ba-b7c0-02536eceb7ba admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:54.841005 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea468e57-b0b1-48ba-b7c0-02536eceb7ba admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:37:54.841375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea468e57-b0b1-48ba-b7c0-02536eceb7ba admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:54.843049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea468e57-b0b1-48ba-b7c0-02536eceb7ba admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:54.872742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 970/1943] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:37:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:37:54.873880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea468e57-b0b1-48ba-b7c0-02536eceb7ba admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:54.878575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 974/1944] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:54 2022] POST /identity/v3/projects => generated 385 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:54.879679 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248fdb5-b257-4783-9e91-08c6670728f6 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:54.882100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9248fdb5-b257-4783-9e91-08c6670728f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:54.882526 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ea468e57-b0b1-48ba-b7c0-02536eceb7ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:54.907872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea468e57-b0b1-48ba-b7c0-02536eceb7ba admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:54.993218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf06c6-485b-4cc6-8380-794339529041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:54.994138 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf06c6-485b-4cc6-8380-794339529041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:54.994424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf06c6-485b-4cc6-8380-794339529041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:54.994703 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cf06c6-485b-4cc6-8380-794339529041 admin admin] PATH_INFO: `/v3/projects/8c163ddb24574f82acd9786273ee89f6` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:54.996072 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf06c6-485b-4cc6-8380-794339529041 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c163ddb24574f82acd9786273ee89f6)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:54.998042 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cf06c6-485b-4cc6-8380-794339529041 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:55.029575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9248fdb5-b257-4783-9e91-08c6670728f6 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:55.036357 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e3314-df1b-4800-a585-4467259968b3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2352b5c2aa664bf0a7e321ff3a5038fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:55.037247 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e3314-df1b-4800-a585-4467259968b3 service glance] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:55.037382 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e3314-df1b-4800-a585-4467259968b3 service glance] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:55.037713 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39e3314-df1b-4800-a585-4467259968b3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:55.117994 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e3314-df1b-4800-a585-4467259968b3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:55.119492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39e3314-df1b-4800-a585-4467259968b3 service glance] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:55.130992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 975/1945] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:54 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:55.132957 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e3314-df1b-4800-a585-4467259968b3 service glance] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:55.145335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39e3314-df1b-4800-a585-4467259968b3 service glance] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:55.148005 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75cf06c6-485b-4cc6-8380-794339529041 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c163ddb24574f82acd9786273ee89f6', 'request_id': 'req-75cf06c6-485b-4cc6-8380-794339529041'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:55.157510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75cf06c6-485b-4cc6-8380-794339529041 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c163ddb24574f82acd9786273ee89f6', 'request_id': 'req-75cf06c6-485b-4cc6-8380-794339529041'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:55.165760 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75cf06c6-485b-4cc6-8380-794339529041 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c163ddb24574f82acd9786273ee89f6', 'request_id': 'req-75cf06c6-485b-4cc6-8380-794339529041'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:55.212643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bd202-4939-4c81-93b9-c0f20b68d68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:55.213829 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bd202-4939-4c81-93b9-c0f20b68d68c admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:55.214121 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bd202-4939-4c81-93b9-c0f20b68d68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:55.214919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0bd202-4939-4c81-93b9-c0f20b68d68c admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:55.215689 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0bd202-4939-4c81-93b9-c0f20b68d68c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:55.217741 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0bd202-4939-4c81-93b9-c0f20b68d68c admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:55.306074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75cf06c6-485b-4cc6-8380-794339529041 admin admin] The token cache is being invalidate because project 8c163ddb24574f82acd9786273ee89f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:55.306366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75cf06c6-485b-4cc6-8380-794339529041 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:55.307665 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-75cf06c6-485b-4cc6-8380-794339529041 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:55.309523 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 971/1946] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:54 2022] DELETE /identity/v3/projects/8c163ddb24574f82acd9786273ee89f6 => generated 0 bytes in 436 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:55.310341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf06c6-485b-4cc6-8380-794339529041 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:55.312731 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-75cf06c6-485b-4cc6-8380-794339529041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:55.326907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cf06c6-485b-4cc6-8380-794339529041 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:55.333612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c86a69-4c4c-4b62-b33d-6660cc0a4671 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:55.334309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c86a69-4c4c-4b62-b33d-6660cc0a4671 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:55.337762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c86a69-4c4c-4b62-b33d-6660cc0a4671 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:55.337762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c86a69-4c4c-4b62-b33d-6660cc0a4671 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:55.337762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c86a69-4c4c-4b62-b33d-6660cc0a4671 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:55.337762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1c86a69-4c4c-4b62-b33d-6660cc0a4671 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:55.378358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 976/1947] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:55 2022] POST /identity/v3/users => generated 293 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:55.379538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bd202-4939-4c81-93b9-c0f20b68d68c admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:55.381926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9d0bd202-4939-4c81-93b9-c0f20b68d68c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:55.411074 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0bd202-4939-4c81-93b9-c0f20b68d68c admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:55.416562 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf5391-2e85-4794-84c8-d1ee45b42efb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:55.417769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf5391-2e85-4794-84c8-d1ee45b42efb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:55.418196 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf5391-2e85-4794-84c8-d1ee45b42efb admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:55.418540 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcf5391-2e85-4794-84c8-d1ee45b42efb admin admin] PATH_INFO: `/v3/users/9e9995b41de5423088e5272267655302` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:55.419988 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf5391-2e85-4794-84c8-d1ee45b42efb admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e9995b41de5423088e5272267655302)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:55.422099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcf5391-2e85-4794-84c8-d1ee45b42efb admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:55.481712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 972/1948] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:55 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:55.482561 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c86a69-4c4c-4b62-b33d-6660cc0a4671 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:55.486512 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b1c86a69-4c4c-4b62-b33d-6660cc0a4671 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:55.563830 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c86a69-4c4c-4b62-b33d-6660cc0a4671 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:55.571546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd70aa-c8b6-45b2-9774-6645bdeaca1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:55.571546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd70aa-c8b6-45b2-9774-6645bdeaca1c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:55.571546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd70aa-c8b6-45b2-9774-6645bdeaca1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:55.571546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dccd70aa-c8b6-45b2-9774-6645bdeaca1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:55.571895 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd70aa-c8b6-45b2-9774-6645bdeaca1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:55.572416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dccd70aa-c8b6-45b2-9774-6645bdeaca1c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:55.583812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 973/1949] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:55.584727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd70aa-c8b6-45b2-9774-6645bdeaca1c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:55.597887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dccd70aa-c8b6-45b2-9774-6645bdeaca1c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:55.602726 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a492d-677b-48c4-bb5a-0a7de23c26de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:55.603501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a492d-677b-48c4-bb5a-0a7de23c26de admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:55.603795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a492d-677b-48c4-bb5a-0a7de23c26de admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:55.604086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122a492d-677b-48c4-bb5a-0a7de23c26de admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:55.604765 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a492d-677b-48c4-bb5a-0a7de23c26de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:55.606775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122a492d-677b-48c4-bb5a-0a7de23c26de admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:55.662456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-fbcf5391-2e85-4794-84c8-d1ee45b42efb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e9995b41de5423088e5272267655302'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:55.663195 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-fbcf5391-2e85-4794-84c8-d1ee45b42efb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e9995b41de5423088e5272267655302'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:55.776983 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 974/1950] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:55 2022] POST /identity/v3/users => generated 290 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:55.777907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a492d-677b-48c4-bb5a-0a7de23c26de admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:55.779719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-122a492d-677b-48c4-bb5a-0a7de23c26de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:55.792331 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122a492d-677b-48c4-bb5a-0a7de23c26de admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:55.797592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303703f-a94c-441f-bfd2-b7bcd552f923 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:55.798358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303703f-a94c-441f-bfd2-b7bcd552f923 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:55.798640 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303703f-a94c-441f-bfd2-b7bcd552f923 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:55.798944 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303703f-a94c-441f-bfd2-b7bcd552f923 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:55.799675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303703f-a94c-441f-bfd2-b7bcd552f923 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:55.801313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5303703f-a94c-441f-bfd2-b7bcd552f923 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:55.818855 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 975/1951] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:55.818855 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303703f-a94c-441f-bfd2-b7bcd552f923 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:55.818855 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5303703f-a94c-441f-bfd2-b7bcd552f923 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:55.828660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303703f-a94c-441f-bfd2-b7bcd552f923 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:55.833458 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70e18e-df92-4f4a-bb6d-9d1ffccca74b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:55.834122 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70e18e-df92-4f4a-bb6d-9d1ffccca74b admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:55.834406 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70e18e-df92-4f4a-bb6d-9d1ffccca74b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:55.834705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c70e18e-df92-4f4a-bb6d-9d1ffccca74b admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:55.835501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70e18e-df92-4f4a-bb6d-9d1ffccca74b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:55.837069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c70e18e-df92-4f4a-bb6d-9d1ffccca74b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:55.842197 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-fbcf5391-2e85-4794-84c8-d1ee45b42efb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e9995b41de5423088e5272267655302'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:55.843031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-fbcf5391-2e85-4794-84c8-d1ee45b42efb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e9995b41de5423088e5272267655302'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:55.848472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 976/1952] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:55.855029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70e18e-df92-4f4a-bb6d-9d1ffccca74b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:55.860560 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-fbcf5391-2e85-4794-84c8-d1ee45b42efb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e9995b41de5423088e5272267655302'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:55.860954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c70e18e-df92-4f4a-bb6d-9d1ffccca74b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:55.865852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b283d11-89ea-4290-8dfd-93a7cf1a3afd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:55.866772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283d11-89ea-4290-8dfd-93a7cf1a3afd admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:55.867052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283d11-89ea-4290-8dfd-93a7cf1a3afd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:55.867329 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b283d11-89ea-4290-8dfd-93a7cf1a3afd admin admin] PATH_INFO: `/v3/projects/403d384b03a8475287f72d5549f14ecb/users/2f4c2e1762954d7396849bbc394c0993/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:55.873154 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 977/1953] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:55 2022] DELETE /identity/v3/users/9e9995b41de5423088e5272267655302 => generated 0 bytes in 494 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:55.873954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf5391-2e85-4794-84c8-d1ee45b42efb admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:55.886241 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b283d11-89ea-4290-8dfd-93a7cf1a3afd admin admin] RBAC: Authorizing `identity:create_grant(project_id=403d384b03a8475287f72d5549f14ecb, user_id=2f4c2e1762954d7396849bbc394c0993, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:55.889330 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b283d11-89ea-4290-8dfd-93a7cf1a3afd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:55.953225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcf5391-2e85-4794-84c8-d1ee45b42efb admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:55.958253 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cda040-6778-4931-8b06-33329d91dd2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:55.958961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cda040-6778-4931-8b06-33329d91dd2d admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:55.959245 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cda040-6778-4931-8b06-33329d91dd2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:55.959550 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cda040-6778-4931-8b06-33329d91dd2d admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:55.960286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cda040-6778-4931-8b06-33329d91dd2d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:55.961916 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cda040-6778-4931-8b06-33329d91dd2d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:55.973413 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 978/1954] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:55 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:55.979346 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cda040-6778-4931-8b06-33329d91dd2d admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:55.990179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cda040-6778-4931-8b06-33329d91dd2d admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:55.994968 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3751d938-737c-465f-be5c-b417a7e127a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:55.995863 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d938-737c-465f-be5c-b417a7e127a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:55.996148 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d938-737c-465f-be5c-b417a7e127a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:55.996415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3751d938-737c-465f-be5c-b417a7e127a2 admin admin] PATH_INFO: `/v3/projects/9ad62c09172043039ce5a9c1cffd8ebc/users/44a39dcf032b44959018eb4ec2f4e6b1/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:56.013271 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751d938-737c-465f-be5c-b417a7e127a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ad62c09172043039ce5a9c1cffd8ebc, user_id=44a39dcf032b44959018eb4ec2f4e6b1, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:56.016030 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3751d938-737c-465f-be5c-b417a7e127a2 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:56.045324 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 977/1955] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:55 2022] PUT /identity/v3/projects/403d384b03a8475287f72d5549f14ecb/users/2f4c2e1762954d7396849bbc394c0993/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:56.057579 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084870e7-1d34-4703-9f07-edcdb96d389a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:56.058174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084870e7-1d34-4703-9f07-edcdb96d389a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:56.058690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084870e7-1d34-4703-9f07-edcdb96d389a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:56.100214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-084870e7-1d34-4703-9f07-edcdb96d389a None None] MFA Rules not processed for user `2f4c2e1762954d7396849bbc394c0993`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:56.101718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-084870e7-1d34-4703-9f07-edcdb96d389a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:56.129164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 979/1956] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:55 2022] PUT /identity/v3/projects/9ad62c09172043039ce5a9c1cffd8ebc/users/44a39dcf032b44959018eb4ec2f4e6b1/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:37:56.142166 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095ea53-0b87-4b06-8c05-d676d446e966 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:56.142504 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095ea53-0b87-4b06-8c05-d676d446e966 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:56.142734 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2095ea53-0b87-4b06-8c05-d676d446e966 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:56.195726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-2095ea53-0b87-4b06-8c05-d676d446e966 None None] MFA Rules not processed for user `44a39dcf032b44959018eb4ec2f4e6b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:56.196935 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2095ea53-0b87-4b06-8c05-d676d446e966 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:56.198055 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 978/1957] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:37:56.204209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084870e7-1d34-4703-9f07-edcdb96d389a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:56.295653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084870e7-1d34-4703-9f07-edcdb96d389a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:56.329282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 980/1958] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:56 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:37:56.334233 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095ea53-0b87-4b06-8c05-d676d446e966 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:56.363485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caa7b8-9e65-46a5-a404-a78ae6707816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:56.364252 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caa7b8-9e65-46a5-a404-a78ae6707816 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:56.364628 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caa7b8-9e65-46a5-a404-a78ae6707816 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:56.364975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0caa7b8-9e65-46a5-a404-a78ae6707816 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:56.365738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0caa7b8-9e65-46a5-a404-a78ae6707816 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:56.367769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0caa7b8-9e65-46a5-a404-a78ae6707816 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:56.380243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:56.400578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2095ea53-0b87-4b06-8c05-d676d446e966 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:56.405531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b70d88-9bc3-4496-9848-448b986b5884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:56.406901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b70d88-9bc3-4496-9848-448b986b5884 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:56.407287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b70d88-9bc3-4496-9848-448b986b5884 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:56.407571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b70d88-9bc3-4496-9848-448b986b5884 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:56.408273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b70d88-9bc3-4496-9848-448b986b5884 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:56.410202 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b70d88-9bc3-4496-9848-448b986b5884 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:56.559671 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 979/1959] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:56 2022] POST /identity/v3/projects => generated 385 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:37:56.560539 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caa7b8-9e65-46a5-a404-a78ae6707816 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:56.562246 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d0caa7b8-9e65-46a5-a404-a78ae6707816 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:56.570640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 981/1960] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:56 2022] POST /identity/v3/projects => generated 377 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:37:56.570640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b70d88-9bc3-4496-9848-448b986b5884 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:56.641607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b70d88-9bc3-4496-9848-448b986b5884 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:56.643355 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0caa7b8-9e65-46a5-a404-a78ae6707816 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:56.646421 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d67a9-cc80-4eea-a896-26c9d9986626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:56.647152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d67a9-cc80-4eea-a896-26c9d9986626 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:56.647437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d67a9-cc80-4eea-a896-26c9d9986626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:56.647747 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-436d67a9-cc80-4eea-a896-26c9d9986626 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:56.648431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d67a9-cc80-4eea-a896-26c9d9986626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:56.648537 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:56.649387 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:56.649693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:56.649963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044 admin admin] PATH_INFO: `/v3/projects/e5b714a32ec646dd9804e2706fa4bf1c` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:56.650365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-436d67a9-cc80-4eea-a896-26c9d9986626 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:56.651171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e5b714a32ec646dd9804e2706fa4bf1c)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:56.653086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:56.796538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 982/1961] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:56 2022] POST /identity/v3/users => generated 299 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:56.796538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d67a9-cc80-4eea-a896-26c9d9986626 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:56.806472 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-436d67a9-cc80-4eea-a896-26c9d9986626 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:56.811315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92056f2-7561-4fbf-835b-90949199a20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:56.811971 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92056f2-7561-4fbf-835b-90949199a20e admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:56.812259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92056f2-7561-4fbf-835b-90949199a20e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:56.812575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92056f2-7561-4fbf-835b-90949199a20e admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:56.813283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92056f2-7561-4fbf-835b-90949199a20e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:56.815243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b92056f2-7561-4fbf-835b-90949199a20e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:56.839682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e5b714a32ec646dd9804e2706fa4bf1c', 'request_id': 'req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:56.861756 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e5b714a32ec646dd9804e2706fa4bf1c', 'request_id': 'req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:56.868170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e5b714a32ec646dd9804e2706fa4bf1c', 'request_id': 'req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:56.961031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 983/1962] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:56 2022] POST /identity/v3/users => generated 295 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:56.963231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044 admin admin] The token cache is being invalidate because project e5b714a32ec646dd9804e2706fa4bf1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:56.963231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:56.964241 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:56.965314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92056f2-7561-4fbf-835b-90949199a20e admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:56.968474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b92056f2-7561-4fbf-835b-90949199a20e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:56.970555 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 980/1963] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:56 2022] DELETE /identity/v3/projects/e5b714a32ec646dd9804e2706fa4bf1c => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:56.971552 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:56.973533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:56.982557 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92056f2-7561-4fbf-835b-90949199a20e admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:57.048553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a354d2-4253-4253-85be-f53d64f2c6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:57.049394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a354d2-4253-4253-85be-f53d64f2c6ff admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.049743 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a354d2-4253-4253-85be-f53d64f2c6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.050110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a354d2-4253-4253-85be-f53d64f2c6ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.050947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a354d2-4253-4253-85be-f53d64f2c6ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:57.053336 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a354d2-4253-4253-85be-f53d64f2c6ff admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:57.066023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 984/1964] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:57.067275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c3dbf-f6e7-48f7-b642-4f1595ad200f None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.068085 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c3dbf-f6e7-48f7-b642-4f1595ad200f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.068422 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04c3dbf-f6e7-48f7-b642-4f1595ad200f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.070030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b111e5-2b3b-4808-9b61-a5aa8f9c0044 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:57.077244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851209d-f9d4-41b0-a0bb-78dc94aa9b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:57.079313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851209d-f9d4-41b0-a0bb-78dc94aa9b73 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.079730 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851209d-f9d4-41b0-a0bb-78dc94aa9b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.080710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c851209d-f9d4-41b0-a0bb-78dc94aa9b73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.080953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851209d-f9d4-41b0-a0bb-78dc94aa9b73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:57.083585 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c851209d-f9d4-41b0-a0bb-78dc94aa9b73 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:57.095219 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-e04c3dbf-f6e7-48f7-b642-4f1595ad200f None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:57.096927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e04c3dbf-f6e7-48f7-b642-4f1595ad200f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:57.097585 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 981/1965] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:57.098419 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851209d-f9d4-41b0-a0bb-78dc94aa9b73 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:57.110396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c851209d-f9d4-41b0-a0bb-78dc94aa9b73 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:57.113462 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 985/1966] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:57.114385 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c3dbf-f6e7-48f7-b642-4f1595ad200f None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:57.121549 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2735c25-b3b9-4c9c-93ed-2f366a7e9c09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:57.122590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735c25-b3b9-4c9c-93ed-2f366a7e9c09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.122987 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735c25-b3b9-4c9c-93ed-2f366a7e9c09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.123320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2735c25-b3b9-4c9c-93ed-2f366a7e9c09 admin admin] PATH_INFO: `/v3/projects/df52f80f58d846708f5b535323ea32b5/users/d9c9e2da78684dd88bc6448a7ccbc563/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.129439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04c3dbf-f6e7-48f7-b642-4f1595ad200f None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:57.135893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8aaa025-6c10-4d63-8e21-30ecd9b93ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:57.136881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa025-6c10-4d63-8e21-30ecd9b93ae9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.137239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa025-6c10-4d63-8e21-30ecd9b93ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.137576 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8aaa025-6c10-4d63-8e21-30ecd9b93ae9 admin admin] PATH_INFO: `/v3/projects/fa7d834c7b7e42e2b135de30b08db61a/users/f7243890858c4184ae8668d96f79b55f/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.145666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2735c25-b3b9-4c9c-93ed-2f366a7e9c09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df52f80f58d846708f5b535323ea32b5, user_id=d9c9e2da78684dd88bc6448a7ccbc563, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:57.148983 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2735c25-b3b9-4c9c-93ed-2f366a7e9c09 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:57.155255 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aaa025-6c10-4d63-8e21-30ecd9b93ae9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa7d834c7b7e42e2b135de30b08db61a, user_id=f7243890858c4184ae8668d96f79b55f, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:57.159507 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8aaa025-6c10-4d63-8e21-30ecd9b93ae9 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:57.304891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 986/1967] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:57 2022] PUT /identity/v3/projects/fa7d834c7b7e42e2b135de30b08db61a/users/f7243890858c4184ae8668d96f79b55f/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:57.305565 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2f0c2-8051-4bb6-b64a-7a3c0f4b4c3c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.308716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 982/1968] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:57 2022] PUT /identity/v3/projects/df52f80f58d846708f5b535323ea32b5/users/d9c9e2da78684dd88bc6448a7ccbc563/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:57.309023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2f0c2-8051-4bb6-b64a-7a3c0f4b4c3c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.309023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e2f0c2-8051-4bb6-b64a-7a3c0f4b4c3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.311829 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2735c25-b3b9-4c9c-93ed-2f366a7e9c09 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:57.332005 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f6e2f0c2-8051-4bb6-b64a-7a3c0f4b4c3c None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:57.333249 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f6e2f0c2-8051-4bb6-b64a-7a3c0f4b4c3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:57.336827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:57.419370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2735c25-b3b9-4c9c-93ed-2f366a7e9c09 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:57.422866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 987/1969] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:57.424886 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ef613-8d67-4487-aeea-d2064f2b23f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:57.425614 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef613-8d67-4487-aeea-d2064f2b23f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.425982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef613-8d67-4487-aeea-d2064f2b23f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.426300 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933ef613-8d67-4487-aeea-d2064f2b23f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.427090 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ef613-8d67-4487-aeea-d2064f2b23f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:57.428890 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933ef613-8d67-4487-aeea-d2064f2b23f5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:57.430366 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2f0c2-8051-4bb6-b64a-7a3c0f4b4c3c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:57.441752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 983/1970] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 131 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:57.442964 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ef613-8d67-4487-aeea-d2064f2b23f5 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:57.447524 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e2f0c2-8051-4bb6-b64a-7a3c0f4b4c3c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:57.454253 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af591b-fe9a-4e24-ac69-10de20c517ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:57.455160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af591b-fe9a-4e24-ac69-10de20c517ff admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.455277 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933ef613-8d67-4487-aeea-d2064f2b23f5 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:57.455579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af591b-fe9a-4e24-ac69-10de20c517ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.455998 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7af591b-fe9a-4e24-ac69-10de20c517ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.456808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af591b-fe9a-4e24-ac69-10de20c517ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:57.458972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7af591b-fe9a-4e24-ac69-10de20c517ff admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:57.461839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b08d2-ff8b-4975-9092-c6b61ae1d934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:57.462493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b08d2-ff8b-4975-9092-c6b61ae1d934 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.462805 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b08d2-ff8b-4975-9092-c6b61ae1d934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.463085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2b08d2-ff8b-4975-9092-c6b61ae1d934 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.464112 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b08d2-ff8b-4975-9092-c6b61ae1d934 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:37:57.464426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b08d2-ff8b-4975-9092-c6b61ae1d934 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:57.466362 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b2b08d2-ff8b-4975-9092-c6b61ae1d934 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:57.487408 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 984/1971] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:37:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:37:57.488495 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b08d2-ff8b-4975-9092-c6b61ae1d934 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:57.490522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 988/1972] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:57.496162 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af591b-fe9a-4e24-ac69-10de20c517ff admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:57.505986 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2b08d2-ff8b-4975-9092-c6b61ae1d934 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:57.513553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7af591b-fe9a-4e24-ac69-10de20c517ff admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:57.516610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca8079-5432-4637-ad65-070e74475ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:57.517548 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca8079-5432-4637-ad65-070e74475ea8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.517836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca8079-5432-4637-ad65-070e74475ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.518121 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70ca8079-5432-4637-ad65-070e74475ea8 admin admin] PATH_INFO: `/v3/projects/fa7d834c7b7e42e2b135de30b08db61a/users/f7243890858c4184ae8668d96f79b55f/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.520406 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca8079-5432-4637-ad65-070e74475ea8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa7d834c7b7e42e2b135de30b08db61a, user_id=f7243890858c4184ae8668d96f79b55f, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:57.528473 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70ca8079-5432-4637-ad65-070e74475ea8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:57.545196 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7621126-a272-4e1b-8de2-03ec4432dc37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:57.545196 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7621126-a272-4e1b-8de2-03ec4432dc37 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.545196 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7621126-a272-4e1b-8de2-03ec4432dc37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.545196 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7621126-a272-4e1b-8de2-03ec4432dc37 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.546022 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7621126-a272-4e1b-8de2-03ec4432dc37 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:57.550247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 985/1973] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:57 2022] PUT /identity/v3/projects/fa7d834c7b7e42e2b135de30b08db61a/users/f7243890858c4184ae8668d96f79b55f/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:57.550908 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7621126-a272-4e1b-8de2-03ec4432dc37 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:57.558874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca8079-5432-4637-ad65-070e74475ea8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:57.638051 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70ca8079-5432-4637-ad65-070e74475ea8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:57.642913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca02860-0a88-4004-84ce-860b8fd80d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:57.643811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02860-0a88-4004-84ce-860b8fd80d99 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.644097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02860-0a88-4004-84ce-860b8fd80d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.644378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca02860-0a88-4004-84ce-860b8fd80d99 admin admin] PATH_INFO: `/v3/projects/df52f80f58d846708f5b535323ea32b5/users/d9c9e2da78684dd88bc6448a7ccbc563/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.646490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca02860-0a88-4004-84ce-860b8fd80d99 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df52f80f58d846708f5b535323ea32b5, user_id=d9c9e2da78684dd88bc6448a7ccbc563, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:57.649385 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca02860-0a88-4004-84ce-860b8fd80d99 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:57.657859 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 989/1974] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:57 2022] POST /identity/v3/projects => generated 365 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:37:57.659298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0bd04-bc84-408d-81da-ef61fa54e47d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.659594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0bd04-bc84-408d-81da-ef61fa54e47d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.659879 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb0bd04-bc84-408d-81da-ef61fa54e47d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.664811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 986/1975] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:57 2022] PUT /identity/v3/projects/df52f80f58d846708f5b535323ea32b5/users/d9c9e2da78684dd88bc6448a7ccbc563/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:57.668198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca02860-0a88-4004-84ce-860b8fd80d99 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:57.677263 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:57.690198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-adb0bd04-bc84-408d-81da-ef61fa54e47d None None] MFA Rules not processed for user `f7243890858c4184ae8668d96f79b55f`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:57.691451 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-adb0bd04-bc84-408d-81da-ef61fa54e47d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:57.748346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca02860-0a88-4004-84ce-860b8fd80d99 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:57.778527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 990/1976] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:57 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:57.779986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14672f7-54fa-4044-aa69-1b2f40f39cd0 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.780366 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14672f7-54fa-4044-aa69-1b2f40f39cd0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.780992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14672f7-54fa-4044-aa69-1b2f40f39cd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.809918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d14672f7-54fa-4044-aa69-1b2f40f39cd0 None None] MFA Rules not processed for user `d9c9e2da78684dd88bc6448a7ccbc563`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:57.811165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d14672f7-54fa-4044-aa69-1b2f40f39cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:57.818888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b22c-844b-4053-bfd4-8b39f34cec53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:57.819594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b22c-844b-4053-bfd4-8b39f34cec53 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.819879 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b22c-844b-4053-bfd4-8b39f34cec53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.820203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5804b22c-844b-4053-bfd4-8b39f34cec53 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.820893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804b22c-844b-4053-bfd4-8b39f34cec53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:57.822911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5804b22c-844b-4053-bfd4-8b39f34cec53 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:57.882220 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 991/1977] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:57 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:57.883250 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14672f7-54fa-4044-aa69-1b2f40f39cd0 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:57.884495 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d14672f7-54fa-4044-aa69-1b2f40f39cd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:57.914814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 987/1978] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:57 2022] POST /identity/v3/users => generated 283 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:37:57.920671 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b22c-844b-4053-bfd4-8b39f34cec53 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:57.931808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5804b22c-844b-4053-bfd4-8b39f34cec53 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:57.936755 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f11c8-6102-4b70-a90f-1bd377e71ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:57.937476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f11c8-6102-4b70-a90f-1bd377e71ef3 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.937843 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f11c8-6102-4b70-a90f-1bd377e71ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.938229 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f11c8-6102-4b70-a90f-1bd377e71ef3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.939099 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f11c8-6102-4b70-a90f-1bd377e71ef3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:57.940870 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f11c8-6102-4b70-a90f-1bd377e71ef3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:57.955744 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 988/1979] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:37:57.956846 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f11c8-6102-4b70-a90f-1bd377e71ef3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:57.958594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c79f11c8-6102-4b70-a90f-1bd377e71ef3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:57.964143 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14672f7-54fa-4044-aa69-1b2f40f39cd0 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:57.967706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcf0a6-40d5-4481-83ce-74784e749a23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:57.968353 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcf0a6-40d5-4481-83ce-74784e749a23 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.969221 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcf0a6-40d5-4481-83ce-74784e749a23 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.969506 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fcf0a6-40d5-4481-83ce-74784e749a23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.971442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f11c8-6102-4b70-a90f-1bd377e71ef3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:57.975062 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a59941-bd54-4de0-9660-23ef220c8443 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:57.980660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a59941-bd54-4de0-9660-23ef220c8443 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:57.980660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a59941-bd54-4de0-9660-23ef220c8443 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:57.980660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a59941-bd54-4de0-9660-23ef220c8443 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:57.983000 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcf0a6-40d5-4481-83ce-74784e749a23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:57.985332 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fcf0a6-40d5-4481-83ce-74784e749a23 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:57.986647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a59941-bd54-4de0-9660-23ef220c8443 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:57.988116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a59941-bd54-4de0-9660-23ef220c8443 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:57.995750 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 992/1980] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:57 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:57.996549 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcf0a6-40d5-4481-83ce-74784e749a23 service cinder] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:57.998123 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 989/1981] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:57 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:58.007081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fcf0a6-40d5-4481-83ce-74784e749a23 service cinder] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:58.011837 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808b724-9b75-4ea8-ace9-d6a2666ea3e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:58.012501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808b724-9b75-4ea8-ace9-d6a2666ea3e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:58.012924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808b724-9b75-4ea8-ace9-d6a2666ea3e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:58.013210 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c808b724-9b75-4ea8-ace9-d6a2666ea3e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:58.014050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808b724-9b75-4ea8-ace9-d6a2666ea3e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:58.016002 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c808b724-9b75-4ea8-ace9-d6a2666ea3e4 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:58.030164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 993/1982] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:58.033977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a59941-bd54-4de0-9660-23ef220c8443 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:58.051790 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a59941-bd54-4de0-9660-23ef220c8443 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:58.068724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5831192-b946-4d83-8e92-28747d15362e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:58.068724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5831192-b946-4d83-8e92-28747d15362e admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:58.068724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5831192-b946-4d83-8e92-28747d15362e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:58.068724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5831192-b946-4d83-8e92-28747d15362e admin admin] PATH_INFO: `/v3/projects/184c99cca25b43c4a20e8912b01c42b0/users/6822cf789178423d9a9f362f24c3eb23/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:58.094326 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5831192-b946-4d83-8e92-28747d15362e admin admin] RBAC: Authorizing `identity:create_grant(project_id=184c99cca25b43c4a20e8912b01c42b0, user_id=6822cf789178423d9a9f362f24c3eb23, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:58.094326 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5831192-b946-4d83-8e92-28747d15362e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:58.100332 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808b724-9b75-4ea8-ace9-d6a2666ea3e4 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:58.112363 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c808b724-9b75-4ea8-ace9-d6a2666ea3e4 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:58.118242 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c87a2c-722a-4638-858b-7129f071d213 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:58.119184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c87a2c-722a-4638-858b-7129f071d213 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:58.119468 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c87a2c-722a-4638-858b-7129f071d213 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:58.119746 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c87a2c-722a-4638-858b-7129f071d213 admin admin] PATH_INFO: `/v3/users/2f4c2e1762954d7396849bbc394c0993` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:58.121036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c87a2c-722a-4638-858b-7129f071d213 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f4c2e1762954d7396849bbc394c0993)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:58.123106 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c87a2c-722a-4638-858b-7129f071d213 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:58.180763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 990/1983] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:58 2022] PUT /identity/v3/projects/184c99cca25b43c4a20e8912b01c42b0/users/6822cf789178423d9a9f362f24c3eb23/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:58.192519 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36cbcf-8175-4b9a-9314-7339ae4c5387 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:58.192811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36cbcf-8175-4b9a-9314-7339ae4c5387 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:58.193091 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f36cbcf-8175-4b9a-9314-7339ae4c5387 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:58.226285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1f36cbcf-8175-4b9a-9314-7339ae4c5387 None None] MFA Rules not processed for user `6822cf789178423d9a9f362f24c3eb23`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:58.227579 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1f36cbcf-8175-4b9a-9314-7339ae4c5387 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:58.297205 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 991/1984] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:58.301794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36cbcf-8175-4b9a-9314-7339ae4c5387 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:58.347621 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c6c87a2c-722a-4638-858b-7129f071d213 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f4c2e1762954d7396849bbc394c0993'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:58.349154 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c6c87a2c-722a-4638-858b-7129f071d213 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f4c2e1762954d7396849bbc394c0993'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:58.377470 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f36cbcf-8175-4b9a-9314-7339ae4c5387 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:58.382668 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c4dee-263d-46ef-9b1c-b1d5f7a43178 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:58.383377 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c4dee-263d-46ef-9b1c-b1d5f7a43178 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:58.383651 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c4dee-263d-46ef-9b1c-b1d5f7a43178 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:58.384062 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019c4dee-263d-46ef-9b1c-b1d5f7a43178 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:58.384693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c4dee-263d-46ef-9b1c-b1d5f7a43178 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:58.386681 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019c4dee-263d-46ef-9b1c-b1d5f7a43178 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:58.456627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c6c87a2c-722a-4638-858b-7129f071d213 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f4c2e1762954d7396849bbc394c0993'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:58.457451 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c6c87a2c-722a-4638-858b-7129f071d213 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f4c2e1762954d7396849bbc394c0993'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:58.476182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c6c87a2c-722a-4638-858b-7129f071d213 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f4c2e1762954d7396849bbc394c0993'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:58.478397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 992/1985] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:37:58 2022] POST /identity/v3/projects => generated 365 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:37:58.483218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c4dee-263d-46ef-9b1c-b1d5f7a43178 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:58.485107 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-019c4dee-263d-46ef-9b1c-b1d5f7a43178 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:58.514427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 994/1986] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:58 2022] DELETE /identity/v3/users/2f4c2e1762954d7396849bbc394c0993 => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:58.516628 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9660892-8642-44cc-bbc8-6285fc43625f None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:58.516933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9660892-8642-44cc-bbc8-6285fc43625f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:58.517291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9660892-8642-44cc-bbc8-6285fc43625f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:58.544680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f9660892-8642-44cc-bbc8-6285fc43625f None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:58.545961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f9660892-8642-44cc-bbc8-6285fc43625f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:58.570065 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019c4dee-263d-46ef-9b1c-b1d5f7a43178 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:58.615753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 995/1987] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:58.627969 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9660892-8642-44cc-bbc8-6285fc43625f None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:58.629896 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f9660892-8642-44cc-bbc8-6285fc43625f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:58.646669 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e870bd-cef8-46be-bce3-1559d84a3dd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:58.647523 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e870bd-cef8-46be-bce3-1559d84a3dd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:58.647877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e870bd-cef8-46be-bce3-1559d84a3dd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:58.648222 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2e870bd-cef8-46be-bce3-1559d84a3dd3 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:58.649161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e870bd-cef8-46be-bce3-1559d84a3dd3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:58.651252 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2e870bd-cef8-46be-bce3-1559d84a3dd3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:58.693218 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9660892-8642-44cc-bbc8-6285fc43625f None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:58.696949 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7aef9-a6ec-4d7f-ac37-4c0512ca5d86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:58.697613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7aef9-a6ec-4d7f-ac37-4c0512ca5d86 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:58.697919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7aef9-a6ec-4d7f-ac37-4c0512ca5d86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:58.698202 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c7aef9-a6ec-4d7f-ac37-4c0512ca5d86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:58.708818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7aef9-a6ec-4d7f-ac37-4c0512ca5d86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:58.710255 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3c7aef9-a6ec-4d7f-ac37-4c0512ca5d86 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:58.719889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 996/1988] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:58.779916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 993/1989] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:37:58 2022] POST /identity/v3/users => generated 289 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:37:58.782781 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7aef9-a6ec-4d7f-ac37-4c0512ca5d86 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:58.792711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c7aef9-a6ec-4d7f-ac37-4c0512ca5d86 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:58.798030 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed5873-11b2-4041-aae1-bd7b82ebc03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:58.798695 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed5873-11b2-4041-aae1-bd7b82ebc03b admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:58.799012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed5873-11b2-4041-aae1-bd7b82ebc03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:58.799464 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ed5873-11b2-4041-aae1-bd7b82ebc03b admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:58.802179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed5873-11b2-4041-aae1-bd7b82ebc03b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:58.802179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43ed5873-11b2-4041-aae1-bd7b82ebc03b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:58.816096 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 997/1990] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:58.817311 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e870bd-cef8-46be-bce3-1559d84a3dd3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:58.827771 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2e870bd-cef8-46be-bce3-1559d84a3dd3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:58.832869 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1669f22-bc85-4de0-b766-1ed6f998107d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:58.833757 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1669f22-bc85-4de0-b766-1ed6f998107d admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:58.834040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1669f22-bc85-4de0-b766-1ed6f998107d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:58.834340 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1669f22-bc85-4de0-b766-1ed6f998107d admin admin] PATH_INFO: `/v3/projects/3109f3c311bf4fc8b79d02b3526c7a65/users/54c1451e9b324d55a192c67d31b524a7/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:58.850740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1669f22-bc85-4de0-b766-1ed6f998107d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3109f3c311bf4fc8b79d02b3526c7a65, user_id=54c1451e9b324d55a192c67d31b524a7, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:58.853486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1669f22-bc85-4de0-b766-1ed6f998107d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:58.968610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 994/1991] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:58 2022] PUT /identity/v3/projects/3109f3c311bf4fc8b79d02b3526c7a65/users/54c1451e9b324d55a192c67d31b524a7/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:58.972701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed5873-11b2-4041-aae1-bd7b82ebc03b admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:58.983512 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43ed5873-11b2-4041-aae1-bd7b82ebc03b admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:59.050490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6589d041-0e93-4c18-ba49-535a140e2470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:59.051214 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589d041-0e93-4c18-ba49-535a140e2470 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:59.051509 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589d041-0e93-4c18-ba49-535a140e2470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:59.051842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6589d041-0e93-4c18-ba49-535a140e2470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:59.052559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589d041-0e93-4c18-ba49-535a140e2470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:59.054171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6589d041-0e93-4c18-ba49-535a140e2470 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:59.065956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 998/1992] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:37:58 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:37:59.070204 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1669f22-bc85-4de0-b766-1ed6f998107d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:59.080894 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1669f22-bc85-4de0-b766-1ed6f998107d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:59.085838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9319c4a-d1ef-4a74-bfb4-61cacfc08c14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:59.086738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9319c4a-d1ef-4a74-bfb4-61cacfc08c14 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:59.087047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9319c4a-d1ef-4a74-bfb4-61cacfc08c14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:59.087317 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9319c4a-d1ef-4a74-bfb4-61cacfc08c14 admin admin] PATH_INFO: `/v3/projects/3109f3c311bf4fc8b79d02b3526c7a65/users/54c1451e9b324d55a192c67d31b524a7/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:59.089327 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9319c4a-d1ef-4a74-bfb4-61cacfc08c14 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3109f3c311bf4fc8b79d02b3526c7a65, user_id=54c1451e9b324d55a192c67d31b524a7, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:59.092034 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9319c4a-d1ef-4a74-bfb4-61cacfc08c14 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:59.105686 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 995/1993] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:37:59 2022] PUT /identity/v3/projects/3109f3c311bf4fc8b79d02b3526c7a65/users/54c1451e9b324d55a192c67d31b524a7/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:59.117468 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63650b8f-d208-498c-a819-8897dbc90160 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:59.117791 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63650b8f-d208-498c-a819-8897dbc90160 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:59.118086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63650b8f-d208-498c-a819-8897dbc90160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:59.147570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-63650b8f-d208-498c-a819-8897dbc90160 None None] MFA Rules not processed for user `54c1451e9b324d55a192c67d31b524a7`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:37:59.148800 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-63650b8f-d208-498c-a819-8897dbc90160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:59.217357 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 999/1994] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:37:59 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:37:59.229963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9319c4a-d1ef-4a74-bfb4-61cacfc08c14 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:59.231984 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c9319c4a-d1ef-4a74-bfb4-61cacfc08c14 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:59.298345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9319c4a-d1ef-4a74-bfb4-61cacfc08c14 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:59.302046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abf07f-46c3-4964-baf9-1b8a49e48201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:59.302690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abf07f-46c3-4964-baf9-1b8a49e48201 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:59.303007 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abf07f-46c3-4964-baf9-1b8a49e48201 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:59.303284 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58abf07f-46c3-4964-baf9-1b8a49e48201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:59.312523 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abf07f-46c3-4964-baf9-1b8a49e48201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:59.317509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58abf07f-46c3-4964-baf9-1b8a49e48201 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:59.323529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 996/1995] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:59 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:37:59.369250 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:37:59.376062 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63650b8f-d208-498c-a819-8897dbc90160 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:59.377722 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-63650b8f-d208-498c-a819-8897dbc90160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:59.460718 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63650b8f-d208-498c-a819-8897dbc90160 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:59.466435 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6674a03-e76b-45b5-a42c-cdf74e39aeec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:59.467950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6674a03-e76b-45b5-a42c-cdf74e39aeec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:59.468204 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6674a03-e76b-45b5-a42c-cdf74e39aeec admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:59.469237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6674a03-e76b-45b5-a42c-cdf74e39aeec admin admin] PATH_INFO: `/v3/projects/403d384b03a8475287f72d5549f14ecb` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:59.471324 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6674a03-e76b-45b5-a42c-cdf74e39aeec admin admin] RBAC: Authorizing `identity:delete_project(project_id=403d384b03a8475287f72d5549f14ecb)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:59.473602 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6674a03-e76b-45b5-a42c-cdf74e39aeec admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:59.694873 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f6674a03-e76b-45b5-a42c-cdf74e39aeec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '403d384b03a8475287f72d5549f14ecb', 'request_id': 'req-f6674a03-e76b-45b5-a42c-cdf74e39aeec'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:59.715789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abf07f-46c3-4964-baf9-1b8a49e48201 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:59.715789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-58abf07f-46c3-4964-baf9-1b8a49e48201 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:59.726863 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58abf07f-46c3-4964-baf9-1b8a49e48201 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:59.778915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c666f7-d3eb-4882-93da-f59d1acfb509 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:59.779474 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c666f7-d3eb-4882-93da-f59d1acfb509 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:59.779759 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c666f7-d3eb-4882-93da-f59d1acfb509 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:59.780033 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82c666f7-d3eb-4882-93da-f59d1acfb509 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:59.782732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-82c666f7-d3eb-4882-93da-f59d1acfb509 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:37:59.839250 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f6674a03-e76b-45b5-a42c-cdf74e39aeec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '403d384b03a8475287f72d5549f14ecb', 'request_id': 'req-f6674a03-e76b-45b5-a42c-cdf74e39aeec'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:59.847632 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c666f7-d3eb-4882-93da-f59d1acfb509 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:59.847845 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f6674a03-e76b-45b5-a42c-cdf74e39aeec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '403d384b03a8475287f72d5549f14ecb', 'request_id': 'req-f6674a03-e76b-45b5-a42c-cdf74e39aeec'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:59.850358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82c666f7-d3eb-4882-93da-f59d1acfb509 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:37:59.864671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f6674a03-e76b-45b5-a42c-cdf74e39aeec admin admin] The token cache is being invalidate because project 403d384b03a8475287f72d5549f14ecb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:37:59.865092 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f6674a03-e76b-45b5-a42c-cdf74e39aeec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:59.865767 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f6674a03-e76b-45b5-a42c-cdf74e39aeec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:37:59.867143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 997/1996] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:37:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:37:59.867459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1000/1997] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:37:59 2022] DELETE /identity/v3/projects/403d384b03a8475287f72d5549f14ecb => generated 0 bytes in 492 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:37:59.872174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c666f7-d3eb-4882-93da-f59d1acfb509 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:37:59.945244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82c666f7-d3eb-4882-93da-f59d1acfb509 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:37:59.950005 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c869157-0cb8-4852-83db-870ba9ef5bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:37:59.950914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869157-0cb8-4852-83db-870ba9ef5bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:37:59.951201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869157-0cb8-4852-83db-870ba9ef5bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:37:59.951479 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c869157-0cb8-4852-83db-870ba9ef5bda admin admin] PATH_INFO: `/v3/users/d9c9e2da78684dd88bc6448a7ccbc563` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:37:59.952751 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c869157-0cb8-4852-83db-870ba9ef5bda admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c9e2da78684dd88bc6448a7ccbc563)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:37:59.955509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c869157-0cb8-4852-83db-870ba9ef5bda admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:00.269376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8c869157-0cb8-4852-83db-870ba9ef5bda admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c9e2da78684dd88bc6448a7ccbc563'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:00.281307 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8c869157-0cb8-4852-83db-870ba9ef5bda admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c9e2da78684dd88bc6448a7ccbc563'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:00.282001 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8c869157-0cb8-4852-83db-870ba9ef5bda admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c9e2da78684dd88bc6448a7ccbc563'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:00.282595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8c869157-0cb8-4852-83db-870ba9ef5bda admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c9e2da78684dd88bc6448a7ccbc563'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:00.289506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-8c869157-0cb8-4852-83db-870ba9ef5bda admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c9e2da78684dd88bc6448a7ccbc563'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:00.457696 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 998/1998] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:37:59 2022] DELETE /identity/v3/users/d9c9e2da78684dd88bc6448a7ccbc563 => generated 0 bytes in 586 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:00.537409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:00.581910 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6674a03-e76b-45b5-a42c-cdf74e39aeec admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:00.583586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f6674a03-e76b-45b5-a42c-cdf74e39aeec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:00.603983 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c869157-0cb8-4852-83db-870ba9ef5bda admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:00.607471 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8c869157-0cb8-4852-83db-870ba9ef5bda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:00.607742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6674a03-e76b-45b5-a42c-cdf74e39aeec admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:00.688406 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ea08d-619e-4b96-95de-8b306e81bb37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:00.689565 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ea08d-619e-4b96-95de-8b306e81bb37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:00.689851 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ea08d-619e-4b96-95de-8b306e81bb37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:00.690402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0ea08d-619e-4b96-95de-8b306e81bb37 admin admin] PATH_INFO: `/v3/users/f7b24819c4d346e993cbeac41bd29bc7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:00.691484 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ea08d-619e-4b96-95de-8b306e81bb37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7b24819c4d346e993cbeac41bd29bc7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:00.693536 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0ea08d-619e-4b96-95de-8b306e81bb37 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:00.723501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c869157-0cb8-4852-83db-870ba9ef5bda admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:00.740102 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa38aae-51f0-4bd3-baba-428102f0a879 tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7243890858c4184ae8668d96f79b55f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa7d834c7b7e42e2b135de30b08db61a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:00.740931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa38aae-51f0-4bd3-baba-428102f0a879 tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:00.741341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa38aae-51f0-4bd3-baba-428102f0a879 tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:00.741657 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa38aae-51f0-4bd3-baba-428102f0a879 tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:00.743197 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa38aae-51f0-4bd3-baba-428102f0a879 tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:00.743569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa38aae-51f0-4bd3-baba-428102f0a879 tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:00.745665 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa38aae-51f0-4bd3-baba-428102f0a879 tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:00.770037 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 999/1999] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:38:00.772129 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa38aae-51f0-4bd3-baba-428102f0a879 tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:00.785852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa38aae-51f0-4bd3-baba-428102f0a879 tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:00.792462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab71705-9ee2-4422-a61d-e22b80fcf8db tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7243890858c4184ae8668d96f79b55f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa7d834c7b7e42e2b135de30b08db61a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:00.792999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71705-9ee2-4422-a61d-e22b80fcf8db tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:00.793289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71705-9ee2-4422-a61d-e22b80fcf8db tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:00.793604 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab71705-9ee2-4422-a61d-e22b80fcf8db tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:00.794537 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab71705-9ee2-4422-a61d-e22b80fcf8db tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:00.797672 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab71705-9ee2-4422-a61d-e22b80fcf8db tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:00.896361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1000/2000] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:00 2022] POST /identity/v3/projects => generated 354 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:00.898010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab71705-9ee2-4422-a61d-e22b80fcf8db tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:00.975973 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab71705-9ee2-4422-a61d-e22b80fcf8db tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:00.981321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d54d89-b8fe-46b4-b299-5e317cd469ee tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7243890858c4184ae8668d96f79b55f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa7d834c7b7e42e2b135de30b08db61a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:00.986682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d54d89-b8fe-46b4-b299-5e317cd469ee tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:00.986682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d54d89-b8fe-46b4-b299-5e317cd469ee tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:00.986682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d54d89-b8fe-46b4-b299-5e317cd469ee tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:00.986682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d54d89-b8fe-46b4-b299-5e317cd469ee tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:00.986682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d54d89-b8fe-46b4-b299-5e317cd469ee tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:00.987193 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d54d89-b8fe-46b4-b299-5e317cd469ee tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:00.999329 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1001/2001] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:38:01.032857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-ba0ea08d-619e-4b96-95de-8b306e81bb37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7b24819c4d346e993cbeac41bd29bc7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:01.033884 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-ba0ea08d-619e-4b96-95de-8b306e81bb37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7b24819c4d346e993cbeac41bd29bc7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:01.053205 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d54d89-b8fe-46b4-b299-5e317cd469ee tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:01.055669 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b0d54d89-b8fe-46b4-b299-5e317cd469ee tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:01.074632 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d54d89-b8fe-46b4-b299-5e317cd469ee tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:01.080534 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b16ec38-da09-49d7-9e86-5fc696870a9f tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f7243890858c4184ae8668d96f79b55f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'fa7d834c7b7e42e2b135de30b08db61a', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:01.082120 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16ec38-da09-49d7-9e86-5fc696870a9f tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:01.082120 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16ec38-da09-49d7-9e86-5fc696870a9f tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:01.082278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b16ec38-da09-49d7-9e86-5fc696870a9f tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] PATH_INFO: `/v3/projects/7f80640f7e2c4f9bba33295944368942` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:01.083442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16ec38-da09-49d7-9e86-5fc696870a9f tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7f80640f7e2c4f9bba33295944368942)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:01.085465 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b16ec38-da09-49d7-9e86-5fc696870a9f tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:01.196779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-ba0ea08d-619e-4b96-95de-8b306e81bb37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7b24819c4d346e993cbeac41bd29bc7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:01.208056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-ba0ea08d-619e-4b96-95de-8b306e81bb37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7b24819c4d346e993cbeac41bd29bc7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:01.213306 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-ba0ea08d-619e-4b96-95de-8b306e81bb37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7b24819c4d346e993cbeac41bd29bc7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:01.227568 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1001/2002] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:00 2022] DELETE /identity/v3/users/f7b24819c4d346e993cbeac41bd29bc7 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:01.228433 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ea08d-619e-4b96-95de-8b306e81bb37 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:01.229784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ba0ea08d-619e-4b96-95de-8b306e81bb37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:01.266605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1b16ec38-da09-49d7-9e86-5fc696870a9f tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7f80640f7e2c4f9bba33295944368942', 'request_id': 'req-1b16ec38-da09-49d7-9e86-5fc696870a9f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:01.274092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1b16ec38-da09-49d7-9e86-5fc696870a9f tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7f80640f7e2c4f9bba33295944368942', 'request_id': 'req-1b16ec38-da09-49d7-9e86-5fc696870a9f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:01.280126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1b16ec38-da09-49d7-9e86-5fc696870a9f tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7f80640f7e2c4f9bba33295944368942', 'request_id': 'req-1b16ec38-da09-49d7-9e86-5fc696870a9f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:01.310847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0ea08d-619e-4b96-95de-8b306e81bb37 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:01.374421 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5c271c-363b-44fe-9975-847a8be3dab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:01.375394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c271c-363b-44fe-9975-847a8be3dab6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:01.375711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c271c-363b-44fe-9975-847a8be3dab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:01.376029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5c271c-363b-44fe-9975-847a8be3dab6 admin admin] PATH_INFO: `/v3/projects/df52f80f58d846708f5b535323ea32b5` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:01.377393 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c271c-363b-44fe-9975-847a8be3dab6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=df52f80f58d846708f5b535323ea32b5)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:01.379921 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5c271c-363b-44fe-9975-847a8be3dab6 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:01.427554 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1b16ec38-da09-49d7-9e86-5fc696870a9f tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] The token cache is being invalidate because project 7f80640f7e2c4f9bba33295944368942 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:01.428357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1b16ec38-da09-49d7-9e86-5fc696870a9f tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:01.429101 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1b16ec38-da09-49d7-9e86-5fc696870a9f tempest-VolumeQuotaClassesTest-12812136 tempest-VolumeQuotaClassesTest-12812136-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:01.430724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1002/2003] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:01 2022] DELETE /identity/v3/projects/7f80640f7e2c4f9bba33295944368942 => generated 0 bytes in 378 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:38:01.432117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37f114-c8d9-45f3-a896-4340568542c3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:01.432429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37f114-c8d9-45f3-a896-4340568542c3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:01.432733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee37f114-c8d9-45f3-a896-4340568542c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:01.455212 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ee37f114-c8d9-45f3-a896-4340568542c3 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:01.456511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ee37f114-c8d9-45f3-a896-4340568542c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:01.464782 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1003/2004] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:01.474975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37f114-c8d9-45f3-a896-4340568542c3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:01.476386 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ee37f114-c8d9-45f3-a896-4340568542c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:01.536398 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee37f114-c8d9-45f3-a896-4340568542c3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:01.542336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68c326f-335d-453c-b2d6-fd86938d9c78 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:01.543558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c326f-335d-453c-b2d6-fd86938d9c78 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:01.543969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c326f-335d-453c-b2d6-fd86938d9c78 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:01.544573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c326f-335d-453c-b2d6-fd86938d9c78 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:01.564504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c326f-335d-453c-b2d6-fd86938d9c78 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:01.565634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7c5c271c-363b-44fe-9975-847a8be3dab6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df52f80f58d846708f5b535323ea32b5', 'request_id': 'req-7c5c271c-363b-44fe-9975-847a8be3dab6'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:01.565974 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68c326f-335d-453c-b2d6-fd86938d9c78 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:01.576158 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1004/2005] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:38:01.692165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7c5c271c-363b-44fe-9975-847a8be3dab6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df52f80f58d846708f5b535323ea32b5', 'request_id': 'req-7c5c271c-363b-44fe-9975-847a8be3dab6'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:01.695342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7c5c271c-363b-44fe-9975-847a8be3dab6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df52f80f58d846708f5b535323ea32b5', 'request_id': 'req-7c5c271c-363b-44fe-9975-847a8be3dab6'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:01.707355 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7c5c271c-363b-44fe-9975-847a8be3dab6 admin admin] The token cache is being invalidate because project df52f80f58d846708f5b535323ea32b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:01.707649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7c5c271c-363b-44fe-9975-847a8be3dab6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:01.708428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7c5c271c-363b-44fe-9975-847a8be3dab6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:01.712267 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1002/2006] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:01 2022] DELETE /identity/v3/projects/df52f80f58d846708f5b535323ea32b5 => generated 0 bytes in 484 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:01.718638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ded6dc-655a-44bc-b351-647df5353781 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:01.718996 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ded6dc-655a-44bc-b351-647df5353781 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:01.719354 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ded6dc-655a-44bc-b351-647df5353781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:01.738374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c6ded6dc-655a-44bc-b351-647df5353781 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:01.739689 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c6ded6dc-655a-44bc-b351-647df5353781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:01.804687 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1005/2007] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:01.814922 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a19dca-0da8-4309-9b01-106e19f1f98e None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:01.821424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a19dca-0da8-4309-9b01-106e19f1f98e None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:01.821424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a19dca-0da8-4309-9b01-106e19f1f98e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:01.840832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-66a19dca-0da8-4309-9b01-106e19f1f98e None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:01.844184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-66a19dca-0da8-4309-9b01-106e19f1f98e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:01.863128 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1003/2008] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:01.867764 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ded6dc-655a-44bc-b351-647df5353781 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:01.883674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ded6dc-655a-44bc-b351-647df5353781 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:01.889092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca3727-9438-4e53-9bb1-d43a5d16622c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:01.889773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca3727-9438-4e53-9bb1-d43a5d16622c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:01.890061 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca3727-9438-4e53-9bb1-d43a5d16622c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:01.890464 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cca3727-9438-4e53-9bb1-d43a5d16622c admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:01.891256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca3727-9438-4e53-9bb1-d43a5d16622c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:01.891910 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca3727-9438-4e53-9bb1-d43a5d16622c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:01.893594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cca3727-9438-4e53-9bb1-d43a5d16622c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:01.906981 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1006/2009] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:38:01.910744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a19dca-0da8-4309-9b01-106e19f1f98e None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:01.920758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a19dca-0da8-4309-9b01-106e19f1f98e None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:01.927155 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506aa5f-349c-4f63-adfd-b513a2a0e1c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:01.927845 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506aa5f-349c-4f63-adfd-b513a2a0e1c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:01.928134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506aa5f-349c-4f63-adfd-b513a2a0e1c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:01.928442 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506aa5f-349c-4f63-adfd-b513a2a0e1c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:01.929294 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506aa5f-349c-4f63-adfd-b513a2a0e1c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:01.931277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506aa5f-349c-4f63-adfd-b513a2a0e1c6 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:02.093340 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1004/2010] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:01 2022] POST /identity/v3/projects => generated 375 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:02.098101 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca3727-9438-4e53-9bb1-d43a5d16622c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:02.110817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cca3727-9438-4e53-9bb1-d43a5d16622c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:02.127508 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506aa5f-349c-4f63-adfd-b513a2a0e1c6 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:02.131155 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6506aa5f-349c-4f63-adfd-b513a2a0e1c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:02.238258 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ffca2-52e0-4226-8ff7-bccabca4d62b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:02.239143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ffca2-52e0-4226-8ff7-bccabca4d62b admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:02.239551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ffca2-52e0-4226-8ff7-bccabca4d62b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:02.239951 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4ffca2-52e0-4226-8ff7-bccabca4d62b admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:02.250342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506aa5f-349c-4f63-adfd-b513a2a0e1c6 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:02.251350 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ffca2-52e0-4226-8ff7-bccabca4d62b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:02.253498 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b4ffca2-52e0-4226-8ff7-bccabca4d62b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:02.256478 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345bff4-6441-4b87-84ac-036d2f3fa401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:02.257351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345bff4-6441-4b87-84ac-036d2f3fa401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:02.257700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345bff4-6441-4b87-84ac-036d2f3fa401 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:02.258045 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e345bff4-6441-4b87-84ac-036d2f3fa401 admin admin] PATH_INFO: `/v3/projects/f40136e9baa1404ba612c059f459bded` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:02.259330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345bff4-6441-4b87-84ac-036d2f3fa401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f40136e9baa1404ba612c059f459bded)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:02.261306 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e345bff4-6441-4b87-84ac-036d2f3fa401 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:02.399887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1007/2011] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:02 2022] POST /identity/v3/users => generated 288 bytes in 302 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:02.403932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ffca2-52e0-4226-8ff7-bccabca4d62b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:02.414656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4ffca2-52e0-4226-8ff7-bccabca4d62b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:02.419438 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1262609-174b-4856-a94b-e364010eb21e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:02.420096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1262609-174b-4856-a94b-e364010eb21e admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:02.420383 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1262609-174b-4856-a94b-e364010eb21e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:02.420665 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1262609-174b-4856-a94b-e364010eb21e admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:02.421400 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1262609-174b-4856-a94b-e364010eb21e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:02.423700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1262609-174b-4856-a94b-e364010eb21e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:02.449892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1008/2012] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:38:02.451228 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1262609-174b-4856-a94b-e364010eb21e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:02.458187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-e345bff4-6441-4b87-84ac-036d2f3fa401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f40136e9baa1404ba612c059f459bded', 'request_id': 'req-e345bff4-6441-4b87-84ac-036d2f3fa401'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:02.462690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1262609-174b-4856-a94b-e364010eb21e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:02.530177 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1d591-0967-4409-8b8d-7933a58259cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:02.534457 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1d591-0967-4409-8b8d-7933a58259cf admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:02.534457 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1d591-0967-4409-8b8d-7933a58259cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:02.534457 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b1d591-0967-4409-8b8d-7933a58259cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:02.535728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1d591-0967-4409-8b8d-7933a58259cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:02.538245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b1d591-0967-4409-8b8d-7933a58259cf admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:02.552263 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-e345bff4-6441-4b87-84ac-036d2f3fa401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f40136e9baa1404ba612c059f459bded', 'request_id': 'req-e345bff4-6441-4b87-84ac-036d2f3fa401'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:02.558403 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1009/2013] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:02 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:02.559826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1d591-0967-4409-8b8d-7933a58259cf admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:02.566793 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-e345bff4-6441-4b87-84ac-036d2f3fa401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f40136e9baa1404ba612c059f459bded', 'request_id': 'req-e345bff4-6441-4b87-84ac-036d2f3fa401'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:02.577141 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b1d591-0967-4409-8b8d-7933a58259cf admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:02.582776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-e345bff4-6441-4b87-84ac-036d2f3fa401 admin admin] The token cache is being invalidate because project f40136e9baa1404ba612c059f459bded was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:02.583064 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-e345bff4-6441-4b87-84ac-036d2f3fa401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:02.583932 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-e345bff4-6441-4b87-84ac-036d2f3fa401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:02.585331 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbc993-7604-4ced-8dd2-297076247186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:02.585882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1005/2014] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:02 2022] DELETE /identity/v3/projects/f40136e9baa1404ba612c059f459bded => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:02.587038 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbc993-7604-4ced-8dd2-297076247186 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:02.587411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbc993-7604-4ced-8dd2-297076247186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:02.587754 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfcbc993-7604-4ced-8dd2-297076247186 admin admin] PATH_INFO: `/v3/projects/96c6beae8c82407ba71dffdcac8dbd00/users/d8affc736bc7420b9d20cd7bd046bdfe/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:02.589773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345bff4-6441-4b87-84ac-036d2f3fa401 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:02.592991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e345bff4-6441-4b87-84ac-036d2f3fa401 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:02.608309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbc993-7604-4ced-8dd2-297076247186 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96c6beae8c82407ba71dffdcac8dbd00, user_id=d8affc736bc7420b9d20cd7bd046bdfe, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:02.611678 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e345bff4-6441-4b87-84ac-036d2f3fa401 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:02.612075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfcbc993-7604-4ced-8dd2-297076247186 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:02.617905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3a883-8c66-4a87-8e14-037b9813a2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:02.618871 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3a883-8c66-4a87-8e14-037b9813a2b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:02.620549 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3a883-8c66-4a87-8e14-037b9813a2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:02.620549 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3a883-8c66-4a87-8e14-037b9813a2b6 admin admin] PATH_INFO: `/v3/users/39c63d48ff3d4dafa59289b329651a51` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:02.621273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3a883-8c66-4a87-8e14-037b9813a2b6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=39c63d48ff3d4dafa59289b329651a51)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:02.623848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3a883-8c66-4a87-8e14-037b9813a2b6 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:02.729745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1010/2015] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:02 2022] PUT /identity/v3/projects/96c6beae8c82407ba71dffdcac8dbd00/users/d8affc736bc7420b9d20cd7bd046bdfe/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:02.730668 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbc993-7604-4ced-8dd2-297076247186 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:02.732389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dfcbc993-7604-4ced-8dd2-297076247186 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:02.805264 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfcbc993-7604-4ced-8dd2-297076247186 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:02.811839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66dad7d8-76ae-4395-8c3a-3711274c75e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:02.812866 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dad7d8-76ae-4395-8c3a-3711274c75e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:02.813149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dad7d8-76ae-4395-8c3a-3711274c75e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:02.813422 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66dad7d8-76ae-4395-8c3a-3711274c75e9 admin admin] PATH_INFO: `/v3/users/44a39dcf032b44959018eb4ec2f4e6b1` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:02.814672 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dad7d8-76ae-4395-8c3a-3711274c75e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44a39dcf032b44959018eb4ec2f4e6b1)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:02.816689 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66dad7d8-76ae-4395-8c3a-3711274c75e9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:02.923355 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-beb3a883-8c66-4a87-8e14-037b9813a2b6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39c63d48ff3d4dafa59289b329651a51'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:02.924478 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-beb3a883-8c66-4a87-8e14-037b9813a2b6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39c63d48ff3d4dafa59289b329651a51'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:02.934489 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:03.016449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-beb3a883-8c66-4a87-8e14-037b9813a2b6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39c63d48ff3d4dafa59289b329651a51'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:03.018664 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-beb3a883-8c66-4a87-8e14-037b9813a2b6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39c63d48ff3d4dafa59289b329651a51'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:03.033376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-66dad7d8-76ae-4395-8c3a-3711274c75e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44a39dcf032b44959018eb4ec2f4e6b1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:03.036504 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-beb3a883-8c66-4a87-8e14-037b9813a2b6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39c63d48ff3d4dafa59289b329651a51'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:03.049865 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-66dad7d8-76ae-4395-8c3a-3711274c75e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44a39dcf032b44959018eb4ec2f4e6b1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:03.051022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-66dad7d8-76ae-4395-8c3a-3711274c75e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44a39dcf032b44959018eb4ec2f4e6b1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:03.051974 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-66dad7d8-76ae-4395-8c3a-3711274c75e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44a39dcf032b44959018eb4ec2f4e6b1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:03.064906 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1006/2016] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:02 2022] DELETE /identity/v3/users/39c63d48ff3d4dafa59289b329651a51 => generated 0 bytes in 469 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:38:03.067136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3b850-38cd-4ed6-9b1b-b4366138b655 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:03.067693 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3b850-38cd-4ed6-9b1b-b4366138b655 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:03.068214 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c3b850-38cd-4ed6-9b1b-b4366138b655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:03.069753 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-66dad7d8-76ae-4395-8c3a-3711274c75e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44a39dcf032b44959018eb4ec2f4e6b1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:03.105834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-88c3b850-38cd-4ed6-9b1b-b4366138b655 None None] MFA Rules not processed for user `d8affc736bc7420b9d20cd7bd046bdfe`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:03.107346 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-88c3b850-38cd-4ed6-9b1b-b4366138b655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:03.157837 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1011/2017] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:02 2022] DELETE /identity/v3/users/44a39dcf032b44959018eb4ec2f4e6b1 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:03.169674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fb541-6f62-4321-ba07-2492c22ca103 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:03.169991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fb541-6f62-4321-ba07-2492c22ca103 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:03.170272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514fb541-6f62-4321-ba07-2492c22ca103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:03.182985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1007/2018] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:03.185901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3b850-38cd-4ed6-9b1b-b4366138b655 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:03.189218 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-88c3b850-38cd-4ed6-9b1b-b4366138b655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:03.193336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-514fb541-6f62-4321-ba07-2492c22ca103 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:03.194593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-514fb541-6f62-4321-ba07-2492c22ca103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:03.286674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1012/2019] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:03.292047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88c3b850-38cd-4ed6-9b1b-b4366138b655 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:03.302794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fb541-6f62-4321-ba07-2492c22ca103 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:03.302794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-514fb541-6f62-4321-ba07-2492c22ca103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:03.312185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5efe67-77ba-4597-8442-86cba5a74be1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:03.313962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5efe67-77ba-4597-8442-86cba5a74be1 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:03.314340 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5efe67-77ba-4597-8442-86cba5a74be1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:03.314707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5efe67-77ba-4597-8442-86cba5a74be1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:03.315566 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5efe67-77ba-4597-8442-86cba5a74be1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:03.317830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a5efe67-77ba-4597-8442-86cba5a74be1 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:03.372127 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514fb541-6f62-4321-ba07-2492c22ca103 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:03.378886 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697a151-68c3-450c-9ad0-79eff4561dbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:03.380180 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697a151-68c3-450c-9ad0-79eff4561dbb service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:03.380752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697a151-68c3-450c-9ad0-79eff4561dbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:03.381034 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a697a151-68c3-450c-9ad0-79eff4561dbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:03.392128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697a151-68c3-450c-9ad0-79eff4561dbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:03.393670 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a697a151-68c3-450c-9ad0-79eff4561dbb service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:03.403908 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1013/2020] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:38:03.458368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1008/2021] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:03 2022] POST /identity/v3/projects => generated 375 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:38:03.459854 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697a151-68c3-450c-9ad0-79eff4561dbb service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:03.477542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a697a151-68c3-450c-9ad0-79eff4561dbb service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:03.546387 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d853e9e-5985-4c2a-b5fc-b82791c86975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:03.547820 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d853e9e-5985-4c2a-b5fc-b82791c86975 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:03.548033 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d853e9e-5985-4c2a-b5fc-b82791c86975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:03.548306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d853e9e-5985-4c2a-b5fc-b82791c86975 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:03.549030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d853e9e-5985-4c2a-b5fc-b82791c86975 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:03.551002 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d853e9e-5985-4c2a-b5fc-b82791c86975 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:03.703741 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1014/2022] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:03 2022] POST /identity/v3/users => generated 294 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:03.705165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5efe67-77ba-4597-8442-86cba5a74be1 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:03.720765 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a5efe67-77ba-4597-8442-86cba5a74be1 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:03.726287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703d395-2e40-45be-8422-0482a9413f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:03.727164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703d395-2e40-45be-8422-0482a9413f4f admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:03.727519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703d395-2e40-45be-8422-0482a9413f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:03.728185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4703d395-2e40-45be-8422-0482a9413f4f admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:03.729020 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703d395-2e40-45be-8422-0482a9413f4f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:03.730986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4703d395-2e40-45be-8422-0482a9413f4f admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:03.748810 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1009/2023] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:03.754790 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d853e9e-5985-4c2a-b5fc-b82791c86975 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:03.768480 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d853e9e-5985-4c2a-b5fc-b82791c86975 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:03.769584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703d395-2e40-45be-8422-0482a9413f4f admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:03.771498 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4703d395-2e40-45be-8422-0482a9413f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:03.779384 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e12aa-4a97-4bfe-b81d-595138e6cb26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:03.780438 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e12aa-4a97-4bfe-b81d-595138e6cb26 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:03.780744 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e12aa-4a97-4bfe-b81d-595138e6cb26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:03.781226 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e12aa-4a97-4bfe-b81d-595138e6cb26 admin admin] PATH_INFO: `/v3/projects/81cdf4a5a11841d890930e5b74c943a9/users/d02900ae817344e7bc555aaa89ad7d22/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:03.800072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4703d395-2e40-45be-8422-0482a9413f4f admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:03.811404 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683b71d-0cfe-4987-8b77-2ca94c510274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:03.813014 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683b71d-0cfe-4987-8b77-2ca94c510274 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:03.813308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683b71d-0cfe-4987-8b77-2ca94c510274 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:03.813590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4683b71d-0cfe-4987-8b77-2ca94c510274 admin admin] PATH_INFO: `/v3/projects/01d89c8f546e433f83dd38fe2192cc0e` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:03.817689 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683b71d-0cfe-4987-8b77-2ca94c510274 admin admin] RBAC: Authorizing `identity:delete_project(project_id=01d89c8f546e433f83dd38fe2192cc0e)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:03.820951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4683b71d-0cfe-4987-8b77-2ca94c510274 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:03.828659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e12aa-4a97-4bfe-b81d-595138e6cb26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cdf4a5a11841d890930e5b74c943a9, user_id=d02900ae817344e7bc555aaa89ad7d22, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:03.831836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0e12aa-4a97-4bfe-b81d-595138e6cb26 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:03.860717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:03.963111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1015/2024] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:03 2022] PUT /identity/v3/projects/81cdf4a5a11841d890930e5b74c943a9/users/d02900ae817344e7bc555aaa89ad7d22/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:03.966973 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e12aa-4a97-4bfe-b81d-595138e6cb26 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:04.040192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4683b71d-0cfe-4987-8b77-2ca94c510274 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '01d89c8f546e433f83dd38fe2192cc0e', 'request_id': 'req-4683b71d-0cfe-4987-8b77-2ca94c510274'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:04.048436 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0e12aa-4a97-4bfe-b81d-595138e6cb26 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:04.110593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a203a3-1173-493a-bf65-fe0a8b68e0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:04.111316 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a203a3-1173-493a-bf65-fe0a8b68e0de admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:04.111599 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a203a3-1173-493a-bf65-fe0a8b68e0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:04.111875 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a203a3-1173-493a-bf65-fe0a8b68e0de admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:04.112629 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a203a3-1173-493a-bf65-fe0a8b68e0de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:04.114296 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a203a3-1173-493a-bf65-fe0a8b68e0de admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:04.124391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1016/2025] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:03 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:38:04.125838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a203a3-1173-493a-bf65-fe0a8b68e0de admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:04.127498 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b5a203a3-1173-493a-bf65-fe0a8b68e0de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:04.142233 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a203a3-1173-493a-bf65-fe0a8b68e0de admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:04.147218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4da5c1-7520-4095-8559-9305762f8dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:04.148840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4da5c1-7520-4095-8559-9305762f8dd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:04.149400 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4da5c1-7520-4095-8559-9305762f8dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:04.150134 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4da5c1-7520-4095-8559-9305762f8dd0 admin admin] PATH_INFO: `/v3/projects/9ad62c09172043039ce5a9c1cffd8ebc` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:04.153216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4da5c1-7520-4095-8559-9305762f8dd0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ad62c09172043039ce5a9c1cffd8ebc)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:04.156239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4da5c1-7520-4095-8559-9305762f8dd0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:04.266036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4683b71d-0cfe-4987-8b77-2ca94c510274 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '01d89c8f546e433f83dd38fe2192cc0e', 'request_id': 'req-4683b71d-0cfe-4987-8b77-2ca94c510274'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:04.274342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4683b71d-0cfe-4987-8b77-2ca94c510274 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '01d89c8f546e433f83dd38fe2192cc0e', 'request_id': 'req-4683b71d-0cfe-4987-8b77-2ca94c510274'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:04.288995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4683b71d-0cfe-4987-8b77-2ca94c510274 admin admin] The token cache is being invalidate because project 01d89c8f546e433f83dd38fe2192cc0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:04.289476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4683b71d-0cfe-4987-8b77-2ca94c510274 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:04.290326 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-4683b71d-0cfe-4987-8b77-2ca94c510274 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:04.292930 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1010/2026] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:03 2022] DELETE /identity/v3/projects/01d89c8f546e433f83dd38fe2192cc0e => generated 0 bytes in 524 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:04.294300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683b71d-0cfe-4987-8b77-2ca94c510274 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:04.299572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4683b71d-0cfe-4987-8b77-2ca94c510274 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:04.305619 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ff4da5c1-7520-4095-8559-9305762f8dd0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ad62c09172043039ce5a9c1cffd8ebc', 'request_id': 'req-ff4da5c1-7520-4095-8559-9305762f8dd0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:04.313371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ff4da5c1-7520-4095-8559-9305762f8dd0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ad62c09172043039ce5a9c1cffd8ebc', 'request_id': 'req-ff4da5c1-7520-4095-8559-9305762f8dd0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:04.313625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4683b71d-0cfe-4987-8b77-2ca94c510274 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:04.319463 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ff4da5c1-7520-4095-8559-9305762f8dd0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ad62c09172043039ce5a9c1cffd8ebc', 'request_id': 'req-ff4da5c1-7520-4095-8559-9305762f8dd0'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:04.381085 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a603b8-b6a7-4b75-a71b-17dc99ccd96f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:04.382440 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a603b8-b6a7-4b75-a71b-17dc99ccd96f admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:04.382933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a603b8-b6a7-4b75-a71b-17dc99ccd96f admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:04.383415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a603b8-b6a7-4b75-a71b-17dc99ccd96f admin admin] PATH_INFO: `/v3/projects/81cdf4a5a11841d890930e5b74c943a9/users/d02900ae817344e7bc555aaa89ad7d22/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:04.385856 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a603b8-b6a7-4b75-a71b-17dc99ccd96f admin admin] RBAC: Authorizing `identity:create_grant(project_id=81cdf4a5a11841d890930e5b74c943a9, user_id=d02900ae817344e7bc555aaa89ad7d22, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:04.389231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39a603b8-b6a7-4b75-a71b-17dc99ccd96f admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:04.402989 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1011/2027] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:04 2022] PUT /identity/v3/projects/81cdf4a5a11841d890930e5b74c943a9/users/d02900ae817344e7bc555aaa89ad7d22/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:04.405524 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a0341-597e-4f56-8ac8-84fdf70b1b23 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:04.407026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a0341-597e-4f56-8ac8-84fdf70b1b23 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:04.407298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1a0341-597e-4f56-8ac8-84fdf70b1b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:04.421179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ff4da5c1-7520-4095-8559-9305762f8dd0 admin admin] The token cache is being invalidate because project 9ad62c09172043039ce5a9c1cffd8ebc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:04.422436 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ff4da5c1-7520-4095-8559-9305762f8dd0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:04.423627 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-ff4da5c1-7520-4095-8559-9305762f8dd0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:04.427192 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1017/2028] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:04 2022] DELETE /identity/v3/projects/9ad62c09172043039ce5a9c1cffd8ebc => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:04.431698 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52127e83-22a6-4361-9262-ee172cdc40ca None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:04.432094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52127e83-22a6-4361-9262-ee172cdc40ca None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:04.432804 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52127e83-22a6-4361-9262-ee172cdc40ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:04.444372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-3b1a0341-597e-4f56-8ac8-84fdf70b1b23 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:04.445611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3b1a0341-597e-4f56-8ac8-84fdf70b1b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:04.487772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-52127e83-22a6-4361-9262-ee172cdc40ca None None] MFA Rules not processed for user `d02900ae817344e7bc555aaa89ad7d22`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:04.489205 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-52127e83-22a6-4361-9262-ee172cdc40ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:04.533956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1012/2029] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:04.535087 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a0341-597e-4f56-8ac8-84fdf70b1b23 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:04.536680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3b1a0341-597e-4f56-8ac8-84fdf70b1b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:04.554072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1a0341-597e-4f56-8ac8-84fdf70b1b23 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:04.559942 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d504b-6ead-4b75-ad6c-f88f6936113a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:04.560830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d504b-6ead-4b75-ad6c-f88f6936113a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:04.561108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d504b-6ead-4b75-ad6c-f88f6936113a admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:04.561379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d504b-6ead-4b75-ad6c-f88f6936113a admin admin] PATH_INFO: `/v3/users/f7243890858c4184ae8668d96f79b55f` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:04.563188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d504b-6ead-4b75-ad6c-f88f6936113a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f7243890858c4184ae8668d96f79b55f)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:04.566422 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3d504b-6ead-4b75-ad6c-f88f6936113a admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:04.594795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1018/2030] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:04 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:04.596228 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40a74a-8d58-46ba-ae4c-09c5286e4449 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:04.596520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40a74a-8d58-46ba-ae4c-09c5286e4449 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:04.596800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40a74a-8d58-46ba-ae4c-09c5286e4449 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:04.620286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9d40a74a-8d58-46ba-ae4c-09c5286e4449 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:04.623412 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9d40a74a-8d58-46ba-ae4c-09c5286e4449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:04.633377 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1019/2031] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:04.637114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40a74a-8d58-46ba-ae4c-09c5286e4449 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:04.637114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9d40a74a-8d58-46ba-ae4c-09c5286e4449 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:04.696502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d40a74a-8d58-46ba-ae4c-09c5286e4449 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:04.700173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f97a96-089d-4eb7-aaab-8314c34d3fd5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:04.700824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f97a96-089d-4eb7-aaab-8314c34d3fd5 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:04.701108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f97a96-089d-4eb7-aaab-8314c34d3fd5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:04.701384 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f97a96-089d-4eb7-aaab-8314c34d3fd5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:04.703205 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-14f97a96-089d-4eb7-aaab-8314c34d3fd5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:04.765112 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f97a96-089d-4eb7-aaab-8314c34d3fd5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:04.766983 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f97a96-089d-4eb7-aaab-8314c34d3fd5 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:04.776042 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1020/2032] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:04 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:04.776903 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f97a96-089d-4eb7-aaab-8314c34d3fd5 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:04.788345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f97a96-089d-4eb7-aaab-8314c34d3fd5 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:04.793336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf7c14-9336-40c4-9b58-1c9211188e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:04.793988 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf7c14-9336-40c4-9b58-1c9211188e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:04.794290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf7c14-9336-40c4-9b58-1c9211188e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:04.794577 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77bf7c14-9336-40c4-9b58-1c9211188e99 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:04.795334 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf7c14-9336-40c4-9b58-1c9211188e99 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:04.795641 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf7c14-9336-40c4-9b58-1c9211188e99 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:04.798425 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77bf7c14-9336-40c4-9b58-1c9211188e99 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:04.810936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1021/2033] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:38:04.815751 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf7c14-9336-40c4-9b58-1c9211188e99 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:04.826584 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77bf7c14-9336-40c4-9b58-1c9211188e99 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:04.833250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a485dde-60f3-4e9b-97bc-df6604cf73bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:04.833916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485dde-60f3-4e9b-97bc-df6604cf73bc admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:04.834200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485dde-60f3-4e9b-97bc-df6604cf73bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:04.834845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a485dde-60f3-4e9b-97bc-df6604cf73bc admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:04.835623 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a485dde-60f3-4e9b-97bc-df6604cf73bc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:04.837881 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a485dde-60f3-4e9b-97bc-df6604cf73bc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:04.854523 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6e3d504b-6ead-4b75-ad6c-f88f6936113a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f7243890858c4184ae8668d96f79b55f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:04.855397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6e3d504b-6ead-4b75-ad6c-f88f6936113a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f7243890858c4184ae8668d96f79b55f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:04.951610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6e3d504b-6ead-4b75-ad6c-f88f6936113a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f7243890858c4184ae8668d96f79b55f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:04.952370 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6e3d504b-6ead-4b75-ad6c-f88f6936113a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f7243890858c4184ae8668d96f79b55f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:04.961243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1022/2034] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:04 2022] POST /identity/v3/projects => generated 385 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:04.965457 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a485dde-60f3-4e9b-97bc-df6604cf73bc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:04.967159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2a485dde-60f3-4e9b-97bc-df6604cf73bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:04.971038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6e3d504b-6ead-4b75-ad6c-f88f6936113a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f7243890858c4184ae8668d96f79b55f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:04.984929 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1013/2035] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:04 2022] DELETE /identity/v3/users/f7243890858c4184ae8668d96f79b55f => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:05.043518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a485dde-60f3-4e9b-97bc-df6604cf73bc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:05.105738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793e3b0-e96d-4736-a25c-27826f22003d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:05.106538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793e3b0-e96d-4736-a25c-27826f22003d admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:05.106863 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793e3b0-e96d-4736-a25c-27826f22003d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:05.107140 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c793e3b0-e96d-4736-a25c-27826f22003d admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:05.107843 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793e3b0-e96d-4736-a25c-27826f22003d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:05.109795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c793e3b0-e96d-4736-a25c-27826f22003d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:05.332756 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1023/2036] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:04 2022] POST /identity/v3/users => generated 293 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:05.336441 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d504b-6ead-4b75-ad6c-f88f6936113a admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:05.347646 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d504b-6ead-4b75-ad6c-f88f6936113a admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:05.354665 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a4361-9b9f-4b96-8bf9-996bc9128ef8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:05.355388 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a4361-9b9f-4b96-8bf9-996bc9128ef8 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:05.358190 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a4361-9b9f-4b96-8bf9-996bc9128ef8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:05.358190 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71a4361-9b9f-4b96-8bf9-996bc9128ef8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:05.358190 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a4361-9b9f-4b96-8bf9-996bc9128ef8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:05.358409 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71a4361-9b9f-4b96-8bf9-996bc9128ef8 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:05.375151 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1014/2037] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:05.377681 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793e3b0-e96d-4736-a25c-27826f22003d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:05.389555 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c793e3b0-e96d-4736-a25c-27826f22003d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:05.396134 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422c373-91fa-45d5-9a36-dbce0ff84e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:05.396883 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422c373-91fa-45d5-9a36-dbce0ff84e85 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:05.397276 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422c373-91fa-45d5-9a36-dbce0ff84e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:05.397635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d422c373-91fa-45d5-9a36-dbce0ff84e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:05.398453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422c373-91fa-45d5-9a36-dbce0ff84e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:05.400576 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d422c373-91fa-45d5-9a36-dbce0ff84e85 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:05.416438 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1024/2038] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:05.416634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a4361-9b9f-4b96-8bf9-996bc9128ef8 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:05.430804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71a4361-9b9f-4b96-8bf9-996bc9128ef8 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:05.442365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f73fdb-5713-4ce5-a2dd-cbec136c8f3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:05.444320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f73fdb-5713-4ce5-a2dd-cbec136c8f3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:05.444647 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f73fdb-5713-4ce5-a2dd-cbec136c8f3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:05.445182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f73fdb-5713-4ce5-a2dd-cbec136c8f3d admin admin] PATH_INFO: `/v3/projects/83f162a5892f49c6889fff30eae17acf/users/83dd6e6258fe4b58b006b933d8703573/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:05.466721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f73fdb-5713-4ce5-a2dd-cbec136c8f3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=83f162a5892f49c6889fff30eae17acf, user_id=83dd6e6258fe4b58b006b933d8703573, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:05.470250 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f73fdb-5713-4ce5-a2dd-cbec136c8f3d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:05.522486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422c373-91fa-45d5-9a36-dbce0ff84e85 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:05.525049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d422c373-91fa-45d5-9a36-dbce0ff84e85 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:05.560532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d422c373-91fa-45d5-9a36-dbce0ff84e85 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:05.566689 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3cc74e-5f90-44ac-9c70-a55ca6a61c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:05.568384 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cc74e-5f90-44ac-9c70-a55ca6a61c3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:05.569119 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cc74e-5f90-44ac-9c70-a55ca6a61c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:05.569670 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3cc74e-5f90-44ac-9c70-a55ca6a61c3d admin admin] PATH_INFO: `/v3/projects/fa7d834c7b7e42e2b135de30b08db61a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:05.571487 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cc74e-5f90-44ac-9c70-a55ca6a61c3d admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa7d834c7b7e42e2b135de30b08db61a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:05.573713 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3cc74e-5f90-44ac-9c70-a55ca6a61c3d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:05.583491 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1015/2039] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:05 2022] PUT /identity/v3/projects/83f162a5892f49c6889fff30eae17acf/users/83dd6e6258fe4b58b006b933d8703573/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:38:05.601144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f295f3c-62fa-421b-be2f-9bd69fdcdd94 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:05.608123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f295f3c-62fa-421b-be2f-9bd69fdcdd94 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:05.608123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f295f3c-62fa-421b-be2f-9bd69fdcdd94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:05.650397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-1f295f3c-62fa-421b-be2f-9bd69fdcdd94 None None] MFA Rules not processed for user `83dd6e6258fe4b58b006b933d8703573`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:05.652101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1f295f3c-62fa-421b-be2f-9bd69fdcdd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:05.749301 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1016/2040] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:05 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:38:05.749539 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7c3cc74e-5f90-44ac-9c70-a55ca6a61c3d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa7d834c7b7e42e2b135de30b08db61a', 'request_id': 'req-7c3cc74e-5f90-44ac-9c70-a55ca6a61c3d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:05.762985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f295f3c-62fa-421b-be2f-9bd69fdcdd94 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:05.764702 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1f295f3c-62fa-421b-be2f-9bd69fdcdd94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:05.776437 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7c3cc74e-5f90-44ac-9c70-a55ca6a61c3d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa7d834c7b7e42e2b135de30b08db61a', 'request_id': 'req-7c3cc74e-5f90-44ac-9c70-a55ca6a61c3d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:05.788742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7c3cc74e-5f90-44ac-9c70-a55ca6a61c3d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa7d834c7b7e42e2b135de30b08db61a', 'request_id': 'req-7c3cc74e-5f90-44ac-9c70-a55ca6a61c3d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:05.858446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f295f3c-62fa-421b-be2f-9bd69fdcdd94 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:05.917799 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2cda68-8ea4-4d2a-af1c-0f2c56f767a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:05.918629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cda68-8ea4-4d2a-af1c-0f2c56f767a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:05.919038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cda68-8ea4-4d2a-af1c-0f2c56f767a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:05.919415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2cda68-8ea4-4d2a-af1c-0f2c56f767a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:05.943648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7c3cc74e-5f90-44ac-9c70-a55ca6a61c3d admin admin] The token cache is being invalidate because project fa7d834c7b7e42e2b135de30b08db61a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:05.943999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7c3cc74e-5f90-44ac-9c70-a55ca6a61c3d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:05.945130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7c3cc74e-5f90-44ac-9c70-a55ca6a61c3d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:05.947455 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1025/2041] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:05 2022] DELETE /identity/v3/projects/fa7d834c7b7e42e2b135de30b08db61a => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:05.952244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c792269-179a-4a3f-8a95-adfa1a575e33 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:05.952564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c792269-179a-4a3f-8a95-adfa1a575e33 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:05.952956 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c792269-179a-4a3f-8a95-adfa1a575e33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:05.991179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9c792269-179a-4a3f-8a95-adfa1a575e33 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:05.993458 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9c792269-179a-4a3f-8a95-adfa1a575e33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:06.017980 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cda68-8ea4-4d2a-af1c-0f2c56f767a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:06.019689 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2cda68-8ea4-4d2a-af1c-0f2c56f767a7 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:06.031392 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1017/2042] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:05 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:38:06.044152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:06.106072 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1026/2043] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:38:06.115168 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637485c-fee0-4ef3-920e-5907c7337ab5 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:06.115557 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637485c-fee0-4ef3-920e-5907c7337ab5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:06.115919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3637485c-fee0-4ef3-920e-5907c7337ab5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:06.138273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-3637485c-fee0-4ef3-920e-5907c7337ab5 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:06.139749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3637485c-fee0-4ef3-920e-5907c7337ab5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:06.150442 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1018/2044] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:06.154803 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c792269-179a-4a3f-8a95-adfa1a575e33 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:06.167222 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c792269-179a-4a3f-8a95-adfa1a575e33 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:06.179001 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9af1b0-1d20-4171-b8f4-d3cb9670412d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:06.180053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9af1b0-1d20-4171-b8f4-d3cb9670412d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:06.181247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9af1b0-1d20-4171-b8f4-d3cb9670412d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:06.183036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9af1b0-1d20-4171-b8f4-d3cb9670412d admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:06.185338 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9af1b0-1d20-4171-b8f4-d3cb9670412d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:06.185338 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9af1b0-1d20-4171-b8f4-d3cb9670412d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:06.187863 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9af1b0-1d20-4171-b8f4-d3cb9670412d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:06.214802 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1027/2045] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:38:06.219257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637485c-fee0-4ef3-920e-5907c7337ab5 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:06.229461 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3637485c-fee0-4ef3-920e-5907c7337ab5 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:06.235299 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cc333-5be9-4879-aea9-4dcf4064f6e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:06.236001 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cc333-5be9-4879-aea9-4dcf4064f6e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:06.236286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cc333-5be9-4879-aea9-4dcf4064f6e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:06.236755 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31cc333-5be9-4879-aea9-4dcf4064f6e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:06.237843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cc333-5be9-4879-aea9-4dcf4064f6e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:06.239770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31cc333-5be9-4879-aea9-4dcf4064f6e5 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:06.384320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1019/2046] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:06 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:06.388553 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9af1b0-1d20-4171-b8f4-d3cb9670412d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:06.399296 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9af1b0-1d20-4171-b8f4-d3cb9670412d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:06.462586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605223a-5fda-4ee6-b917-dabd47773f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:06.463595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605223a-5fda-4ee6-b917-dabd47773f39 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:06.463880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605223a-5fda-4ee6-b917-dabd47773f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:06.464156 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4605223a-5fda-4ee6-b917-dabd47773f39 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:06.464856 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605223a-5fda-4ee6-b917-dabd47773f39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:06.466913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4605223a-5fda-4ee6-b917-dabd47773f39 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:06.581723 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1028/2047] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:06 2022] POST /identity/v3/users => generated 292 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:06.586078 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cc333-5be9-4879-aea9-4dcf4064f6e5 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:06.598381 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31cc333-5be9-4879-aea9-4dcf4064f6e5 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:06.607507 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4556b-ec70-4456-9385-f811e2fb69db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:06.608225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4556b-ec70-4456-9385-f811e2fb69db admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:06.608570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4556b-ec70-4456-9385-f811e2fb69db admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:06.608787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de4556b-ec70-4456-9385-f811e2fb69db admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:06.609907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4556b-ec70-4456-9385-f811e2fb69db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:06.611627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de4556b-ec70-4456-9385-f811e2fb69db admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:06.622965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1020/2048] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:38:06.627341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605223a-5fda-4ee6-b917-dabd47773f39 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:06.638130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4605223a-5fda-4ee6-b917-dabd47773f39 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:06.643567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39851126-f5b9-4617-a9d2-9cc36c0c505a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:06.644228 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39851126-f5b9-4617-a9d2-9cc36c0c505a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:06.644517 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39851126-f5b9-4617-a9d2-9cc36c0c505a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:06.644794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39851126-f5b9-4617-a9d2-9cc36c0c505a admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:06.645542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39851126-f5b9-4617-a9d2-9cc36c0c505a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:06.647239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39851126-f5b9-4617-a9d2-9cc36c0c505a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:06.659152 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1029/2049] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:06.666697 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4556b-ec70-4456-9385-f811e2fb69db admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:06.676889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de4556b-ec70-4456-9385-f811e2fb69db admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:06.681575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012af434-dbb5-4827-a7d2-5f6c87169693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:06.682462 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012af434-dbb5-4827-a7d2-5f6c87169693 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:06.682744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012af434-dbb5-4827-a7d2-5f6c87169693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:06.683053 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012af434-dbb5-4827-a7d2-5f6c87169693 admin admin] PATH_INFO: `/v3/projects/cd4ac8555a5245eeb729e7292f400f2c/users/ed1bf1c68201466eb95b6e1d4ef4d616/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:06.699896 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012af434-dbb5-4827-a7d2-5f6c87169693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd4ac8555a5245eeb729e7292f400f2c, user_id=ed1bf1c68201466eb95b6e1d4ef4d616, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:06.700083 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:06.702596 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012af434-dbb5-4827-a7d2-5f6c87169693 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:06.839787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1021/2050] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:06 2022] PUT /identity/v3/projects/cd4ac8555a5245eeb729e7292f400f2c/users/ed1bf1c68201466eb95b6e1d4ef4d616/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:06.854477 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ef916-9880-411b-80dd-19597e519c35 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:06.858824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ef916-9880-411b-80dd-19597e519c35 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:06.859346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970ef916-9880-411b-80dd-19597e519c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:06.916626 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-970ef916-9880-411b-80dd-19597e519c35 None None] MFA Rules not processed for user `ed1bf1c68201466eb95b6e1d4ef4d616`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:06.917971 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-970ef916-9880-411b-80dd-19597e519c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:07.066812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1030/2051] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:06 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:07.068748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012af434-dbb5-4827-a7d2-5f6c87169693 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:07.173708 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012af434-dbb5-4827-a7d2-5f6c87169693 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:07.178980 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276a204-faf0-4863-ae07-af55db67b591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:07.179846 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276a204-faf0-4863-ae07-af55db67b591 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:07.180131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276a204-faf0-4863-ae07-af55db67b591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:07.180408 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e276a204-faf0-4863-ae07-af55db67b591 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:07.181112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276a204-faf0-4863-ae07-af55db67b591 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:07.183067 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e276a204-faf0-4863-ae07-af55db67b591 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:07.288168 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1022/2052] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:07 2022] POST /identity/v3/projects => generated 383 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:07.292352 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ef916-9880-411b-80dd-19597e519c35 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:07.304735 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970ef916-9880-411b-80dd-19597e519c35 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:07.373402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a9b97-bf2e-4bc3-bd88-d47c7cd82479 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:07.374610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9b97-bf2e-4bc3-bd88-d47c7cd82479 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:07.375074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9b97-bf2e-4bc3-bd88-d47c7cd82479 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:07.375603 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41a9b97-bf2e-4bc3-bd88-d47c7cd82479 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:07.377001 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a9b97-bf2e-4bc3-bd88-d47c7cd82479 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:07.380009 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f41a9b97-bf2e-4bc3-bd88-d47c7cd82479 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:07.550114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1031/2053] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:07 2022] POST /identity/v3/users => generated 298 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:38:07.559079 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276a204-faf0-4863-ae07-af55db67b591 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:07.571626 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e276a204-faf0-4863-ae07-af55db67b591 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:07.576374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19fcdc-725d-4c8d-957a-774471d46820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:07.577077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19fcdc-725d-4c8d-957a-774471d46820 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:07.577365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19fcdc-725d-4c8d-957a-774471d46820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:07.577644 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19fcdc-725d-4c8d-957a-774471d46820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:07.578483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19fcdc-725d-4c8d-957a-774471d46820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:07.580722 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a19fcdc-725d-4c8d-957a-774471d46820 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:07.592303 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1023/2054] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:07.596779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a9b97-bf2e-4bc3-bd88-d47c7cd82479 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:07.607497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f41a9b97-bf2e-4bc3-bd88-d47c7cd82479 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:07.612960 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78254697-5a57-4501-a2bf-2dba07b588f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:07.613975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78254697-5a57-4501-a2bf-2dba07b588f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:07.614362 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78254697-5a57-4501-a2bf-2dba07b588f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:07.614874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78254697-5a57-4501-a2bf-2dba07b588f1 admin admin] PATH_INFO: `/v3/projects/9e697b307f3842ffb6056930c23e99e4/users/436a622f48db4954adb6e86a8b8d9e27/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:07.632109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78254697-5a57-4501-a2bf-2dba07b588f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e697b307f3842ffb6056930c23e99e4, user_id=436a622f48db4954adb6e86a8b8d9e27, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:07.634988 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78254697-5a57-4501-a2bf-2dba07b588f1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:08.406214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1032/2055] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:07 2022] PUT /identity/v3/projects/9e697b307f3842ffb6056930c23e99e4/users/436a622f48db4954adb6e86a8b8d9e27/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 810 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:08.411405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19fcdc-725d-4c8d-957a-774471d46820 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:08.423189 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19fcdc-725d-4c8d-957a-774471d46820 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:08.492673 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246a9d6-f25a-429c-8516-3b549cc3f0c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:08.493466 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246a9d6-f25a-429c-8516-3b549cc3f0c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:08.493748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246a9d6-f25a-429c-8516-3b549cc3f0c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:08.494019 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246a9d6-f25a-429c-8516-3b549cc3f0c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:08.494802 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246a9d6-f25a-429c-8516-3b549cc3f0c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:08.499145 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246a9d6-f25a-429c-8516-3b549cc3f0c2 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:08.510624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1024/2056] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:08.514657 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78254697-5a57-4501-a2bf-2dba07b588f1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:08.526457 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78254697-5a57-4501-a2bf-2dba07b588f1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:08.530980 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683aa92b-eb07-4afb-946b-6dda400f3972 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:08.531884 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683aa92b-eb07-4afb-946b-6dda400f3972 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:08.532744 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683aa92b-eb07-4afb-946b-6dda400f3972 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:08.533244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683aa92b-eb07-4afb-946b-6dda400f3972 admin admin] PATH_INFO: `/v3/projects/9e697b307f3842ffb6056930c23e99e4/users/436a622f48db4954adb6e86a8b8d9e27/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:08.535426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683aa92b-eb07-4afb-946b-6dda400f3972 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e697b307f3842ffb6056930c23e99e4, user_id=436a622f48db4954adb6e86a8b8d9e27, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:08.538060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683aa92b-eb07-4afb-946b-6dda400f3972 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:08.550140 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1033/2057] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:08 2022] PUT /identity/v3/projects/9e697b307f3842ffb6056930c23e99e4/users/436a622f48db4954adb6e86a8b8d9e27/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:38:08.560742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665693b6-7856-4fb9-8a76-6e72ee6d116b None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:08.561245 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665693b6-7856-4fb9-8a76-6e72ee6d116b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:08.561347 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-665693b6-7856-4fb9-8a76-6e72ee6d116b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:08.589435 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-665693b6-7856-4fb9-8a76-6e72ee6d116b None None] MFA Rules not processed for user `436a622f48db4954adb6e86a8b8d9e27`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:08.590699 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-665693b6-7856-4fb9-8a76-6e72ee6d116b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:08.681623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1025/2058] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:08 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:08.699361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683aa92b-eb07-4afb-946b-6dda400f3972 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:08.701415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-683aa92b-eb07-4afb-946b-6dda400f3972 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:08.767889 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683aa92b-eb07-4afb-946b-6dda400f3972 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:08.771629 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670419ff-e86d-45a8-839e-3a71ed005895 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:08.772307 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670419ff-e86d-45a8-839e-3a71ed005895 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:08.772591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670419ff-e86d-45a8-839e-3a71ed005895 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:08.772864 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-670419ff-e86d-45a8-839e-3a71ed005895 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:08.782531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670419ff-e86d-45a8-839e-3a71ed005895 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:08.784174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-670419ff-e86d-45a8-839e-3a71ed005895 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:08.794236 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1034/2059] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:08 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:08.869529 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:08.897352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665693b6-7856-4fb9-8a76-6e72ee6d116b None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:08.908331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-665693b6-7856-4fb9-8a76-6e72ee6d116b None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:08.912052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c3d874-9281-429f-83e9-d7509462684c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:08.912708 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3d874-9281-429f-83e9-d7509462684c service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:08.912994 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3d874-9281-429f-83e9-d7509462684c service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:08.913271 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c3d874-9281-429f-83e9-d7509462684c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:08.976965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3d874-9281-429f-83e9-d7509462684c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:08.978545 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c3d874-9281-429f-83e9-d7509462684c service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:08.989489 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1026/2060] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:08 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:09.550867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670419ff-e86d-45a8-839e-3a71ed005895 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:09.552647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-670419ff-e86d-45a8-839e-3a71ed005895 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:09.629407 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-670419ff-e86d-45a8-839e-3a71ed005895 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:09.634587 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee86b1f-f221-431e-a01d-d070e991c471 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:09.635620 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86b1f-f221-431e-a01d-d070e991c471 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:09.635913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86b1f-f221-431e-a01d-d070e991c471 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:09.636189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee86b1f-f221-431e-a01d-d070e991c471 admin admin] PATH_INFO: `/v3/users/d8affc736bc7420b9d20cd7bd046bdfe` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:09.637405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee86b1f-f221-431e-a01d-d070e991c471 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8affc736bc7420b9d20cd7bd046bdfe)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:09.639415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee86b1f-f221-431e-a01d-d070e991c471 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:09.975622 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4ee86b1f-f221-431e-a01d-d070e991c471 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8affc736bc7420b9d20cd7bd046bdfe'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:09.999147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4ee86b1f-f221-431e-a01d-d070e991c471 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8affc736bc7420b9d20cd7bd046bdfe'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:09.999918 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4ee86b1f-f221-431e-a01d-d070e991c471 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8affc736bc7420b9d20cd7bd046bdfe'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:10.000550 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4ee86b1f-f221-431e-a01d-d070e991c471 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8affc736bc7420b9d20cd7bd046bdfe'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:10.021288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4ee86b1f-f221-431e-a01d-d070e991c471 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8affc736bc7420b9d20cd7bd046bdfe'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:10.140241 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1035/2061] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:09 2022] DELETE /identity/v3/users/d8affc736bc7420b9d20cd7bd046bdfe => generated 0 bytes in 592 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:10.145446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dfa91-dbcc-4d8a-8c32-a1979efcd749 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:10.146015 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dfa91-dbcc-4d8a-8c32-a1979efcd749 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:10.146319 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5dfa91-dbcc-4d8a-8c32-a1979efcd749 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:10.164457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-bb5dfa91-dbcc-4d8a-8c32-a1979efcd749 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:10.165684 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-bb5dfa91-dbcc-4d8a-8c32-a1979efcd749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:10.226940 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1027/2062] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:10.237586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee86b1f-f221-431e-a01d-d070e991c471 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:10.239043 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4ee86b1f-f221-431e-a01d-d070e991c471 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:10.256841 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:10.297056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee86b1f-f221-431e-a01d-d070e991c471 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:10.300843 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60dc1c-d79b-4fbe-adc4-1fde599e4243 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:10.301524 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60dc1c-d79b-4fbe-adc4-1fde599e4243 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:10.301805 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60dc1c-d79b-4fbe-adc4-1fde599e4243 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:10.302081 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f60dc1c-d79b-4fbe-adc4-1fde599e4243 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:10.312456 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60dc1c-d79b-4fbe-adc4-1fde599e4243 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:10.314427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f60dc1c-d79b-4fbe-adc4-1fde599e4243 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:10.326062 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1036/2063] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:10.623836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dfa91-dbcc-4d8a-8c32-a1979efcd749 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:10.625413 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-bb5dfa91-dbcc-4d8a-8c32-a1979efcd749 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:10.638465 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5dfa91-dbcc-4d8a-8c32-a1979efcd749 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:10.644584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b59abfe-2208-48e1-9b26-7cd6faeb75f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:10.645488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59abfe-2208-48e1-9b26-7cd6faeb75f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:10.645807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59abfe-2208-48e1-9b26-7cd6faeb75f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:10.646084 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b59abfe-2208-48e1-9b26-7cd6faeb75f0 admin admin] PATH_INFO: `/v3/users/83dd6e6258fe4b58b006b933d8703573` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:10.647335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59abfe-2208-48e1-9b26-7cd6faeb75f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83dd6e6258fe4b58b006b933d8703573)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:10.649535 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b59abfe-2208-48e1-9b26-7cd6faeb75f0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:10.903688 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60dc1c-d79b-4fbe-adc4-1fde599e4243 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:10.905407 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1f60dc1c-d79b-4fbe-adc4-1fde599e4243 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:10.919188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8b59abfe-2208-48e1-9b26-7cd6faeb75f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83dd6e6258fe4b58b006b933d8703573'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:10.919833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f60dc1c-d79b-4fbe-adc4-1fde599e4243 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:10.920009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8b59abfe-2208-48e1-9b26-7cd6faeb75f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83dd6e6258fe4b58b006b933d8703573'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:10.927132 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:10.929399 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c601c-e232-4c2e-bd04-d07e07953d18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:10.930371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c601c-e232-4c2e-bd04-d07e07953d18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:10.930601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c601c-e232-4c2e-bd04-d07e07953d18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:10.930904 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03c601c-e232-4c2e-bd04-d07e07953d18 admin admin] PATH_INFO: `/v3/projects/96c6beae8c82407ba71dffdcac8dbd00` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:10.932540 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c601c-e232-4c2e-bd04-d07e07953d18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96c6beae8c82407ba71dffdcac8dbd00)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:10.934539 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03c601c-e232-4c2e-bd04-d07e07953d18 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:11.039083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8b59abfe-2208-48e1-9b26-7cd6faeb75f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83dd6e6258fe4b58b006b933d8703573'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:11.040554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8b59abfe-2208-48e1-9b26-7cd6faeb75f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83dd6e6258fe4b58b006b933d8703573'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:11.058412 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8b59abfe-2208-48e1-9b26-7cd6faeb75f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83dd6e6258fe4b58b006b933d8703573'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:11.081297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f03c601c-e232-4c2e-bd04-d07e07953d18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96c6beae8c82407ba71dffdcac8dbd00', 'request_id': 'req-f03c601c-e232-4c2e-bd04-d07e07953d18'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:11.091798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1028/2064] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:10 2022] DELETE /identity/v3/users/83dd6e6258fe4b58b006b933d8703573 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:11.096669 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccf610-fc8d-4b87-a68f-1def7ba0f336 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:11.096846 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccf610-fc8d-4b87-a68f-1def7ba0f336 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:11.097226 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ccf610-fc8d-4b87-a68f-1def7ba0f336 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:11.097532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f03c601c-e232-4c2e-bd04-d07e07953d18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96c6beae8c82407ba71dffdcac8dbd00', 'request_id': 'req-f03c601c-e232-4c2e-bd04-d07e07953d18'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:11.111175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f03c601c-e232-4c2e-bd04-d07e07953d18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96c6beae8c82407ba71dffdcac8dbd00', 'request_id': 'req-f03c601c-e232-4c2e-bd04-d07e07953d18'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:11.135424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-32ccf610-fc8d-4b87-a68f-1def7ba0f336 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:11.136649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-32ccf610-fc8d-4b87-a68f-1def7ba0f336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:11.214867 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1029/2065] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:11.225461 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccf610-fc8d-4b87-a68f-1def7ba0f336 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:11.226918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-32ccf610-fc8d-4b87-a68f-1def7ba0f336 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:11.285133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ccf610-fc8d-4b87-a68f-1def7ba0f336 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:11.288814 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b20b6-9588-45a5-9d1c-80ac6a1984f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:11.289669 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b20b6-9588-45a5-9d1c-80ac6a1984f5 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:11.289983 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b20b6-9588-45a5-9d1c-80ac6a1984f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:11.290261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689b20b6-9588-45a5-9d1c-80ac6a1984f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:11.301390 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b20b6-9588-45a5-9d1c-80ac6a1984f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:11.302888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689b20b6-9588-45a5-9d1c-80ac6a1984f5 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:11.315140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1030/2066] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:38:11.342325 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f03c601c-e232-4c2e-bd04-d07e07953d18 admin admin] The token cache is being invalidate because project 96c6beae8c82407ba71dffdcac8dbd00 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:11.342325 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f03c601c-e232-4c2e-bd04-d07e07953d18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:11.342325 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f03c601c-e232-4c2e-bd04-d07e07953d18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:11.342919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1037/2067] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:10 2022] DELETE /identity/v3/projects/96c6beae8c82407ba71dffdcac8dbd00 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:38:11.351861 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b20b6-9588-45a5-9d1c-80ac6a1984f5 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:11.353645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-689b20b6-9588-45a5-9d1c-80ac6a1984f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:11.369667 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689b20b6-9588-45a5-9d1c-80ac6a1984f5 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:11.375455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22173493-2094-4944-845b-f83cc1bbb503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:11.377220 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22173493-2094-4944-845b-f83cc1bbb503 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:11.377220 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22173493-2094-4944-845b-f83cc1bbb503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:11.377641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22173493-2094-4944-845b-f83cc1bbb503 admin admin] PATH_INFO: `/v3/users/d02900ae817344e7bc555aaa89ad7d22` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:11.379516 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22173493-2094-4944-845b-f83cc1bbb503 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d02900ae817344e7bc555aaa89ad7d22)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:11.381646 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22173493-2094-4944-845b-f83cc1bbb503 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:11.676987 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-22173493-2094-4944-845b-f83cc1bbb503 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd02900ae817344e7bc555aaa89ad7d22'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:11.677678 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-22173493-2094-4944-845b-f83cc1bbb503 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd02900ae817344e7bc555aaa89ad7d22'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:11.770409 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-22173493-2094-4944-845b-f83cc1bbb503 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd02900ae817344e7bc555aaa89ad7d22'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:11.771208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-22173493-2094-4944-845b-f83cc1bbb503 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd02900ae817344e7bc555aaa89ad7d22'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:11.786591 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-22173493-2094-4944-845b-f83cc1bbb503 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd02900ae817344e7bc555aaa89ad7d22'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:11.801377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1031/2068] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:11 2022] DELETE /identity/v3/users/d02900ae817344e7bc555aaa89ad7d22 => generated 0 bytes in 450 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:11.828411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c601c-e232-4c2e-bd04-d07e07953d18 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:11.830714 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f03c601c-e232-4c2e-bd04-d07e07953d18 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:11.931972 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03c601c-e232-4c2e-bd04-d07e07953d18 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:11.996255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1436c531-fe63-4aa9-8471-5df44fd9bddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:11.997175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436c531-fe63-4aa9-8471-5df44fd9bddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:11.997496 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436c531-fe63-4aa9-8471-5df44fd9bddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:11.997773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1436c531-fe63-4aa9-8471-5df44fd9bddd admin admin] PATH_INFO: `/v3/projects/83f162a5892f49c6889fff30eae17acf` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:11.999015 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436c531-fe63-4aa9-8471-5df44fd9bddd admin admin] RBAC: Authorizing `identity:delete_project(project_id=83f162a5892f49c6889fff30eae17acf)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:12.001633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1436c531-fe63-4aa9-8471-5df44fd9bddd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:12.275977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1436c531-fe63-4aa9-8471-5df44fd9bddd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83f162a5892f49c6889fff30eae17acf', 'request_id': 'req-1436c531-fe63-4aa9-8471-5df44fd9bddd'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:12.283557 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1436c531-fe63-4aa9-8471-5df44fd9bddd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83f162a5892f49c6889fff30eae17acf', 'request_id': 'req-1436c531-fe63-4aa9-8471-5df44fd9bddd'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:12.289466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1436c531-fe63-4aa9-8471-5df44fd9bddd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83f162a5892f49c6889fff30eae17acf', 'request_id': 'req-1436c531-fe63-4aa9-8471-5df44fd9bddd'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:12.461441 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1436c531-fe63-4aa9-8471-5df44fd9bddd admin admin] The token cache is being invalidate because project 83f162a5892f49c6889fff30eae17acf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:12.461734 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1436c531-fe63-4aa9-8471-5df44fd9bddd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:12.462476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1436c531-fe63-4aa9-8471-5df44fd9bddd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:12.464096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1038/2069] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:11 2022] DELETE /identity/v3/projects/83f162a5892f49c6889fff30eae17acf => generated 0 bytes in 636 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:12.469507 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dc3fc-5530-48c8-997d-c17957da41ab None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:12.470112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dc3fc-5530-48c8-997d-c17957da41ab None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:12.470112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2dc3fc-5530-48c8-997d-c17957da41ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:12.489033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-dc2dc3fc-5530-48c8-997d-c17957da41ab None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:12.490470 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-dc2dc3fc-5530-48c8-997d-c17957da41ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:12.552975 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1032/2070] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:12.560902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a61ef-6510-4562-a57a-acb6da743978 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:12.564509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a61ef-6510-4562-a57a-acb6da743978 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:12.564509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2a61ef-6510-4562-a57a-acb6da743978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:12.568966 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dc3fc-5530-48c8-997d-c17957da41ab None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:12.570397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-dc2dc3fc-5530-48c8-997d-c17957da41ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:12.590345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2dc3fc-5530-48c8-997d-c17957da41ab None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:12.590530 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0e2a61ef-6510-4562-a57a-acb6da743978 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:12.593399 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0e2a61ef-6510-4562-a57a-acb6da743978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:12.599500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654bac4-8a98-46e2-a9db-654d72726356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:12.600402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654bac4-8a98-46e2-a9db-654d72726356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:12.600690 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654bac4-8a98-46e2-a9db-654d72726356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:12.600965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a654bac4-8a98-46e2-a9db-654d72726356 admin admin] PATH_INFO: `/v3/projects/81cdf4a5a11841d890930e5b74c943a9` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:12.603850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654bac4-8a98-46e2-a9db-654d72726356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=81cdf4a5a11841d890930e5b74c943a9)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:12.606477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a654bac4-8a98-46e2-a9db-654d72726356 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:12.629105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1039/2071] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 66 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:12.630839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a61ef-6510-4562-a57a-acb6da743978 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:12.634119 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0e2a61ef-6510-4562-a57a-acb6da743978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:12.647075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2a61ef-6510-4562-a57a-acb6da743978 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:12.651829 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb906419-b341-4d14-9f84-3c6500796433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:12.652703 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb906419-b341-4d14-9f84-3c6500796433 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:12.652983 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb906419-b341-4d14-9f84-3c6500796433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:12.653257 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb906419-b341-4d14-9f84-3c6500796433 admin admin] PATH_INFO: `/v3/users/ed1bf1c68201466eb95b6e1d4ef4d616` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:12.654493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb906419-b341-4d14-9f84-3c6500796433 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed1bf1c68201466eb95b6e1d4ef4d616)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:12.657325 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb906419-b341-4d14-9f84-3c6500796433 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:12.794778 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a654bac4-8a98-46e2-a9db-654d72726356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '81cdf4a5a11841d890930e5b74c943a9', 'request_id': 'req-a654bac4-8a98-46e2-a9db-654d72726356'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:12.897836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a654bac4-8a98-46e2-a9db-654d72726356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '81cdf4a5a11841d890930e5b74c943a9', 'request_id': 'req-a654bac4-8a98-46e2-a9db-654d72726356'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:12.904912 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a654bac4-8a98-46e2-a9db-654d72726356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '81cdf4a5a11841d890930e5b74c943a9', 'request_id': 'req-a654bac4-8a98-46e2-a9db-654d72726356'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:12.912155 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bb906419-b341-4d14-9f84-3c6500796433 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed1bf1c68201466eb95b6e1d4ef4d616'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:12.918259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a654bac4-8a98-46e2-a9db-654d72726356 admin admin] The token cache is being invalidate because project 81cdf4a5a11841d890930e5b74c943a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:12.918576 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a654bac4-8a98-46e2-a9db-654d72726356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:12.919278 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a654bac4-8a98-46e2-a9db-654d72726356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:12.925300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1033/2072] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:12 2022] DELETE /identity/v3/projects/81cdf4a5a11841d890930e5b74c943a9 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:12.926236 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654bac4-8a98-46e2-a9db-654d72726356 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:12.927341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bb906419-b341-4d14-9f84-3c6500796433 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed1bf1c68201466eb95b6e1d4ef4d616'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:12.927680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a654bac4-8a98-46e2-a9db-654d72726356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:12.928717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bb906419-b341-4d14-9f84-3c6500796433 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed1bf1c68201466eb95b6e1d4ef4d616'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:12.929489 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bb906419-b341-4d14-9f84-3c6500796433 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed1bf1c68201466eb95b6e1d4ef4d616'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:12.938159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bb906419-b341-4d14-9f84-3c6500796433 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed1bf1c68201466eb95b6e1d4ef4d616'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:13.004530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a654bac4-8a98-46e2-a9db-654d72726356 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:13.009590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f19a3-ba9d-4d33-8001-2e1eea242cac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:13.010261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f19a3-ba9d-4d33-8001-2e1eea242cac admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:13.010587 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f19a3-ba9d-4d33-8001-2e1eea242cac admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:13.010911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99f19a3-ba9d-4d33-8001-2e1eea242cac admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:13.011780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f19a3-ba9d-4d33-8001-2e1eea242cac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:13.012098 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f19a3-ba9d-4d33-8001-2e1eea242cac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:13.013717 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99f19a3-ba9d-4d33-8001-2e1eea242cac admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:13.023356 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1040/2073] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:12 2022] DELETE /identity/v3/users/ed1bf1c68201466eb95b6e1d4ef4d616 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:13.027023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1034/2074] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:38:13.027900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f19a3-ba9d-4d33-8001-2e1eea242cac admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:13.028617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10bc24-89e0-4077-9049-1a54ced3d99a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:13.029318 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10bc24-89e0-4077-9049-1a54ced3d99a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:13.029744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c99f19a3-ba9d-4d33-8001-2e1eea242cac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:13.030064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b10bc24-89e0-4077-9049-1a54ced3d99a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:13.045065 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99f19a3-ba9d-4d33-8001-2e1eea242cac admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:13.052376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9b10bc24-89e0-4077-9049-1a54ced3d99a None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:13.053803 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9b10bc24-89e0-4077-9049-1a54ced3d99a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:13.125256 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c1e37-2973-4598-a811-94a8e0ca94e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:13.126399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c1e37-2973-4598-a811-94a8e0ca94e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:13.126683 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c1e37-2973-4598-a811-94a8e0ca94e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:13.127173 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3c1e37-2973-4598-a811-94a8e0ca94e1 admin admin] PATH_INFO: `/v3/users/6822cf789178423d9a9f362f24c3eb23` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:13.129545 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c1e37-2973-4598-a811-94a8e0ca94e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6822cf789178423d9a9f362f24c3eb23)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:13.131792 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3c1e37-2973-4598-a811-94a8e0ca94e1 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:13.146999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1041/2075] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:13.148837 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa512a7-af5f-4f52-ac88-99061fe50bd6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:13.149130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa512a7-af5f-4f52-ac88-99061fe50bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:13.149410 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa512a7-af5f-4f52-ac88-99061fe50bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:13.169143 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4aa512a7-af5f-4f52-ac88-99061fe50bd6 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:13.170366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4aa512a7-af5f-4f52-ac88-99061fe50bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:13.179429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1042/2076] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:13.183055 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa512a7-af5f-4f52-ac88-99061fe50bd6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:13.183055 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4aa512a7-af5f-4f52-ac88-99061fe50bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:13.196724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa512a7-af5f-4f52-ac88-99061fe50bd6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:13.210831 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13a4c4-8178-4088-8152-3776aef8a6f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:13.211486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13a4c4-8178-4088-8152-3776aef8a6f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:13.211955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13a4c4-8178-4088-8152-3776aef8a6f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:13.212398 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13a4c4-8178-4088-8152-3776aef8a6f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:13.213536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13a4c4-8178-4088-8152-3776aef8a6f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:13.215992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13a4c4-8178-4088-8152-3776aef8a6f0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:13.424818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1043/2077] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:13 2022] POST /identity/v3/projects => generated 373 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:13.426195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba6bca-8ff9-4220-839b-782cb81b823b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:13.426491 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba6bca-8ff9-4220-839b-782cb81b823b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:13.427022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ba6bca-8ff9-4220-839b-782cb81b823b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:13.448914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-31ba6bca-8ff9-4220-839b-782cb81b823b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:13.450354 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-31ba6bca-8ff9-4220-839b-782cb81b823b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:13.498879 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7e3c1e37-2973-4598-a811-94a8e0ca94e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6822cf789178423d9a9f362f24c3eb23'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:13.499772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7e3c1e37-2973-4598-a811-94a8e0ca94e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6822cf789178423d9a9f362f24c3eb23'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:13.521654 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1044/2078] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:13.522523 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba6bca-8ff9-4220-839b-782cb81b823b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:13.523848 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-31ba6bca-8ff9-4220-839b-782cb81b823b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:13.583220 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ba6bca-8ff9-4220-839b-782cb81b823b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:13.586916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bffdb0-cadb-4a70-8870-7ee85f165392 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:13.587576 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bffdb0-cadb-4a70-8870-7ee85f165392 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:13.587869 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bffdb0-cadb-4a70-8870-7ee85f165392 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:13.588145 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bffdb0-cadb-4a70-8870-7ee85f165392 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:13.589974 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a4bffdb0-cadb-4a70-8870-7ee85f165392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:13.604963 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:13.610956 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bffdb0-cadb-4a70-8870-7ee85f165392 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:13.610956 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bffdb0-cadb-4a70-8870-7ee85f165392 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:13.618847 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1045/2079] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:13.619898 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bffdb0-cadb-4a70-8870-7ee85f165392 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:13.621023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7e3c1e37-2973-4598-a811-94a8e0ca94e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6822cf789178423d9a9f362f24c3eb23'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:13.622612 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7e3c1e37-2973-4598-a811-94a8e0ca94e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6822cf789178423d9a9f362f24c3eb23'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:13.623299 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a4bffdb0-cadb-4a70-8870-7ee85f165392 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:13.635798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bffdb0-cadb-4a70-8870-7ee85f165392 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:13.641961 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e51db5-0934-4331-ad1a-a16c35127c32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:13.642641 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e51db5-0934-4331-ad1a-a16c35127c32 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:13.643551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e51db5-0934-4331-ad1a-a16c35127c32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:13.643862 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e51db5-0934-4331-ad1a-a16c35127c32 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:13.645259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e51db5-0934-4331-ad1a-a16c35127c32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:13.647924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e51db5-0934-4331-ad1a-a16c35127c32 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:13.651563 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7e3c1e37-2973-4598-a811-94a8e0ca94e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6822cf789178423d9a9f362f24c3eb23'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:13.678799 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1035/2080] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:13 2022] DELETE /identity/v3/users/6822cf789178423d9a9f362f24c3eb23 => generated 0 bytes in 648 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:13.678799 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c1e37-2973-4598-a811-94a8e0ca94e1 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:13.759648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1046/2081] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:13 2022] POST /identity/v3/users => generated 287 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:13.761108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a77546-245a-49f3-9795-f24a38a6e752 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:13.761852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a77546-245a-49f3-9795-f24a38a6e752 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:13.762145 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a77546-245a-49f3-9795-f24a38a6e752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:13.771209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3c1e37-2973-4598-a811-94a8e0ca94e1 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:13.776423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1701c-2796-4b2e-9f15-7ba21d7c88b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:13.777104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1701c-2796-4b2e-9f15-7ba21d7c88b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:13.777399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1701c-2796-4b2e-9f15-7ba21d7c88b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:13.777663 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b1701c-2796-4b2e-9f15-7ba21d7c88b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:13.778490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1701c-2796-4b2e-9f15-7ba21d7c88b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:13.778696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1701c-2796-4b2e-9f15-7ba21d7c88b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:13.780534 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b1701c-2796-4b2e-9f15-7ba21d7c88b4 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:13.784442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-87a77546-245a-49f3-9795-f24a38a6e752 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:13.787167 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-87a77546-245a-49f3-9795-f24a38a6e752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:13.796641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1036/2082] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:38:13.797133 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1047/2083] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:13.798138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1701c-2796-4b2e-9f15-7ba21d7c88b4 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:13.801583 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a77546-245a-49f3-9795-f24a38a6e752 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:13.812154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a77546-245a-49f3-9795-f24a38a6e752 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:13.817603 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b1701c-2796-4b2e-9f15-7ba21d7c88b4 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:13.825956 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a191505-b9f3-46f1-bbd7-4b13567432a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:13.825956 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a191505-b9f3-46f1-bbd7-4b13567432a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:13.825956 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a191505-b9f3-46f1-bbd7-4b13567432a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:13.825956 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a191505-b9f3-46f1-bbd7-4b13567432a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:13.826338 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a191505-b9f3-46f1-bbd7-4b13567432a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:13.826428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4ab01-6dda-49a8-aeec-b0a1b5552691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:13.826428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4ab01-6dda-49a8-aeec-b0a1b5552691 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:13.826428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4ab01-6dda-49a8-aeec-b0a1b5552691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:13.826428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed4ab01-6dda-49a8-aeec-b0a1b5552691 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:13.826781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a191505-b9f3-46f1-bbd7-4b13567432a2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:13.826867 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4ab01-6dda-49a8-aeec-b0a1b5552691 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:13.827728 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed4ab01-6dda-49a8-aeec-b0a1b5552691 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:13.840199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1037/2084] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:13.841266 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4ab01-6dda-49a8-aeec-b0a1b5552691 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:13.932244 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed4ab01-6dda-49a8-aeec-b0a1b5552691 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:13.937927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c5213-5b45-4b3c-b2ea-c17dd26469c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:13.939310 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c5213-5b45-4b3c-b2ea-c17dd26469c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:13.939673 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c5213-5b45-4b3c-b2ea-c17dd26469c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:13.940080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890c5213-5b45-4b3c-b2ea-c17dd26469c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:13.951071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1048/2085] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:13 2022] POST /identity/v3/projects => generated 369 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:13.952312 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a191505-b9f3-46f1-bbd7-4b13567432a2 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:13.960009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c5213-5b45-4b3c-b2ea-c17dd26469c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:13.961697 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890c5213-5b45-4b3c-b2ea-c17dd26469c7 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:13.974197 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1038/2086] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:13.975163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c5213-5b45-4b3c-b2ea-c17dd26469c7 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:13.986122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890c5213-5b45-4b3c-b2ea-c17dd26469c7 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:14.044877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a191505-b9f3-46f1-bbd7-4b13567432a2 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:14.052170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f9584-fb12-40b1-89c1-923a14a8ab44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:14.053049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f9584-fb12-40b1-89c1-923a14a8ab44 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:14.053538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f9584-fb12-40b1-89c1-923a14a8ab44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:14.053752 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4f4ad-cbfe-4e5a-baaa-f34f91468ec2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:14.053888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9f9584-fb12-40b1-89c1-923a14a8ab44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:14.054471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4f4ad-cbfe-4e5a-baaa-f34f91468ec2 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:14.054601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f9584-fb12-40b1-89c1-923a14a8ab44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:14.054785 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4f4ad-cbfe-4e5a-baaa-f34f91468ec2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:14.055065 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde4f4ad-cbfe-4e5a-baaa-f34f91468ec2 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:14.056165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4f4ad-cbfe-4e5a-baaa-f34f91468ec2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:14.056504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9f9584-fb12-40b1-89c1-923a14a8ab44 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:14.057924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde4f4ad-cbfe-4e5a-baaa-f34f91468ec2 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:14.071129 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1049/2087] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:13 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:14.072045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f9584-fb12-40b1-89c1-923a14a8ab44 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:14.084077 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9f9584-fb12-40b1-89c1-923a14a8ab44 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:14.089237 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f48a923-acc8-4eb6-a240-239962846dfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:14.090323 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48a923-acc8-4eb6-a240-239962846dfd admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:14.090604 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48a923-acc8-4eb6-a240-239962846dfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:14.090937 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f48a923-acc8-4eb6-a240-239962846dfd admin admin] PATH_INFO: `/v3/projects/92aa10fbaae04327a0df3daa13cdd16d/users/0c171fb9aea2460881f3665cdb5ecaa9/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:14.107644 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48a923-acc8-4eb6-a240-239962846dfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=92aa10fbaae04327a0df3daa13cdd16d, user_id=0c171fb9aea2460881f3665cdb5ecaa9, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:14.110677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f48a923-acc8-4eb6-a240-239962846dfd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:14.148364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:14.156555 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1039/2088] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:13 2022] POST /identity/v3/users => generated 285 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:14.161674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4f4ad-cbfe-4e5a-baaa-f34f91468ec2 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:14.172597 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde4f4ad-cbfe-4e5a-baaa-f34f91468ec2 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:14.177816 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc77c3-0ff2-4dbe-a2b2-2e10dcac8dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:14.178706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc77c3-0ff2-4dbe-a2b2-2e10dcac8dca admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:14.179088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc77c3-0ff2-4dbe-a2b2-2e10dcac8dca admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:14.179327 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ebc77c3-0ff2-4dbe-a2b2-2e10dcac8dca admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:14.180059 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc77c3-0ff2-4dbe-a2b2-2e10dcac8dca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:14.181786 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ebc77c3-0ff2-4dbe-a2b2-2e10dcac8dca admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:14.194824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1040/2089] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:14.197116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc77c3-0ff2-4dbe-a2b2-2e10dcac8dca admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:14.208507 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ebc77c3-0ff2-4dbe-a2b2-2e10dcac8dca admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:14.217395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082a259-88dc-4d6c-956e-c2404b70a5d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:14.218708 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082a259-88dc-4d6c-956e-c2404b70a5d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:14.219025 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082a259-88dc-4d6c-956e-c2404b70a5d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:14.219337 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2082a259-88dc-4d6c-956e-c2404b70a5d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:14.220570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082a259-88dc-4d6c-956e-c2404b70a5d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:14.222091 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1050/2090] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:14 2022] PUT /identity/v3/projects/92aa10fbaae04327a0df3daa13cdd16d/users/0c171fb9aea2460881f3665cdb5ecaa9/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:14.222401 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2082a259-88dc-4d6c-956e-c2404b70a5d1 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:14.232371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17254a-15ba-4d23-8e13-19c75091b6ef None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:14.232662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17254a-15ba-4d23-8e13-19c75091b6ef None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:14.233066 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf17254a-15ba-4d23-8e13-19c75091b6ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:14.234194 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1041/2091] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:38:14.238435 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082a259-88dc-4d6c-956e-c2404b70a5d1 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:14.251441 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2082a259-88dc-4d6c-956e-c2404b70a5d1 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:14.276896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-cf17254a-15ba-4d23-8e13-19c75091b6ef None None] MFA Rules not processed for user `0c171fb9aea2460881f3665cdb5ecaa9`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:14.278395 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cf17254a-15ba-4d23-8e13-19c75091b6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:14.383424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda78533-f254-4a0f-80f2-058cfad048a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:14.384289 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda78533-f254-4a0f-80f2-058cfad048a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:14.384614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda78533-f254-4a0f-80f2-058cfad048a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:14.384890 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda78533-f254-4a0f-80f2-058cfad048a8 admin admin] PATH_INFO: `/v3/projects/5a85dd6dee5e4ba5aaf86cea1ce84dc0/users/4014febac1134a659ebec171b8eddc5b/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:14.405543 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda78533-f254-4a0f-80f2-058cfad048a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5a85dd6dee5e4ba5aaf86cea1ce84dc0, user_id=4014febac1134a659ebec171b8eddc5b, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:14.408786 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cda78533-f254-4a0f-80f2-058cfad048a8 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:14.423260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1051/2092] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:14 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:14.424140 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17254a-15ba-4d23-8e13-19c75091b6ef None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:14.425830 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cf17254a-15ba-4d23-8e13-19c75091b6ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:14.443751 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf17254a-15ba-4d23-8e13-19c75091b6ef None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:14.448589 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:14.449458 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:14.449740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:14.450018 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b admin admin] PATH_INFO: `/v3/projects/cd4ac8555a5245eeb729e7292f400f2c` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:14.451254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd4ac8555a5245eeb729e7292f400f2c)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:14.453493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:14.536969 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1042/2093] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:14 2022] PUT /identity/v3/projects/5a85dd6dee5e4ba5aaf86cea1ce84dc0/users/4014febac1134a659ebec171b8eddc5b/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:14.539148 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda78533-f254-4a0f-80f2-058cfad048a8 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:14.541102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-cda78533-f254-4a0f-80f2-058cfad048a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:14.634582 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda78533-f254-4a0f-80f2-058cfad048a8 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:14.646513 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd4ac8555a5245eeb729e7292f400f2c', 'request_id': 'req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:14.653265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd4ac8555a5245eeb729e7292f400f2c', 'request_id': 'req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:14.660256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd4ac8555a5245eeb729e7292f400f2c', 'request_id': 'req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:14.694628 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d308ded-62e9-40bb-b65c-9dbe544de359 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:14.697804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d308ded-62e9-40bb-b65c-9dbe544de359 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:14.697804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d308ded-62e9-40bb-b65c-9dbe544de359 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:14.697804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d308ded-62e9-40bb-b65c-9dbe544de359 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:14.767141 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d308ded-62e9-40bb-b65c-9dbe544de359 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:14.768643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d308ded-62e9-40bb-b65c-9dbe544de359 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:14.777941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1043/2094] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:14.779254 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313cabf-025d-4907-8afa-7ae2adf1d541 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:14.779548 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313cabf-025d-4907-8afa-7ae2adf1d541 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:14.779829 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313cabf-025d-4907-8afa-7ae2adf1d541 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:14.799794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b admin admin] The token cache is being invalidate because project cd4ac8555a5245eeb729e7292f400f2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:14.799794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:14.799794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:14.799794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1052/2095] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:14 2022] DELETE /identity/v3/projects/cd4ac8555a5245eeb729e7292f400f2c => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:14.799794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:14.800170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:14.836210 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-e313cabf-025d-4907-8afa-7ae2adf1d541 None None] MFA Rules not processed for user `4014febac1134a659ebec171b8eddc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:14.837476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e313cabf-025d-4907-8afa-7ae2adf1d541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:14.899854 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0317d67-4e5d-4f7a-8bdc-cc4bc4a5b64b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:14.904769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:14.905638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:14.905922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:14.906197 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b admin admin] PATH_INFO: `/v3/projects/184c99cca25b43c4a20e8912b01c42b0` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:14.907971 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b admin admin] RBAC: Authorizing `identity:delete_project(project_id=184c99cca25b43c4a20e8912b01c42b0)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:14.910070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:14.911355 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1044/2096] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:14 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:14.912266 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313cabf-025d-4907-8afa-7ae2adf1d541 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:14.914069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e313cabf-025d-4907-8afa-7ae2adf1d541 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:14.941052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313cabf-025d-4907-8afa-7ae2adf1d541 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:14.946464 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5182023-ae49-4820-9bf7-86d10a7a6c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:14.947499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5182023-ae49-4820-9bf7-86d10a7a6c08 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:14.947790 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5182023-ae49-4820-9bf7-86d10a7a6c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:14.948068 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5182023-ae49-4820-9bf7-86d10a7a6c08 admin admin] PATH_INFO: `/v3/users/436a622f48db4954adb6e86a8b8d9e27` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:14.949296 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5182023-ae49-4820-9bf7-86d10a7a6c08 admin admin] RBAC: Authorizing `identity:delete_user(user_id=436a622f48db4954adb6e86a8b8d9e27)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:14.951658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5182023-ae49-4820-9bf7-86d10a7a6c08 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:15.096505 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '184c99cca25b43c4a20e8912b01c42b0', 'request_id': 'req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:15.109527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '184c99cca25b43c4a20e8912b01c42b0', 'request_id': 'req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:15.118208 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '184c99cca25b43c4a20e8912b01c42b0', 'request_id': 'req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:15.248463 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b admin admin] The token cache is being invalidate because project 184c99cca25b43c4a20e8912b01c42b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:15.249046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:15.250130 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:15.262015 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1053/2097] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:14 2022] DELETE /identity/v3/projects/184c99cca25b43c4a20e8912b01c42b0 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:15.263401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:15.273358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:15.273515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c5182023-ae49-4820-9bf7-86d10a7a6c08 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '436a622f48db4954adb6e86a8b8d9e27'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:15.273515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c5182023-ae49-4820-9bf7-86d10a7a6c08 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '436a622f48db4954adb6e86a8b8d9e27'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:15.349548 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aaa4c26-d1d2-4ee4-82a4-7c0e219cc28b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:15.355783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ac1c14-9533-4e8d-bcfb-21a9445f3c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:15.356704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac1c14-9533-4e8d-bcfb-21a9445f3c2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:15.357060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac1c14-9533-4e8d-bcfb-21a9445f3c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:15.357421 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ac1c14-9533-4e8d-bcfb-21a9445f3c2c admin admin] PATH_INFO: `/v3/users/0c171fb9aea2460881f3665cdb5ecaa9` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:15.358856 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac1c14-9533-4e8d-bcfb-21a9445f3c2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c171fb9aea2460881f3665cdb5ecaa9)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:15.361600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ac1c14-9533-4e8d-bcfb-21a9445f3c2c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:15.365042 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c5182023-ae49-4820-9bf7-86d10a7a6c08 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '436a622f48db4954adb6e86a8b8d9e27'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:15.365685 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c5182023-ae49-4820-9bf7-86d10a7a6c08 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '436a622f48db4954adb6e86a8b8d9e27'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:15.385942 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c5182023-ae49-4820-9bf7-86d10a7a6c08 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '436a622f48db4954adb6e86a8b8d9e27'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:15.413328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1045/2098] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:14 2022] DELETE /identity/v3/users/436a622f48db4954adb6e86a8b8d9e27 => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:15.413328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5182023-ae49-4820-9bf7-86d10a7a6c08 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:15.413328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c5182023-ae49-4820-9bf7-86d10a7a6c08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:15.483424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5182023-ae49-4820-9bf7-86d10a7a6c08 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:15.491885 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09783aa1-9586-4a5f-a39c-cedec9c8bac8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2352b5c2aa664bf0a7e321ff3a5038fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:15.491885 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09783aa1-9586-4a5f-a39c-cedec9c8bac8 service glance] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:15.491885 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09783aa1-9586-4a5f-a39c-cedec9c8bac8 service glance] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:15.491885 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09783aa1-9586-4a5f-a39c-cedec9c8bac8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:15.493486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-09783aa1-9586-4a5f-a39c-cedec9c8bac8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:15.580945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09783aa1-9586-4a5f-a39c-cedec9c8bac8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:15.582617 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09783aa1-9586-4a5f-a39c-cedec9c8bac8 service glance] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:15.595118 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1046/2099] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:15 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 184 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:15.597210 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09783aa1-9586-4a5f-a39c-cedec9c8bac8 service glance] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:15.600297 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-09783aa1-9586-4a5f-a39c-cedec9c8bac8 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:15.605855 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:15.691755 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09783aa1-9586-4a5f-a39c-cedec9c8bac8 service glance] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:15.697213 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3aed0-e0f7-49cb-b5ce-14f6dddde0af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:15.698512 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3aed0-e0f7-49cb-b5ce-14f6dddde0af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:15.698891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3aed0-e0f7-49cb-b5ce-14f6dddde0af admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:15.699258 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe3aed0-e0f7-49cb-b5ce-14f6dddde0af admin admin] PATH_INFO: `/v3/users/54c1451e9b324d55a192c67d31b524a7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:15.700587 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3aed0-e0f7-49cb-b5ce-14f6dddde0af admin admin] RBAC: Authorizing `identity:delete_user(user_id=54c1451e9b324d55a192c67d31b524a7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:15.704541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe3aed0-e0f7-49cb-b5ce-14f6dddde0af admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:15.767347 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-53ac1c14-9533-4e8d-bcfb-21a9445f3c2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c171fb9aea2460881f3665cdb5ecaa9'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:15.788446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-53ac1c14-9533-4e8d-bcfb-21a9445f3c2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c171fb9aea2460881f3665cdb5ecaa9'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:15.789271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-53ac1c14-9533-4e8d-bcfb-21a9445f3c2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c171fb9aea2460881f3665cdb5ecaa9'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:15.791222 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-53ac1c14-9533-4e8d-bcfb-21a9445f3c2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c171fb9aea2460881f3665cdb5ecaa9'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:15.810861 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-53ac1c14-9533-4e8d-bcfb-21a9445f3c2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c171fb9aea2460881f3665cdb5ecaa9'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:15.952680 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1054/2100] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:15 2022] DELETE /identity/v3/users/0c171fb9aea2460881f3665cdb5ecaa9 => generated 0 bytes in 690 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:15.958556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d51b41-6793-4ec8-b4fc-88107914c23d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:15.959382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d51b41-6793-4ec8-b4fc-88107914c23d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:15.959856 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d51b41-6793-4ec8-b4fc-88107914c23d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:15.994269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-50d51b41-6793-4ec8-b4fc-88107914c23d None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:15.995761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-50d51b41-6793-4ec8-b4fc-88107914c23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:16.020556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6fe3aed0-e0f7-49cb-b5ce-14f6dddde0af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '54c1451e9b324d55a192c67d31b524a7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:16.021273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6fe3aed0-e0f7-49cb-b5ce-14f6dddde0af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '54c1451e9b324d55a192c67d31b524a7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:16.075006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:16.083321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1055/2101] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:38:16.095339 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d51b41-6793-4ec8-b4fc-88107914c23d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:16.097064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-50d51b41-6793-4ec8-b4fc-88107914c23d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:16.105334 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6fe3aed0-e0f7-49cb-b5ce-14f6dddde0af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '54c1451e9b324d55a192c67d31b524a7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:16.107228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6fe3aed0-e0f7-49cb-b5ce-14f6dddde0af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '54c1451e9b324d55a192c67d31b524a7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:16.149990 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-6fe3aed0-e0f7-49cb-b5ce-14f6dddde0af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '54c1451e9b324d55a192c67d31b524a7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:16.180622 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1047/2102] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:15 2022] DELETE /identity/v3/users/54c1451e9b324d55a192c67d31b524a7 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:16.193875 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d51b41-6793-4ec8-b4fc-88107914c23d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:16.246251 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b047bfdc-1f83-4dcb-99d8-dd50b9907002 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:16.246914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047bfdc-1f83-4dcb-99d8-dd50b9907002 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:16.247199 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047bfdc-1f83-4dcb-99d8-dd50b9907002 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:16.247472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b047bfdc-1f83-4dcb-99d8-dd50b9907002 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:16.263661 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3aed0-e0f7-49cb-b5ce-14f6dddde0af admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:16.265138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6fe3aed0-e0f7-49cb-b5ce-14f6dddde0af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:16.365589 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047bfdc-1f83-4dcb-99d8-dd50b9907002 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:16.370326 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b047bfdc-1f83-4dcb-99d8-dd50b9907002 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:16.398896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1056/2103] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:38:16.399735 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35aaa20-8cd6-475e-b4dc-bd7badf220a2 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:16.401879 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35aaa20-8cd6-475e-b4dc-bd7badf220a2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:16.401879 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35aaa20-8cd6-475e-b4dc-bd7badf220a2 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:16.402100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe3aed0-e0f7-49cb-b5ce-14f6dddde0af admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:16.402178 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1057/2104] 10.222.0.40 () {54 vars in 921 bytes} [Fri Jul 15 19:38:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:38:16.409385 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc3977-6626-46a6-ad91-fff05a778cac None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:16.409671 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc3977-6626-46a6-ad91-fff05a778cac None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:16.409943 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32fc3977-6626-46a6-ad91-fff05a778cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:16.426999 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37736c86-312d-47c8-b6b3-81852d863973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:16.427889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37736c86-312d-47c8-b6b3-81852d863973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:16.428172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37736c86-312d-47c8-b6b3-81852d863973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:16.428445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37736c86-312d-47c8-b6b3-81852d863973 admin admin] PATH_INFO: `/v3/projects/9e697b307f3842ffb6056930c23e99e4` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:16.430815 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37736c86-312d-47c8-b6b3-81852d863973 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e697b307f3842ffb6056930c23e99e4)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:16.432829 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37736c86-312d-47c8-b6b3-81852d863973 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:16.452205 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-32fc3977-6626-46a6-ad91-fff05a778cac None None] MFA Rules not processed for user `ad68d871464f4b5588c22070205f159e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:16.456093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-32fc3977-6626-46a6-ad91-fff05a778cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:16.530258 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1058/2105] 10.222.0.40 () {58 vars in 1018 bytes} [Fri Jul 15 19:38:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:38:16.539854 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc3977-6626-46a6-ad91-fff05a778cac None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:16.541286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-32fc3977-6626-46a6-ad91-fff05a778cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:16.555751 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32fc3977-6626-46a6-ad91-fff05a778cac None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:16.570907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24872aee-c477-4142-a0ad-0f50ffc09699 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:16.570907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24872aee-c477-4142-a0ad-0f50ffc09699 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:16.570907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24872aee-c477-4142-a0ad-0f50ffc09699 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:16.570907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24872aee-c477-4142-a0ad-0f50ffc09699 admin admin] PATH_INFO: `/v3/users/7a57f2b2c3a041f48290f7441cffe5b8` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:16.572578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24872aee-c477-4142-a0ad-0f50ffc09699 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a57f2b2c3a041f48290f7441cffe5b8)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:16.574556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24872aee-c477-4142-a0ad-0f50ffc09699 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:16.638777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-37736c86-312d-47c8-b6b3-81852d863973 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e697b307f3842ffb6056930c23e99e4', 'request_id': 'req-37736c86-312d-47c8-b6b3-81852d863973'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:16.785387 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-37736c86-312d-47c8-b6b3-81852d863973 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e697b307f3842ffb6056930c23e99e4', 'request_id': 'req-37736c86-312d-47c8-b6b3-81852d863973'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:16.792782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-37736c86-312d-47c8-b6b3-81852d863973 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e697b307f3842ffb6056930c23e99e4', 'request_id': 'req-37736c86-312d-47c8-b6b3-81852d863973'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:16.806668 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-37736c86-312d-47c8-b6b3-81852d863973 admin admin] The token cache is being invalidate because project 9e697b307f3842ffb6056930c23e99e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:16.807075 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-37736c86-312d-47c8-b6b3-81852d863973 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:16.807892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-37736c86-312d-47c8-b6b3-81852d863973 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:16.810372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1048/2106] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:16 2022] DELETE /identity/v3/projects/9e697b307f3842ffb6056930c23e99e4 => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:38:16.811406 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37736c86-312d-47c8-b6b3-81852d863973 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:16.812758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-37736c86-312d-47c8-b6b3-81852d863973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:16.898733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-24872aee-c477-4142-a0ad-0f50ffc09699 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a57f2b2c3a041f48290f7441cffe5b8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:16.906415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37736c86-312d-47c8-b6b3-81852d863973 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:16.912424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38d359a-c600-483a-bae7-2b00075bba73 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad68d871464f4b5588c22070205f159e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:16.913245 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d359a-c600-483a-bae7-2b00075bba73 service placement] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:16.913482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-24872aee-c477-4142-a0ad-0f50ffc09699 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a57f2b2c3a041f48290f7441cffe5b8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:16.913586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d359a-c600-483a-bae7-2b00075bba73 service placement] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:16.913820 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38d359a-c600-483a-bae7-2b00075bba73 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:16.914344 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-24872aee-c477-4142-a0ad-0f50ffc09699 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a57f2b2c3a041f48290f7441cffe5b8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:16.915059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-24872aee-c477-4142-a0ad-0f50ffc09699 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a57f2b2c3a041f48290f7441cffe5b8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:16.915937 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d38d359a-c600-483a-bae7-2b00075bba73 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:16.923938 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-24872aee-c477-4142-a0ad-0f50ffc09699 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a57f2b2c3a041f48290f7441cffe5b8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:16.928791 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d359a-c600-483a-bae7-2b00075bba73 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:16.930412 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38d359a-c600-483a-bae7-2b00075bba73 service placement] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:16.943324 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1049/2107] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:16.944576 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653f4af-28e7-4d43-95ad-7861670413a9 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:16.944864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653f4af-28e7-4d43-95ad-7861670413a9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:16.945143 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653f4af-28e7-4d43-95ad-7861670413a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:16.964746 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c653f4af-28e7-4d43-95ad-7861670413a9 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:16.966052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c653f4af-28e7-4d43-95ad-7861670413a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:17.035479 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1050/2108] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:17.036334 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653f4af-28e7-4d43-95ad-7861670413a9 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:17.037666 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c653f4af-28e7-4d43-95ad-7861670413a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:17.050585 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653f4af-28e7-4d43-95ad-7861670413a9 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:17.054075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1059/2109] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:16 2022] DELETE /identity/v3/users/7a57f2b2c3a041f48290f7441cffe5b8 => generated 0 bytes in 512 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:17.054075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24872aee-c477-4142-a0ad-0f50ffc09699 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:17.054075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-24872aee-c477-4142-a0ad-0f50ffc09699 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:17.132894 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24872aee-c477-4142-a0ad-0f50ffc09699 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:17.138676 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8cdfa2-cc25-4684-895d-dbc0246e1324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:17.139582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cdfa2-cc25-4684-895d-dbc0246e1324 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:17.140033 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cdfa2-cc25-4684-895d-dbc0246e1324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:17.140461 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8cdfa2-cc25-4684-895d-dbc0246e1324 admin admin] PATH_INFO: `/v3/projects/92aa10fbaae04327a0df3daa13cdd16d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:17.141982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cdfa2-cc25-4684-895d-dbc0246e1324 admin admin] RBAC: Authorizing `identity:delete_project(project_id=92aa10fbaae04327a0df3daa13cdd16d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:17.144028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc8cdfa2-cc25-4684-895d-dbc0246e1324 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:17.148805 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc2c3ac-5641-4e01-bb9e-b68cbec44399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:17.149914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2c3ac-5641-4e01-bb9e-b68cbec44399 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:17.150418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2c3ac-5641-4e01-bb9e-b68cbec44399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:17.150881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc2c3ac-5641-4e01-bb9e-b68cbec44399 admin admin] PATH_INFO: `/v3/projects/3109f3c311bf4fc8b79d02b3526c7a65` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:17.152839 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2c3ac-5641-4e01-bb9e-b68cbec44399 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3109f3c311bf4fc8b79d02b3526c7a65)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:17.155901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc2c3ac-5641-4e01-bb9e-b68cbec44399 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:17.314458 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-fc8cdfa2-cc25-4684-895d-dbc0246e1324 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '92aa10fbaae04327a0df3daa13cdd16d', 'request_id': 'req-fc8cdfa2-cc25-4684-895d-dbc0246e1324'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:17.321047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-fc8cdfa2-cc25-4684-895d-dbc0246e1324 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '92aa10fbaae04327a0df3daa13cdd16d', 'request_id': 'req-fc8cdfa2-cc25-4684-895d-dbc0246e1324'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:17.327004 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-fc8cdfa2-cc25-4684-895d-dbc0246e1324 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '92aa10fbaae04327a0df3daa13cdd16d', 'request_id': 'req-fc8cdfa2-cc25-4684-895d-dbc0246e1324'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:17.354102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0fc2c3ac-5641-4e01-bb9e-b68cbec44399 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3109f3c311bf4fc8b79d02b3526c7a65', 'request_id': 'req-0fc2c3ac-5641-4e01-bb9e-b68cbec44399'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:17.441118 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-fc8cdfa2-cc25-4684-895d-dbc0246e1324 admin admin] The token cache is being invalidate because project 92aa10fbaae04327a0df3daa13cdd16d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:17.441409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-fc8cdfa2-cc25-4684-895d-dbc0246e1324 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:17.442064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-fc8cdfa2-cc25-4684-895d-dbc0246e1324 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:17.443698 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1060/2110] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:17 2022] DELETE /identity/v3/projects/92aa10fbaae04327a0df3daa13cdd16d => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:17.444915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d216e56-bdc2-4703-a651-e75e70d5f28e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:17.445199 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d216e56-bdc2-4703-a651-e75e70d5f28e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:17.445501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d216e56-bdc2-4703-a651-e75e70d5f28e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:17.465241 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1d216e56-bdc2-4703-a651-e75e70d5f28e None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:17.466246 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1d216e56-bdc2-4703-a651-e75e70d5f28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:17.535579 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1061/2111] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:17.536459 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d216e56-bdc2-4703-a651-e75e70d5f28e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:17.537779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1d216e56-bdc2-4703-a651-e75e70d5f28e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:17.542925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0fc2c3ac-5641-4e01-bb9e-b68cbec44399 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3109f3c311bf4fc8b79d02b3526c7a65', 'request_id': 'req-0fc2c3ac-5641-4e01-bb9e-b68cbec44399'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:17.550587 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d216e56-bdc2-4703-a651-e75e70d5f28e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:17.557549 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0fc2c3ac-5641-4e01-bb9e-b68cbec44399 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3109f3c311bf4fc8b79d02b3526c7a65', 'request_id': 'req-0fc2c3ac-5641-4e01-bb9e-b68cbec44399'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:17.557841 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42afd689-97f7-487c-92d3-6639eb9cf41e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:17.557841 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afd689-97f7-487c-92d3-6639eb9cf41e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:17.557841 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afd689-97f7-487c-92d3-6639eb9cf41e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:17.557841 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42afd689-97f7-487c-92d3-6639eb9cf41e admin admin] PATH_INFO: `/v3/projects/115fe7763abc4e32bc88cd0846619fa4` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:17.558562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afd689-97f7-487c-92d3-6639eb9cf41e admin admin] RBAC: Authorizing `identity:delete_project(project_id=115fe7763abc4e32bc88cd0846619fa4)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:17.560582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42afd689-97f7-487c-92d3-6639eb9cf41e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:17.568836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0fc2c3ac-5641-4e01-bb9e-b68cbec44399 admin admin] The token cache is being invalidate because project 3109f3c311bf4fc8b79d02b3526c7a65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:17.569349 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0fc2c3ac-5641-4e01-bb9e-b68cbec44399 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:17.570053 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0fc2c3ac-5641-4e01-bb9e-b68cbec44399 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:17.571677 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1051/2112] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:17 2022] DELETE /identity/v3/projects/3109f3c311bf4fc8b79d02b3526c7a65 => generated 0 bytes in 536 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:17.575250 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b906e1-920b-4c8f-a0fd-63f802ad9f89 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:17.575250 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b906e1-920b-4c8f-a0fd-63f802ad9f89 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:17.575250 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b906e1-920b-4c8f-a0fd-63f802ad9f89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:17.593821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-07b906e1-920b-4c8f-a0fd-63f802ad9f89 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:17.596542 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-07b906e1-920b-4c8f-a0fd-63f802ad9f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:17.604733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1052/2113] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:17.608280 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b906e1-920b-4c8f-a0fd-63f802ad9f89 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:17.608280 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-07b906e1-920b-4c8f-a0fd-63f802ad9f89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:17.619616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b906e1-920b-4c8f-a0fd-63f802ad9f89 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:17.624432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb6a5a2-2319-4472-9547-96a9cefa27c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:17.625120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6a5a2-2319-4472-9547-96a9cefa27c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:17.625464 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6a5a2-2319-4472-9547-96a9cefa27c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:17.625740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb6a5a2-2319-4472-9547-96a9cefa27c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:17.626677 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6a5a2-2319-4472-9547-96a9cefa27c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:17.627017 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6a5a2-2319-4472-9547-96a9cefa27c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:17.628651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb6a5a2-2319-4472-9547-96a9cefa27c4 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:17.642802 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1053/2114] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:38:17.644264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cc71f-fa74-4031-84b4-3771528964e2 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:17.644562 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cc71f-fa74-4031-84b4-3771528964e2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:17.644838 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256cc71f-fa74-4031-84b4-3771528964e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:17.663515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-256cc71f-fa74-4031-84b4-3771528964e2 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:17.664730 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-256cc71f-fa74-4031-84b4-3771528964e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:17.675108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1054/2115] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:17.677485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c266384-fa53-4f56-a508-ca9b1860de82 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:17.677984 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c266384-fa53-4f56-a508-ca9b1860de82 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:17.678477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c266384-fa53-4f56-a508-ca9b1860de82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:17.691539 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-42afd689-97f7-487c-92d3-6639eb9cf41e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '115fe7763abc4e32bc88cd0846619fa4', 'request_id': 'req-42afd689-97f7-487c-92d3-6639eb9cf41e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:17.698538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-42afd689-97f7-487c-92d3-6639eb9cf41e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '115fe7763abc4e32bc88cd0846619fa4', 'request_id': 'req-42afd689-97f7-487c-92d3-6639eb9cf41e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:17.702727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-8c266384-fa53-4f56-a508-ca9b1860de82 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:17.704400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8c266384-fa53-4f56-a508-ca9b1860de82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:17.704800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-42afd689-97f7-487c-92d3-6639eb9cf41e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '115fe7763abc4e32bc88cd0846619fa4', 'request_id': 'req-42afd689-97f7-487c-92d3-6639eb9cf41e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:17.715676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:17.771396 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1055/2116] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:17.772932 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c266384-fa53-4f56-a508-ca9b1860de82 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:17.782934 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c266384-fa53-4f56-a508-ca9b1860de82 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:17.788090 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144bc09-37bb-4b46-aaca-30066de6b8da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:17.792419 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144bc09-37bb-4b46-aaca-30066de6b8da admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:17.792419 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144bc09-37bb-4b46-aaca-30066de6b8da admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:17.792419 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e144bc09-37bb-4b46-aaca-30066de6b8da admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:17.792419 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144bc09-37bb-4b46-aaca-30066de6b8da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:17.792419 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e144bc09-37bb-4b46-aaca-30066de6b8da admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:17.819933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-42afd689-97f7-487c-92d3-6639eb9cf41e admin admin] The token cache is being invalidate because project 115fe7763abc4e32bc88cd0846619fa4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:17.820276 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-42afd689-97f7-487c-92d3-6639eb9cf41e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:17.820961 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-42afd689-97f7-487c-92d3-6639eb9cf41e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:17.822605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1062/2117] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:17 2022] DELETE /identity/v3/projects/115fe7763abc4e32bc88cd0846619fa4 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:17.823894 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cc22a-0620-42c2-ab9f-6bea9e36e9b2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:17.824178 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cc22a-0620-42c2-ab9f-6bea9e36e9b2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:17.824468 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea5cc22a-0620-42c2-ab9f-6bea9e36e9b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:17.844028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ea5cc22a-0620-42c2-ab9f-6bea9e36e9b2 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:17.845873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ea5cc22a-0620-42c2-ab9f-6bea9e36e9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:17.853869 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1063/2118] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:17.854669 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cc22a-0620-42c2-ab9f-6bea9e36e9b2 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:17.856030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ea5cc22a-0620-42c2-ab9f-6bea9e36e9b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:17.868221 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea5cc22a-0620-42c2-ab9f-6bea9e36e9b2 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:17.873288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2150880f-7639-4949-ae17-7b41c023b559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:17.873997 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150880f-7639-4949-ae17-7b41c023b559 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:17.874271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150880f-7639-4949-ae17-7b41c023b559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:17.874541 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2150880f-7639-4949-ae17-7b41c023b559 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:17.879202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150880f-7639-4949-ae17-7b41c023b559 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:17.879202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150880f-7639-4949-ae17-7b41c023b559 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:17.879202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2150880f-7639-4949-ae17-7b41c023b559 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:17.894352 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1064/2119] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:38:17.894352 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f556f-fd25-4eab-b2d7-f8ae5a4f5512 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:17.894352 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f556f-fd25-4eab-b2d7-f8ae5a4f5512 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:17.894352 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-936f556f-fd25-4eab-b2d7-f8ae5a4f5512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:17.912074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-936f556f-fd25-4eab-b2d7-f8ae5a4f5512 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:17.913219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-936f556f-fd25-4eab-b2d7-f8ae5a4f5512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:17.917402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1056/2120] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:17 2022] POST /identity/v3/projects => generated 383 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:17.918226 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144bc09-37bb-4b46-aaca-30066de6b8da admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:17.925337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1065/2121] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:17.925627 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f556f-fd25-4eab-b2d7-f8ae5a4f5512 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:17.942371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-936f556f-fd25-4eab-b2d7-f8ae5a4f5512 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:17.996352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e144bc09-37bb-4b46-aaca-30066de6b8da admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:18.002913 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf119b8-6ee9-4c0a-a058-9ad8e7e9d91e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:18.003629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf119b8-6ee9-4c0a-a058-9ad8e7e9d91e admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:18.003917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf119b8-6ee9-4c0a-a058-9ad8e7e9d91e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:18.004200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf119b8-6ee9-4c0a-a058-9ad8e7e9d91e admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:18.004941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf119b8-6ee9-4c0a-a058-9ad8e7e9d91e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:18.005254 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf119b8-6ee9-4c0a-a058-9ad8e7e9d91e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:18.006369 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c817928-52aa-4ac5-bb4b-6f076c816fcc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:18.007161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c817928-52aa-4ac5-bb4b-6f076c816fcc admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:18.007270 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf119b8-6ee9-4c0a-a058-9ad8e7e9d91e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:18.007622 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c817928-52aa-4ac5-bb4b-6f076c816fcc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:18.008008 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c817928-52aa-4ac5-bb4b-6f076c816fcc admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:18.009013 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c817928-52aa-4ac5-bb4b-6f076c816fcc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:18.011039 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c817928-52aa-4ac5-bb4b-6f076c816fcc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:18.022582 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1057/2122] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:38:18.023404 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf119b8-6ee9-4c0a-a058-9ad8e7e9d91e admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:18.025209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-cbf119b8-6ee9-4c0a-a058-9ad8e7e9d91e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:18.038680 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf119b8-6ee9-4c0a-a058-9ad8e7e9d91e admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:18.044048 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34583981-bade-4c3c-a8be-ccf4d4b07c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:18.044832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34583981-bade-4c3c-a8be-ccf4d4b07c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:18.045125 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34583981-bade-4c3c-a8be-ccf4d4b07c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:18.045616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34583981-bade-4c3c-a8be-ccf4d4b07c34 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:18.046399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34583981-bade-4c3c-a8be-ccf4d4b07c34 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:18.049124 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34583981-bade-4c3c-a8be-ccf4d4b07c34 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:18.162981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1058/2123] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:18 2022] POST /identity/v3/users => generated 292 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:18.167298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259717c-2920-41e7-8c44-025d861b3f12 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:18.167428 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1066/2124] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:17 2022] POST /identity/v3/projects => generated 375 bytes in 239 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:18.167525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259717c-2920-41e7-8c44-025d861b3f12 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:18.167525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8259717c-2920-41e7-8c44-025d861b3f12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:18.167707 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c817928-52aa-4ac5-bb4b-6f076c816fcc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:18.185887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-8259717c-2920-41e7-8c44-025d861b3f12 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:18.187240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8259717c-2920-41e7-8c44-025d861b3f12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:18.237857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c817928-52aa-4ac5-bb4b-6f076c816fcc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:18.243321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c0197-09e2-4b98-ba01-e71afb8c61a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:18.250401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c0197-09e2-4b98-ba01-e71afb8c61a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:18.250401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c0197-09e2-4b98-ba01-e71afb8c61a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:18.250401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12c0197-09e2-4b98-ba01-e71afb8c61a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:18.250401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c0197-09e2-4b98-ba01-e71afb8c61a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:18.250401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12c0197-09e2-4b98-ba01-e71afb8c61a4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:18.262715 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1059/2125] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:18.263778 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259717c-2920-41e7-8c44-025d861b3f12 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:18.274776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8259717c-2920-41e7-8c44-025d861b3f12 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:18.279682 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0353c-30ae-420a-8fb6-51cd9c62d781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:18.280397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0353c-30ae-420a-8fb6-51cd9c62d781 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:18.280686 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0353c-30ae-420a-8fb6-51cd9c62d781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:18.280965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a0353c-30ae-420a-8fb6-51cd9c62d781 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:18.281761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0353c-30ae-420a-8fb6-51cd9c62d781 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:18.283561 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a0353c-30ae-420a-8fb6-51cd9c62d781 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:18.296195 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1060/2126] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:18.296195 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0353c-30ae-420a-8fb6-51cd9c62d781 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:18.311109 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a0353c-30ae-420a-8fb6-51cd9c62d781 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:18.316639 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:18.319198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afcac5-f6ba-4ba6-be27-d4006e05ef85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:18.319198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afcac5-f6ba-4ba6-be27-d4006e05ef85 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:18.319198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afcac5-f6ba-4ba6-be27-d4006e05ef85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:18.319493 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3afcac5-f6ba-4ba6-be27-d4006e05ef85 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:18.320161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afcac5-f6ba-4ba6-be27-d4006e05ef85 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:18.322318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3afcac5-f6ba-4ba6-be27-d4006e05ef85 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:18.387741 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1067/2127] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:18 2022] POST /identity/v3/projects => generated 365 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:18.388613 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c0197-09e2-4b98-ba01-e71afb8c61a4 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:18.431975 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1061/2128] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:18 2022] POST /identity/v3/users => generated 288 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:18.432828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afcac5-f6ba-4ba6-be27-d4006e05ef85 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:18.455291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3afcac5-f6ba-4ba6-be27-d4006e05ef85 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:18.479078 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12c0197-09e2-4b98-ba01-e71afb8c61a4 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:18.483942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b275f-2b7c-4c11-ae4c-b18317466295 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:18.484664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b275f-2b7c-4c11-ae4c-b18317466295 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:18.485478 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b275f-2b7c-4c11-ae4c-b18317466295 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:18.485755 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49b275f-2b7c-4c11-ae4c-b18317466295 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:18.486595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b275f-2b7c-4c11-ae4c-b18317466295 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:18.487061 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b275f-2b7c-4c11-ae4c-b18317466295 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:18.489034 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49b275f-2b7c-4c11-ae4c-b18317466295 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:18.503374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1068/2129] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:38:18.504216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b275f-2b7c-4c11-ae4c-b18317466295 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:18.514930 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49b275f-2b7c-4c11-ae4c-b18317466295 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:18.521080 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beee68-e6d9-4a89-800a-8428d57b5388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:18.522067 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beee68-e6d9-4a89-800a-8428d57b5388 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:18.522330 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beee68-e6d9-4a89-800a-8428d57b5388 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:18.522606 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6beee68-e6d9-4a89-800a-8428d57b5388 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:18.523338 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6beee68-e6d9-4a89-800a-8428d57b5388 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:18.525375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6beee68-e6d9-4a89-800a-8428d57b5388 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:18.540697 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60f4cd-fce8-4aab-9761-ff6919394f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:18.541469 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60f4cd-fce8-4aab-9761-ff6919394f43 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:18.541835 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60f4cd-fce8-4aab-9761-ff6919394f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:18.542216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a60f4cd-fce8-4aab-9761-ff6919394f43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:18.543203 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60f4cd-fce8-4aab-9761-ff6919394f43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:18.544869 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a60f4cd-fce8-4aab-9761-ff6919394f43 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:18.555690 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1062/2130] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:18.556526 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60f4cd-fce8-4aab-9761-ff6919394f43 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:18.567663 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a60f4cd-fce8-4aab-9761-ff6919394f43 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:18.575020 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e060538-e4a7-4e8a-bcc4-dc8fe8b08de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:18.575780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e060538-e4a7-4e8a-bcc4-dc8fe8b08de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:18.576130 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e060538-e4a7-4e8a-bcc4-dc8fe8b08de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:18.576468 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e060538-e4a7-4e8a-bcc4-dc8fe8b08de5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:18.577355 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e060538-e4a7-4e8a-bcc4-dc8fe8b08de5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:18.579465 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e060538-e4a7-4e8a-bcc4-dc8fe8b08de5 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:18.590703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1063/2131] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:18.591514 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e060538-e4a7-4e8a-bcc4-dc8fe8b08de5 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:18.602035 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e060538-e4a7-4e8a-bcc4-dc8fe8b08de5 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:18.608171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5073cbc-7985-4c24-8968-28e499fc527a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:18.613286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5073cbc-7985-4c24-8968-28e499fc527a admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:18.613286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5073cbc-7985-4c24-8968-28e499fc527a admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:18.613286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5073cbc-7985-4c24-8968-28e499fc527a admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:18.613286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5073cbc-7985-4c24-8968-28e499fc527a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:18.613286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5073cbc-7985-4c24-8968-28e499fc527a admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:18.643041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1069/2132] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:18 2022] POST /identity/v3/users => generated 283 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:18.643906 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beee68-e6d9-4a89-800a-8428d57b5388 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:18.654103 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6beee68-e6d9-4a89-800a-8428d57b5388 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:18.659644 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ea37b-1220-4275-b3cb-88bdd24b3b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:18.660598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ea37b-1220-4275-b3cb-88bdd24b3b81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:18.660882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ea37b-1220-4275-b3cb-88bdd24b3b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:18.661192 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3ea37b-1220-4275-b3cb-88bdd24b3b81 admin admin] PATH_INFO: `/v3/projects/e767c1a76b15451ca1f4196c216fec78/users/90f0281e2b0046f8a395fea6a128ac7f/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:18.678087 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ea37b-1220-4275-b3cb-88bdd24b3b81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e767c1a76b15451ca1f4196c216fec78, user_id=90f0281e2b0046f8a395fea6a128ac7f, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:18.681059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3ea37b-1220-4275-b3cb-88bdd24b3b81 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:18.729172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1064/2133] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:18 2022] POST /identity/v3/projects => generated 387 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:18.729995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5073cbc-7985-4c24-8968-28e499fc527a admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:18.793267 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5073cbc-7985-4c24-8968-28e499fc527a admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:18.798189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1070/2134] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:18 2022] PUT /identity/v3/projects/e767c1a76b15451ca1f4196c216fec78/users/90f0281e2b0046f8a395fea6a128ac7f/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:18.800876 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ea37b-1220-4275-b3cb-88bdd24b3b81 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:18.869155 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44e068-0df1-41d4-b005-9ebbb0042574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:18.869155 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44e068-0df1-41d4-b005-9ebbb0042574 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:18.869155 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44e068-0df1-41d4-b005-9ebbb0042574 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:18.869155 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b44e068-0df1-41d4-b005-9ebbb0042574 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:18.869603 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44e068-0df1-41d4-b005-9ebbb0042574 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:18.869603 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b44e068-0df1-41d4-b005-9ebbb0042574 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:18.884016 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1065/2135] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:18.884230 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3ea37b-1220-4275-b3cb-88bdd24b3b81 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:18.884328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44e068-0df1-41d4-b005-9ebbb0042574 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:18.888704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c1232e-cc2d-41ae-8906-1a918b056475 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:18.889493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1232e-cc2d-41ae-8906-1a918b056475 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:18.889781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1232e-cc2d-41ae-8906-1a918b056475 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:18.890058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c1232e-cc2d-41ae-8906-1a918b056475 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:18.890857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1232e-cc2d-41ae-8906-1a918b056475 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:18.892982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b44e068-0df1-41d4-b005-9ebbb0042574 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:18.893199 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c1232e-cc2d-41ae-8906-1a918b056475 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:18.898693 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974671e-67d2-4c87-9a8a-ebe0eaf8a3ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:18.899868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974671e-67d2-4c87-9a8a-ebe0eaf8a3ce admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:18.900235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974671e-67d2-4c87-9a8a-ebe0eaf8a3ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:18.900686 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1974671e-67d2-4c87-9a8a-ebe0eaf8a3ce admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:18.901461 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974671e-67d2-4c87-9a8a-ebe0eaf8a3ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:18.903527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1974671e-67d2-4c87-9a8a-ebe0eaf8a3ce admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:18.908907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1071/2136] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:18.908907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893f069-7608-4840-9230-1c2d45706cd6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:18.908907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893f069-7608-4840-9230-1c2d45706cd6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:18.908907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0893f069-7608-4840-9230-1c2d45706cd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:18.937788 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0893f069-7608-4840-9230-1c2d45706cd6 None None] MFA Rules not processed for user `90f0281e2b0046f8a395fea6a128ac7f`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:18.939670 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0893f069-7608-4840-9230-1c2d45706cd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:19.006159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1072/2137] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:18 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:19.007459 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893f069-7608-4840-9230-1c2d45706cd6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:19.019226 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0893f069-7608-4840-9230-1c2d45706cd6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:19.023973 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a16d9-c324-4f2f-a958-bc9cc710531e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:19.024860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a16d9-c324-4f2f-a958-bc9cc710531e admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:19.025140 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a16d9-c324-4f2f-a958-bc9cc710531e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:19.025413 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014a16d9-c324-4f2f-a958-bc9cc710531e admin admin] PATH_INFO: `/v3/projects/9df05408162f486b838398697e6ec96f/users/f8a4c4ddb11c486db79906fb776356ce/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:19.028277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1066/2138] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:18 2022] POST /identity/v3/users => generated 294 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:19.029453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974671e-67d2-4c87-9a8a-ebe0eaf8a3ce admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:19.042228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1974671e-67d2-4c87-9a8a-ebe0eaf8a3ce admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:19.042698 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a16d9-c324-4f2f-a958-bc9cc710531e admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df05408162f486b838398697e6ec96f, user_id=f8a4c4ddb11c486db79906fb776356ce, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:19.045731 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014a16d9-c324-4f2f-a958-bc9cc710531e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:19.048195 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b93e79-8acb-47ca-aeea-e3ed0e8491dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:19.048971 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b93e79-8acb-47ca-aeea-e3ed0e8491dd admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:19.049325 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b93e79-8acb-47ca-aeea-e3ed0e8491dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:19.049668 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b93e79-8acb-47ca-aeea-e3ed0e8491dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:19.050492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b93e79-8acb-47ca-aeea-e3ed0e8491dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:19.052144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b93e79-8acb-47ca-aeea-e3ed0e8491dd admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:19.064108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1067/2139] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:19.064932 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b93e79-8acb-47ca-aeea-e3ed0e8491dd admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:19.078636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b93e79-8acb-47ca-aeea-e3ed0e8491dd admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:19.083499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99ae7f-8b74-4424-b147-4ca2b501b3df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:19.084153 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99ae7f-8b74-4424-b147-4ca2b501b3df admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:19.084436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99ae7f-8b74-4424-b147-4ca2b501b3df admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:19.084712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a99ae7f-8b74-4424-b147-4ca2b501b3df admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:19.085395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99ae7f-8b74-4424-b147-4ca2b501b3df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:19.087326 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a99ae7f-8b74-4424-b147-4ca2b501b3df admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:19.215773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1068/2140] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:19 2022] POST /identity/v3/projects => generated 383 bytes in 147 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:19.215773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99ae7f-8b74-4424-b147-4ca2b501b3df admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:19.230859 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1073/2141] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:19 2022] PUT /identity/v3/projects/9df05408162f486b838398697e6ec96f/users/f8a4c4ddb11c486db79906fb776356ce/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:19.231794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a16d9-c324-4f2f-a958-bc9cc710531e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:19.305533 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a99ae7f-8b74-4424-b147-4ca2b501b3df admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:19.307390 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014a16d9-c324-4f2f-a958-bc9cc710531e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:19.311026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11d81c-cf95-441d-bd30-39751c8599a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:19.311900 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11d81c-cf95-441d-bd30-39751c8599a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:19.312219 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11d81c-cf95-441d-bd30-39751c8599a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:19.312497 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff11d81c-cf95-441d-bd30-39751c8599a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:19.312682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-833ab9cb-6bfd-4daa-ad0c-08b8abafa250 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:19.313433 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11d81c-cf95-441d-bd30-39751c8599a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:19.313790 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab9cb-6bfd-4daa-ad0c-08b8abafa250 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:19.314058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab9cb-6bfd-4daa-ad0c-08b8abafa250 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:19.314341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-833ab9cb-6bfd-4daa-ad0c-08b8abafa250 admin admin] PATH_INFO: `/v3/projects/a9547d8d42bd4d80878c873682ed25d7/users/e9839882cfdf43deb6780680f9cfd541/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:19.315075 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff11d81c-cf95-441d-bd30-39751c8599a0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:19.326494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1069/2142] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:19.327438 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11d81c-cf95-441d-bd30-39751c8599a0 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:19.331291 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ab9cb-6bfd-4daa-ad0c-08b8abafa250 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9547d8d42bd4d80878c873682ed25d7, user_id=e9839882cfdf43deb6780680f9cfd541, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:19.338450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-833ab9cb-6bfd-4daa-ad0c-08b8abafa250 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:19.343574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff11d81c-cf95-441d-bd30-39751c8599a0 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:19.349175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa2f52-bee6-4a98-ab51-32c764fa7a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:19.350204 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa2f52-bee6-4a98-ab51-32c764fa7a44 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:19.350587 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa2f52-bee6-4a98-ab51-32c764fa7a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:19.351016 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa2f52-bee6-4a98-ab51-32c764fa7a44 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:19.351898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa2f52-bee6-4a98-ab51-32c764fa7a44 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:19.356393 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa2f52-bee6-4a98-ab51-32c764fa7a44 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:19.416581 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1074/2143] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:19 2022] PUT /identity/v3/projects/a9547d8d42bd4d80878c873682ed25d7/users/e9839882cfdf43deb6780680f9cfd541/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:19.418040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9ea74-3676-4cf3-9a80-e0e3699c2942 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:19.418335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9ea74-3676-4cf3-9a80-e0e3699c2942 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:19.418614 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a9ea74-3676-4cf3-9a80-e0e3699c2942 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:19.442024 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1070/2144] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:19 2022] POST /identity/v3/users => generated 298 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:19.442229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa2f52-bee6-4a98-ab51-32c764fa7a44 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:19.445999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-09a9ea74-3676-4cf3-9a80-e0e3699c2942 None None] MFA Rules not processed for user `f8a4c4ddb11c486db79906fb776356ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:19.450904 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-09a9ea74-3676-4cf3-9a80-e0e3699c2942 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:19.457947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa2f52-bee6-4a98-ab51-32c764fa7a44 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:19.525076 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a7971-981b-496b-a55a-e0c7e9c70c7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:19.525978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a7971-981b-496b-a55a-e0c7e9c70c7b admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:19.526268 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a7971-981b-496b-a55a-e0c7e9c70c7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:19.526550 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367a7971-981b-496b-a55a-e0c7e9c70c7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:19.527331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a7971-981b-496b-a55a-e0c7e9c70c7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:19.528980 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367a7971-981b-496b-a55a-e0c7e9c70c7b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:19.533900 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1075/2145] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:19 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:19.535224 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead76571-9fc7-4097-a630-8cd9acc09425 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:19.535519 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead76571-9fc7-4097-a630-8cd9acc09425 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:19.535796 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ead76571-9fc7-4097-a630-8cd9acc09425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:19.544713 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1071/2146] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:19.545574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a7971-981b-496b-a55a-e0c7e9c70c7b admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:19.558838 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367a7971-981b-496b-a55a-e0c7e9c70c7b admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:19.564748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320e487-fccd-4425-880e-385cedc9cb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:19.566246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e487-fccd-4425-880e-385cedc9cb09 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:19.566246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e487-fccd-4425-880e-385cedc9cb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:19.566246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8320e487-fccd-4425-880e-385cedc9cb09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:19.566816 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320e487-fccd-4425-880e-385cedc9cb09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:19.569157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8320e487-fccd-4425-880e-385cedc9cb09 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:19.570605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ead76571-9fc7-4097-a630-8cd9acc09425 None None] MFA Rules not processed for user `e9839882cfdf43deb6780680f9cfd541`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:19.571944 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ead76571-9fc7-4097-a630-8cd9acc09425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:19.585568 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1072/2147] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:19.585568 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320e487-fccd-4425-880e-385cedc9cb09 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:19.588115 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8320e487-fccd-4425-880e-385cedc9cb09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:19.656895 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1076/2148] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:19 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:19.660688 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead76571-9fc7-4097-a630-8cd9acc09425 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:19.660785 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8320e487-fccd-4425-880e-385cedc9cb09 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:19.665717 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a63bf-d979-498d-bf5c-1958d0ec8423 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:19.665717 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a63bf-d979-498d-bf5c-1958d0ec8423 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:19.665717 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a63bf-d979-498d-bf5c-1958d0ec8423 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:19.665717 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e64a63bf-d979-498d-bf5c-1958d0ec8423 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:19.671168 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ead76571-9fc7-4097-a630-8cd9acc09425 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:19.674726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a63bf-d979-498d-bf5c-1958d0ec8423 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:19.676194 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e64a63bf-d979-498d-bf5c-1958d0ec8423 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:19.676528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb5085-0e0f-451c-bf3d-ac12f89be53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:19.677555 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb5085-0e0f-451c-bf3d-ac12f89be53e admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:19.677831 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb5085-0e0f-451c-bf3d-ac12f89be53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:19.678153 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4beb5085-0e0f-451c-bf3d-ac12f89be53e admin admin] PATH_INFO: `/v3/projects/8e2fbe6daaf24041a865c0bd68e1e0f3/users/9a1371db30294725bead27951b6cdb25/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:19.685397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1073/2149] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:19.686205 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a63bf-d979-498d-bf5c-1958d0ec8423 service cinder] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:19.697690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb5085-0e0f-451c-bf3d-ac12f89be53e admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e2fbe6daaf24041a865c0bd68e1e0f3, user_id=9a1371db30294725bead27951b6cdb25, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:19.698170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e64a63bf-d979-498d-bf5c-1958d0ec8423 service cinder] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:19.700776 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4beb5085-0e0f-451c-bf3d-ac12f89be53e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:19.703275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7d39b-8979-423b-8f13-e5ebb6b2da08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:19.705092 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d39b-8979-423b-8f13-e5ebb6b2da08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:19.705275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d39b-8979-423b-8f13-e5ebb6b2da08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:19.705554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7d39b-8979-423b-8f13-e5ebb6b2da08 admin admin] PATH_INFO: `/v3/projects/1d3bd5cc7cac492dbcb7b95afffa0d08/users/52ef92c1390d4203aeb0bc5f88e2aedd/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:19.722445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7d39b-8979-423b-8f13-e5ebb6b2da08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3bd5cc7cac492dbcb7b95afffa0d08, user_id=52ef92c1390d4203aeb0bc5f88e2aedd, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:19.725247 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7d39b-8979-423b-8f13-e5ebb6b2da08 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:19.771780 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1077/2150] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:19 2022] PUT /identity/v3/projects/8e2fbe6daaf24041a865c0bd68e1e0f3/users/9a1371db30294725bead27951b6cdb25/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:19.772781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb5085-0e0f-451c-bf3d-ac12f89be53e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:19.816911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1074/2151] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:19 2022] PUT /identity/v3/projects/1d3bd5cc7cac492dbcb7b95afffa0d08/users/52ef92c1390d4203aeb0bc5f88e2aedd/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:19.816911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050eebf-2d4e-4bcc-8a05-ff7cbfa821ed None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:19.816911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050eebf-2d4e-4bcc-8a05-ff7cbfa821ed None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:19.816911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1050eebf-2d4e-4bcc-8a05-ff7cbfa821ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:19.835664 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-1050eebf-2d4e-4bcc-8a05-ff7cbfa821ed None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:19.836887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1050eebf-2d4e-4bcc-8a05-ff7cbfa821ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:19.843846 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4beb5085-0e0f-451c-bf3d-ac12f89be53e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:19.905799 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5c395-2523-4121-8545-3d12efccfd54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:19.906617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5c395-2523-4121-8545-3d12efccfd54 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:19.907438 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5c395-2523-4121-8545-3d12efccfd54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:19.907710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cc5c395-2523-4121-8545-3d12efccfd54 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:19.908408 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5c395-2523-4121-8545-3d12efccfd54 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:19.910083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1075/2152] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:19.910520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cc5c395-2523-4121-8545-3d12efccfd54 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:19.911536 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050eebf-2d4e-4bcc-8a05-ff7cbfa821ed None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:19.925188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1050eebf-2d4e-4bcc-8a05-ff7cbfa821ed None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:19.925904 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:19.931477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba320d71-ec78-4fd2-aec2-54bc66647c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:19.932193 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba320d71-ec78-4fd2-aec2-54bc66647c4d admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:19.936135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba320d71-ec78-4fd2-aec2-54bc66647c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:19.936135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba320d71-ec78-4fd2-aec2-54bc66647c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:19.936135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba320d71-ec78-4fd2-aec2-54bc66647c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:19.936135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba320d71-ec78-4fd2-aec2-54bc66647c4d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:19.947406 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1076/2153] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:19 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:19.948313 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba320d71-ec78-4fd2-aec2-54bc66647c4d admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:19.950267 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ba320d71-ec78-4fd2-aec2-54bc66647c4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:20.013970 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba320d71-ec78-4fd2-aec2-54bc66647c4d admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:20.018342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbe6b4-d2e2-4a42-9d31-105ab51f0919 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:20.019027 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbe6b4-d2e2-4a42-9d31-105ab51f0919 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:20.019309 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbe6b4-d2e2-4a42-9d31-105ab51f0919 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:20.019591 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffbe6b4-d2e2-4a42-9d31-105ab51f0919 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:20.029573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbe6b4-d2e2-4a42-9d31-105ab51f0919 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:20.031069 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffbe6b4-d2e2-4a42-9d31-105ab51f0919 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:20.040831 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1077/2154] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:20.041679 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbe6b4-d2e2-4a42-9d31-105ab51f0919 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:20.053753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffbe6b4-d2e2-4a42-9d31-105ab51f0919 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:20.062996 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1078/2155] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:19 2022] POST /identity/v3/projects => generated 365 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:20.064018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb5c23c2-9b51-48d0-a19e-d2d00468d910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:20.064018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c23c2-9b51-48d0-a19e-d2d00468d910 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:20.064018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c23c2-9b51-48d0-a19e-d2d00468d910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:20.064018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5c23c2-9b51-48d0-a19e-d2d00468d910 admin admin] PATH_INFO: `/v3/projects/1d3bd5cc7cac492dbcb7b95afffa0d08/users/52ef92c1390d4203aeb0bc5f88e2aedd/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:20.068542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5c395-2523-4121-8545-3d12efccfd54 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:20.069532 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c23c2-9b51-48d0-a19e-d2d00468d910 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d3bd5cc7cac492dbcb7b95afffa0d08, user_id=52ef92c1390d4203aeb0bc5f88e2aedd, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:20.073246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb5c23c2-9b51-48d0-a19e-d2d00468d910 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:20.085877 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1078/2156] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:20 2022] PUT /identity/v3/projects/1d3bd5cc7cac492dbcb7b95afffa0d08/users/52ef92c1390d4203aeb0bc5f88e2aedd/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:20.100658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac0d8d-add8-45a8-a748-5a44b81b959c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:20.101020 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac0d8d-add8-45a8-a748-5a44b81b959c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:20.101306 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ac0d8d-add8-45a8-a748-5a44b81b959c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:20.129941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-94ac0d8d-add8-45a8-a748-5a44b81b959c None None] MFA Rules not processed for user `52ef92c1390d4203aeb0bc5f88e2aedd`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:20.131487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-94ac0d8d-add8-45a8-a748-5a44b81b959c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:20.146259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cc5c395-2523-4121-8545-3d12efccfd54 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:20.206218 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1079/2157] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:38:20.212151 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57653c-dc11-49cd-acc6-069665540909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:20.212833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57653c-dc11-49cd-acc6-069665540909 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:20.213122 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57653c-dc11-49cd-acc6-069665540909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:20.213400 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc57653c-dc11-49cd-acc6-069665540909 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:20.214092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57653c-dc11-49cd-acc6-069665540909 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:20.216087 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc57653c-dc11-49cd-acc6-069665540909 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:20.217707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac0d8d-add8-45a8-a748-5a44b81b959c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:20.219941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-94ac0d8d-add8-45a8-a748-5a44b81b959c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:20.278780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ac0d8d-add8-45a8-a748-5a44b81b959c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:20.283184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62517d6f-39cc-4b66-a017-31e9a8a0123d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:20.283822 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62517d6f-39cc-4b66-a017-31e9a8a0123d service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:20.284101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62517d6f-39cc-4b66-a017-31e9a8a0123d service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:20.284372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62517d6f-39cc-4b66-a017-31e9a8a0123d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:20.350020 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62517d6f-39cc-4b66-a017-31e9a8a0123d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:20.351508 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62517d6f-39cc-4b66-a017-31e9a8a0123d service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:20.362067 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1080/2158] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:20 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:38:20.468265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1079/2159] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:20 2022] POST /identity/v3/users => generated 289 bytes in 400 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:38:20.473174 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62517d6f-39cc-4b66-a017-31e9a8a0123d service cinder] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:20.491169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62517d6f-39cc-4b66-a017-31e9a8a0123d service cinder] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:20.496881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef24ce4-1d5e-4a3d-9816-26392fb8efdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:20.497669 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef24ce4-1d5e-4a3d-9816-26392fb8efdb admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:20.498140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef24ce4-1d5e-4a3d-9816-26392fb8efdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:20.498609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef24ce4-1d5e-4a3d-9816-26392fb8efdb admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:20.499324 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef24ce4-1d5e-4a3d-9816-26392fb8efdb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:20.501192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef24ce4-1d5e-4a3d-9816-26392fb8efdb admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:20.512320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1081/2160] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:20.517055 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57653c-dc11-49cd-acc6-069665540909 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:20.529068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc57653c-dc11-49cd-acc6-069665540909 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:20.534918 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30ca89-63a9-4d2c-83cb-07aa5e0d6724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:20.535815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30ca89-63a9-4d2c-83cb-07aa5e0d6724 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:20.536096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30ca89-63a9-4d2c-83cb-07aa5e0d6724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:20.536369 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe30ca89-63a9-4d2c-83cb-07aa5e0d6724 admin admin] PATH_INFO: `/v3/projects/b9b869bd221740c8a6cc104c6d493907/users/999a2574e87442009e9f80e7c5be5401/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:20.552377 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30ca89-63a9-4d2c-83cb-07aa5e0d6724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b869bd221740c8a6cc104c6d493907, user_id=999a2574e87442009e9f80e7c5be5401, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:20.555153 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe30ca89-63a9-4d2c-83cb-07aa5e0d6724 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:20.619893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:20.694552 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1080/2161] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:20 2022] PUT /identity/v3/projects/b9b869bd221740c8a6cc104c6d493907/users/999a2574e87442009e9f80e7c5be5401/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:20.698823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef24ce4-1d5e-4a3d-9816-26392fb8efdb admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:20.713056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef24ce4-1d5e-4a3d-9816-26392fb8efdb admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:20.795975 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c22ec5-86b6-49ef-984b-7b463e47341e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:20.796657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c22ec5-86b6-49ef-984b-7b463e47341e admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:20.796992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c22ec5-86b6-49ef-984b-7b463e47341e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:20.800588 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c22ec5-86b6-49ef-984b-7b463e47341e admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:20.801611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c22ec5-86b6-49ef-984b-7b463e47341e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:20.803478 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c22ec5-86b6-49ef-984b-7b463e47341e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:20.818434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1082/2162] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:20 2022] GET /identity/v3/roles => generated 1420 bytes in 120 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:20.820320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30ca89-63a9-4d2c-83cb-07aa5e0d6724 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:20.837699 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe30ca89-63a9-4d2c-83cb-07aa5e0d6724 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:20.843165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffe271-1ce6-43a4-8f68-b5ca935ec559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:20.847259 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffe271-1ce6-43a4-8f68-b5ca935ec559 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:20.847649 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffe271-1ce6-43a4-8f68-b5ca935ec559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:20.848027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40ffe271-1ce6-43a4-8f68-b5ca935ec559 admin admin] PATH_INFO: `/v3/projects/b9b869bd221740c8a6cc104c6d493907/users/999a2574e87442009e9f80e7c5be5401/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:20.850567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffe271-1ce6-43a4-8f68-b5ca935ec559 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b9b869bd221740c8a6cc104c6d493907, user_id=999a2574e87442009e9f80e7c5be5401, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:20.855429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40ffe271-1ce6-43a4-8f68-b5ca935ec559 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:20.868593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1081/2163] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:20 2022] PUT /identity/v3/projects/b9b869bd221740c8a6cc104c6d493907/users/999a2574e87442009e9f80e7c5be5401/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:20.880266 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df5947-811f-4430-a169-88276c268d1d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:20.880810 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df5947-811f-4430-a169-88276c268d1d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:20.881087 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49df5947-811f-4430-a169-88276c268d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:20.917341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-49df5947-811f-4430-a169-88276c268d1d None None] MFA Rules not processed for user `999a2574e87442009e9f80e7c5be5401`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:20.918776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-49df5947-811f-4430-a169-88276c268d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:21.012656 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1083/2164] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:20 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:21.553963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffe271-1ce6-43a4-8f68-b5ca935ec559 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:21.638625 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40ffe271-1ce6-43a4-8f68-b5ca935ec559 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:21.643493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115a8b8d-6a57-47f9-8d6a-bf5c7505c46e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:21.644126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a8b8d-6a57-47f9-8d6a-bf5c7505c46e service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:21.644401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a8b8d-6a57-47f9-8d6a-bf5c7505c46e service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:21.644671 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115a8b8d-6a57-47f9-8d6a-bf5c7505c46e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:21.655762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a8b8d-6a57-47f9-8d6a-bf5c7505c46e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:21.657987 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115a8b8d-6a57-47f9-8d6a-bf5c7505c46e service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:21.668124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1082/2165] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:21 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:21.959832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df5947-811f-4430-a169-88276c268d1d None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:21.972711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49df5947-811f-4430-a169-88276c268d1d None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:21.977327 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397cd2b-d500-4b3d-b4aa-929b2323bd20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:21.978116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397cd2b-d500-4b3d-b4aa-929b2323bd20 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:21.978583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397cd2b-d500-4b3d-b4aa-929b2323bd20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:21.986512 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e397cd2b-d500-4b3d-b4aa-929b2323bd20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:22.061294 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397cd2b-d500-4b3d-b4aa-929b2323bd20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:22.068225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e397cd2b-d500-4b3d-b4aa-929b2323bd20 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:22.076020 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1084/2166] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:21 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:22.451811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:22.581713 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93a66f-4214-407c-b28c-56ba4f99757b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:22.582688 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93a66f-4214-407c-b28c-56ba4f99757b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:22.583289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93a66f-4214-407c-b28c-56ba4f99757b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:22.603596 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-8b93a66f-4214-407c-b28c-56ba4f99757b None None] MFA Rules not processed for user `f8a4c4ddb11c486db79906fb776356ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:22.605153 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8b93a66f-4214-407c-b28c-56ba4f99757b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:22.693320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1083/2167] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:24.011532 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:26.117557 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:26.545496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397cd2b-d500-4b3d-b4aa-929b2323bd20 service cinder] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:26.632168 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e397cd2b-d500-4b3d-b4aa-929b2323bd20 service cinder] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:26.636959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039e4708-ae6c-4424-9d6b-df506d8a5510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:26.637871 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e4708-ae6c-4424-9d6b-df506d8a5510 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:26.638156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e4708-ae6c-4424-9d6b-df506d8a5510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:26.638434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039e4708-ae6c-4424-9d6b-df506d8a5510 admin admin] PATH_INFO: `/v3/users/e9839882cfdf43deb6780680f9cfd541` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:26.639731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e4708-ae6c-4424-9d6b-df506d8a5510 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e9839882cfdf43deb6780680f9cfd541)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:26.642304 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039e4708-ae6c-4424-9d6b-df506d8a5510 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:26.892101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-039e4708-ae6c-4424-9d6b-df506d8a5510 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e9839882cfdf43deb6780680f9cfd541'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:26.893267 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-039e4708-ae6c-4424-9d6b-df506d8a5510 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e9839882cfdf43deb6780680f9cfd541'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:26.969107 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93a66f-4214-407c-b28c-56ba4f99757b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:26.992674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-039e4708-ae6c-4424-9d6b-df506d8a5510 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e9839882cfdf43deb6780680f9cfd541'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:26.993779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-039e4708-ae6c-4424-9d6b-df506d8a5510 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e9839882cfdf43deb6780680f9cfd541'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:26.996167 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93a66f-4214-407c-b28c-56ba4f99757b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:27.010487 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef79048-2f22-4795-b069-24ab2cb6582d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:27.012478 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79048-2f22-4795-b069-24ab2cb6582d service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:27.012944 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79048-2f22-4795-b069-24ab2cb6582d service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:27.013388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef79048-2f22-4795-b069-24ab2cb6582d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:27.015558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9ef79048-2f22-4795-b069-24ab2cb6582d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:27.022662 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-039e4708-ae6c-4424-9d6b-df506d8a5510 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e9839882cfdf43deb6780680f9cfd541'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:27.065508 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1085/2168] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:26 2022] DELETE /identity/v3/users/e9839882cfdf43deb6780680f9cfd541 => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:27.072976 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fde60-70d8-49b6-8c99-907b24987292 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:27.073305 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fde60-70d8-49b6-8c99-907b24987292 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:27.073559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d72fde60-70d8-49b6-8c99-907b24987292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:27.138249 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d72fde60-70d8-49b6-8c99-907b24987292 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:27.140305 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d72fde60-70d8-49b6-8c99-907b24987292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:27.201560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef79048-2f22-4795-b069-24ab2cb6582d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:27.205702 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef79048-2f22-4795-b069-24ab2cb6582d service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:27.220642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1084/2169] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:26 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:27.269790 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1086/2170] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:27.274463 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef79048-2f22-4795-b069-24ab2cb6582d service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:27.276586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9ef79048-2f22-4795-b069-24ab2cb6582d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:27.432783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef79048-2f22-4795-b069-24ab2cb6582d service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:27.503837 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9513ae38-ac44-42d1-b565-92a204349576 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:27.505024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513ae38-ac44-42d1-b565-92a204349576 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:27.505773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513ae38-ac44-42d1-b565-92a204349576 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:27.506260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9513ae38-ac44-42d1-b565-92a204349576 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:27.519021 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513ae38-ac44-42d1-b565-92a204349576 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:27.521077 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9513ae38-ac44-42d1-b565-92a204349576 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:27.550780 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1085/2171] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:27.667913 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:28.276651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fde60-70d8-49b6-8c99-907b24987292 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:28.278270 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d72fde60-70d8-49b6-8c99-907b24987292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:28.301926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d72fde60-70d8-49b6-8c99-907b24987292 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:28.331803 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b71aa1-bf3e-4bac-8ba9-2f70669da948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:28.334338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b71aa1-bf3e-4bac-8ba9-2f70669da948 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:28.334660 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b71aa1-bf3e-4bac-8ba9-2f70669da948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:28.335157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b71aa1-bf3e-4bac-8ba9-2f70669da948 admin admin] PATH_INFO: `/v3/projects/a9547d8d42bd4d80878c873682ed25d7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:28.336826 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b71aa1-bf3e-4bac-8ba9-2f70669da948 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9547d8d42bd4d80878c873682ed25d7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:28.342401 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b71aa1-bf3e-4bac-8ba9-2f70669da948 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:28.456236 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2d334-8355-4564-91ab-2b2e6881bfb6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:28.456771 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2d334-8355-4564-91ab-2b2e6881bfb6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:28.457276 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a2d334-8355-4564-91ab-2b2e6881bfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:28.494978 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-52a2d334-8355-4564-91ab-2b2e6881bfb6 None None] MFA Rules not processed for user `9a1371db30294725bead27951b6cdb25`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:28.496216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-52a2d334-8355-4564-91ab-2b2e6881bfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:28.536437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-54b71aa1-bf3e-4bac-8ba9-2f70669da948 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9547d8d42bd4d80878c873682ed25d7', 'request_id': 'req-54b71aa1-bf3e-4bac-8ba9-2f70669da948'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:28.595378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1086/2172] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:28 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:28.602294 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2d334-8355-4564-91ab-2b2e6881bfb6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:28.604449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-52a2d334-8355-4564-91ab-2b2e6881bfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:28.679518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-54b71aa1-bf3e-4bac-8ba9-2f70669da948 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9547d8d42bd4d80878c873682ed25d7', 'request_id': 'req-54b71aa1-bf3e-4bac-8ba9-2f70669da948'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:28.688681 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-54b71aa1-bf3e-4bac-8ba9-2f70669da948 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9547d8d42bd4d80878c873682ed25d7', 'request_id': 'req-54b71aa1-bf3e-4bac-8ba9-2f70669da948'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:28.691759 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a2d334-8355-4564-91ab-2b2e6881bfb6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:28.702381 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-54b71aa1-bf3e-4bac-8ba9-2f70669da948 admin admin] The token cache is being invalidate because project a9547d8d42bd4d80878c873682ed25d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:28.702987 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-54b71aa1-bf3e-4bac-8ba9-2f70669da948 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:28.704051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-54b71aa1-bf3e-4bac-8ba9-2f70669da948 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:28.706287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1087/2173] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:28 2022] DELETE /identity/v3/projects/a9547d8d42bd4d80878c873682ed25d7 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:28.711831 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b71aa1-bf3e-4bac-8ba9-2f70669da948 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:28.713456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-54b71aa1-bf3e-4bac-8ba9-2f70669da948 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:28.767254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703d1fb-a22f-4683-8149-ba3e318b7b34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:28.768179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703d1fb-a22f-4683-8149-ba3e318b7b34 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:28.768658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703d1fb-a22f-4683-8149-ba3e318b7b34 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:28.769767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703d1fb-a22f-4683-8149-ba3e318b7b34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:28.770995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f703d1fb-a22f-4683-8149-ba3e318b7b34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:28.786046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b71aa1-bf3e-4bac-8ba9-2f70669da948 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:28.791748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3de8ce-b62e-4c02-a47d-277f119261b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:28.792577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3de8ce-b62e-4c02-a47d-277f119261b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:28.792856 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3de8ce-b62e-4c02-a47d-277f119261b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:28.793132 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3de8ce-b62e-4c02-a47d-277f119261b2 admin admin] PATH_INFO: `/v3/users/999a2574e87442009e9f80e7c5be5401` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:28.794678 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3de8ce-b62e-4c02-a47d-277f119261b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=999a2574e87442009e9f80e7c5be5401)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:28.796383 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3de8ce-b62e-4c02-a47d-277f119261b2 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:28.842619 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703d1fb-a22f-4683-8149-ba3e318b7b34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:28.845059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703d1fb-a22f-4683-8149-ba3e318b7b34 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:28.855162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1087/2174] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 254 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:29.002571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-cb3de8ce-b62e-4c02-a47d-277f119261b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '999a2574e87442009e9f80e7c5be5401'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:29.003343 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-cb3de8ce-b62e-4c02-a47d-277f119261b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '999a2574e87442009e9f80e7c5be5401'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:29.116391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-cb3de8ce-b62e-4c02-a47d-277f119261b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '999a2574e87442009e9f80e7c5be5401'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:29.116949 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-cb3de8ce-b62e-4c02-a47d-277f119261b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '999a2574e87442009e9f80e7c5be5401'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:29.136531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-cb3de8ce-b62e-4c02-a47d-277f119261b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '999a2574e87442009e9f80e7c5be5401'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:29.151341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1088/2175] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:28 2022] DELETE /identity/v3/users/999a2574e87442009e9f80e7c5be5401 => generated 0 bytes in 440 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:29.300687 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:29.659994 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703d1fb-a22f-4683-8149-ba3e318b7b34 service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:29.664000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f703d1fb-a22f-4683-8149-ba3e318b7b34 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:29.686129 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703d1fb-a22f-4683-8149-ba3e318b7b34 service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:29.803818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142bb4a1-05a9-4b7f-a37a-bcbccf494dd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:29.804769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bb4a1-05a9-4b7f-a37a-bcbccf494dd2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:29.805065 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bb4a1-05a9-4b7f-a37a-bcbccf494dd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:29.805331 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142bb4a1-05a9-4b7f-a37a-bcbccf494dd2 admin admin] PATH_INFO: `/v3/users/4f02aa302a9e4c6b82c8d0c9848ffe26` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:29.806675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142bb4a1-05a9-4b7f-a37a-bcbccf494dd2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f02aa302a9e4c6b82c8d0c9848ffe26)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:29.808699 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142bb4a1-05a9-4b7f-a37a-bcbccf494dd2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:29.857624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3de8ce-b62e-4c02-a47d-277f119261b2 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:29.860437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-cb3de8ce-b62e-4c02-a47d-277f119261b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:29.887260 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3de8ce-b62e-4c02-a47d-277f119261b2 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:29.894275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc449bf2-3566-4d74-9ae4-47867ac9b4bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:29.895351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc449bf2-3566-4d74-9ae4-47867ac9b4bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:29.895734 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc449bf2-3566-4d74-9ae4-47867ac9b4bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:29.896469 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc449bf2-3566-4d74-9ae4-47867ac9b4bc admin admin] PATH_INFO: `/v3/projects/b9b869bd221740c8a6cc104c6d493907` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:29.898894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc449bf2-3566-4d74-9ae4-47867ac9b4bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b9b869bd221740c8a6cc104c6d493907)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:29.901292 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc449bf2-3566-4d74-9ae4-47867ac9b4bc admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:30.102929 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-142bb4a1-05a9-4b7f-a37a-bcbccf494dd2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f02aa302a9e4c6b82c8d0c9848ffe26'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:30.119375 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-dc449bf2-3566-4d74-9ae4-47867ac9b4bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b9b869bd221740c8a6cc104c6d493907', 'request_id': 'req-dc449bf2-3566-4d74-9ae4-47867ac9b4bc'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:30.119888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-142bb4a1-05a9-4b7f-a37a-bcbccf494dd2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f02aa302a9e4c6b82c8d0c9848ffe26'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:30.121392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-142bb4a1-05a9-4b7f-a37a-bcbccf494dd2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f02aa302a9e4c6b82c8d0c9848ffe26'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:30.122580 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-142bb4a1-05a9-4b7f-a37a-bcbccf494dd2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f02aa302a9e4c6b82c8d0c9848ffe26'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:30.133269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-142bb4a1-05a9-4b7f-a37a-bcbccf494dd2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f02aa302a9e4c6b82c8d0c9848ffe26'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:30.233934 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-dc449bf2-3566-4d74-9ae4-47867ac9b4bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b9b869bd221740c8a6cc104c6d493907', 'request_id': 'req-dc449bf2-3566-4d74-9ae4-47867ac9b4bc'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:30.246018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-dc449bf2-3566-4d74-9ae4-47867ac9b4bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b9b869bd221740c8a6cc104c6d493907', 'request_id': 'req-dc449bf2-3566-4d74-9ae4-47867ac9b4bc'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:30.262907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-dc449bf2-3566-4d74-9ae4-47867ac9b4bc admin admin] The token cache is being invalidate because project b9b869bd221740c8a6cc104c6d493907 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:30.263869 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-dc449bf2-3566-4d74-9ae4-47867ac9b4bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:30.264779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-dc449bf2-3566-4d74-9ae4-47867ac9b4bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:30.267822 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1089/2176] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:29 2022] DELETE /identity/v3/projects/b9b869bd221740c8a6cc104c6d493907 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:30.273708 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8df00b-74fa-405a-925c-588e9f099986 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:30.274216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8df00b-74fa-405a-925c-588e9f099986 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:30.274654 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8df00b-74fa-405a-925c-588e9f099986 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:30.299237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-8c8df00b-74fa-405a-925c-588e9f099986 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:30.302828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8c8df00b-74fa-405a-925c-588e9f099986 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:30.397852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1088/2177] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:29 2022] DELETE /identity/v3/users/4f02aa302a9e4c6b82c8d0c9848ffe26 => generated 0 bytes in 739 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:30.402726 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645e450-1312-497a-8920-b6f07b0285e1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:30.403052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645e450-1312-497a-8920-b6f07b0285e1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:30.403398 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1645e450-1312-497a-8920-b6f07b0285e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:30.414263 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1090/2178] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:30.425580 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d45e4-d3a5-4916-9827-372738ea1fbf None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:30.426280 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d45e4-d3a5-4916-9827-372738ea1fbf None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:30.426743 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512d45e4-d3a5-4916-9827-372738ea1fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:30.445015 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1645e450-1312-497a-8920-b6f07b0285e1 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:30.447963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1645e450-1312-497a-8920-b6f07b0285e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:30.471262 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-512d45e4-d3a5-4916-9827-372738ea1fbf None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:30.473307 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-512d45e4-d3a5-4916-9827-372738ea1fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:30.539828 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1089/2179] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:30.548945 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645e450-1312-497a-8920-b6f07b0285e1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:30.553886 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1645e450-1312-497a-8920-b6f07b0285e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:30.559901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1091/2180] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:38:30.564721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d45e4-d3a5-4916-9827-372738ea1fbf None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:30.576240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512d45e4-d3a5-4916-9827-372738ea1fbf None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:30.583131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f08c7-2198-4a02-9fbd-e25f8463fc39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:30.583959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f08c7-2198-4a02-9fbd-e25f8463fc39 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:30.588365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f08c7-2198-4a02-9fbd-e25f8463fc39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:30.588365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2f08c7-2198-4a02-9fbd-e25f8463fc39 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:30.588365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f08c7-2198-4a02-9fbd-e25f8463fc39 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:30.588365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f08c7-2198-4a02-9fbd-e25f8463fc39 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:30.588365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2f08c7-2198-4a02-9fbd-e25f8463fc39 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:30.605759 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1092/2181] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:38:30.606910 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f08c7-2198-4a02-9fbd-e25f8463fc39 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:30.620573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1645e450-1312-497a-8920-b6f07b0285e1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:30.626930 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da1a51-aa14-447f-9060-a108ee7c796e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:30.628777 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da1a51-aa14-447f-9060-a108ee7c796e service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:30.629165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da1a51-aa14-447f-9060-a108ee7c796e service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:30.629448 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6da1a51-aa14-447f-9060-a108ee7c796e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:30.631125 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2f08c7-2198-4a02-9fbd-e25f8463fc39 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:30.654739 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecfcb0-2429-404a-957a-4d69ef022de0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:30.655443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecfcb0-2429-404a-957a-4d69ef022de0 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:30.655722 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecfcb0-2429-404a-957a-4d69ef022de0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:30.655993 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecfcb0-2429-404a-957a-4d69ef022de0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:30.657234 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecfcb0-2429-404a-957a-4d69ef022de0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:30.659300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecfcb0-2429-404a-957a-4d69ef022de0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:30.670400 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da1a51-aa14-447f-9060-a108ee7c796e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:30.673133 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6da1a51-aa14-447f-9060-a108ee7c796e service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:30.705618 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1090/2182] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:30.857752 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1093/2183] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:30 2022] POST /identity/v3/projects => generated 401 bytes in 243 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:30.858168 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da1a51-aa14-447f-9060-a108ee7c796e service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:30.878160 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6da1a51-aa14-447f-9060-a108ee7c796e service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:30.972389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ceda4-102a-4a50-8374-a51ecd173acc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:30.973082 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ceda4-102a-4a50-8374-a51ecd173acc admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:30.973370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ceda4-102a-4a50-8374-a51ecd173acc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:30.973650 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18ceda4-102a-4a50-8374-a51ecd173acc admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:30.974380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ceda4-102a-4a50-8374-a51ecd173acc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:30.976398 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18ceda4-102a-4a50-8374-a51ecd173acc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:31.099788 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:31.108848 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1091/2184] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:30 2022] POST /identity/v3/users => generated 301 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:31.112809 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecfcb0-2429-404a-957a-4d69ef022de0 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:31.128117 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecfcb0-2429-404a-957a-4d69ef022de0 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:31.155921 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f876696-763c-492b-ac27-cbc3ddbb7323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:31.156741 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f876696-763c-492b-ac27-cbc3ddbb7323 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:31.157882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f876696-763c-492b-ac27-cbc3ddbb7323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:31.159097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f876696-763c-492b-ac27-cbc3ddbb7323 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:31.160094 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f876696-763c-492b-ac27-cbc3ddbb7323 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:31.164818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f876696-763c-492b-ac27-cbc3ddbb7323 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:31.181768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1094/2185] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:31.185514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ceda4-102a-4a50-8374-a51ecd173acc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:31.207523 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18ceda4-102a-4a50-8374-a51ecd173acc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:31.236110 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa5d09-800e-4fe6-877c-270e22a85d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:31.237765 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa5d09-800e-4fe6-877c-270e22a85d3d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:31.239056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa5d09-800e-4fe6-877c-270e22a85d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:31.239511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62aa5d09-800e-4fe6-877c-270e22a85d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:31.242206 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa5d09-800e-4fe6-877c-270e22a85d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:31.244016 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62aa5d09-800e-4fe6-877c-270e22a85d3d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:31.275852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1092/2186] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:31 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:31.277691 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f876696-763c-492b-ac27-cbc3ddbb7323 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:31.295677 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f876696-763c-492b-ac27-cbc3ddbb7323 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:31.324344 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6088b90-4d02-4a70-aa22-44398cd9a9c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:31.325540 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6088b90-4d02-4a70-aa22-44398cd9a9c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:31.325968 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6088b90-4d02-4a70-aa22-44398cd9a9c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:31.328584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6088b90-4d02-4a70-aa22-44398cd9a9c1 admin admin] PATH_INFO: `/v3/projects/89225e19622c427b98345cff38c538a5/users/3fc4dce9de4d4d79a1103d7e0b5aa7fd/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:31.378302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6088b90-4d02-4a70-aa22-44398cd9a9c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89225e19622c427b98345cff38c538a5, user_id=3fc4dce9de4d4d79a1103d7e0b5aa7fd, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:31.381149 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6088b90-4d02-4a70-aa22-44398cd9a9c1 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:31.508158 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa5d09-800e-4fe6-877c-270e22a85d3d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:31.510928 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-62aa5d09-800e-4fe6-877c-270e22a85d3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:31.543642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1095/2187] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:31 2022] PUT /identity/v3/projects/89225e19622c427b98345cff38c538a5/users/3fc4dce9de4d4d79a1103d7e0b5aa7fd/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:31.555181 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59548d87-da41-4133-8b45-1e260b7b6f15 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:31.555536 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59548d87-da41-4133-8b45-1e260b7b6f15 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:31.556036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59548d87-da41-4133-8b45-1e260b7b6f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:31.576078 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62aa5d09-800e-4fe6-877c-270e22a85d3d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:31.642644 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-59548d87-da41-4133-8b45-1e260b7b6f15 None None] MFA Rules not processed for user `3fc4dce9de4d4d79a1103d7e0b5aa7fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:31.645379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-59548d87-da41-4133-8b45-1e260b7b6f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:31.756534 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1096/2188] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:31 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:31.776340 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59548d87-da41-4133-8b45-1e260b7b6f15 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:31.814525 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25290c69-ded2-4bac-8155-db245edbe7bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:31.815679 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25290c69-ded2-4bac-8155-db245edbe7bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:31.815965 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25290c69-ded2-4bac-8155-db245edbe7bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:31.819068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25290c69-ded2-4bac-8155-db245edbe7bc admin admin] PATH_INFO: `/v3/projects/fb3e3f4170a84d2cbd2d15cd80195d4c` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:31.819068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25290c69-ded2-4bac-8155-db245edbe7bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=fb3e3f4170a84d2cbd2d15cd80195d4c)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:31.819972 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25290c69-ded2-4bac-8155-db245edbe7bc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:31.882133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59548d87-da41-4133-8b45-1e260b7b6f15 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:31.889439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c19f3c-8823-4dfb-9376-2bac55238efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:31.890111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c19f3c-8823-4dfb-9376-2bac55238efc admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:31.890403 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c19f3c-8823-4dfb-9376-2bac55238efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:31.890682 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c19f3c-8823-4dfb-9376-2bac55238efc admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:31.891460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c19f3c-8823-4dfb-9376-2bac55238efc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:31.894555 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c19f3c-8823-4dfb-9376-2bac55238efc admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:32.052836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-25290c69-ded2-4bac-8155-db245edbe7bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fb3e3f4170a84d2cbd2d15cd80195d4c', 'request_id': 'req-25290c69-ded2-4bac-8155-db245edbe7bc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:32.061736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-25290c69-ded2-4bac-8155-db245edbe7bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fb3e3f4170a84d2cbd2d15cd80195d4c', 'request_id': 'req-25290c69-ded2-4bac-8155-db245edbe7bc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:32.074407 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-25290c69-ded2-4bac-8155-db245edbe7bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fb3e3f4170a84d2cbd2d15cd80195d4c', 'request_id': 'req-25290c69-ded2-4bac-8155-db245edbe7bc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:32.091331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1097/2189] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:31 2022] POST /identity/v3/projects => generated 399 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:32.095753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c19f3c-8823-4dfb-9376-2bac55238efc admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:32.199901 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-25290c69-ded2-4bac-8155-db245edbe7bc admin admin] The token cache is being invalidate because project fb3e3f4170a84d2cbd2d15cd80195d4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:32.200191 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-25290c69-ded2-4bac-8155-db245edbe7bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:32.203877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-25290c69-ded2-4bac-8155-db245edbe7bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:32.205213 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1093/2190] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:31 2022] DELETE /identity/v3/projects/fb3e3f4170a84d2cbd2d15cd80195d4c => generated 0 bytes in 697 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:38:32.211220 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135656f2-7b66-4b02-988f-58c0551af210 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:32.211773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135656f2-7b66-4b02-988f-58c0551af210 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:32.212245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135656f2-7b66-4b02-988f-58c0551af210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:32.219534 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c19f3c-8823-4dfb-9376-2bac55238efc admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:32.225064 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5801b0-36d8-422d-8655-ac025ce2a523 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:32.226026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5801b0-36d8-422d-8655-ac025ce2a523 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:32.229545 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5801b0-36d8-422d-8655-ac025ce2a523 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:32.230202 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5801b0-36d8-422d-8655-ac025ce2a523 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:32.231180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5801b0-36d8-422d-8655-ac025ce2a523 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:32.234488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5801b0-36d8-422d-8655-ac025ce2a523 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:32.239371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-135656f2-7b66-4b02-988f-58c0551af210 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:32.241532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-135656f2-7b66-4b02-988f-58c0551af210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:32.254173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1094/2191] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:32.262538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bdc09-9e29-427b-93b8-eb75886d34e5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:32.262972 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bdc09-9e29-427b-93b8-eb75886d34e5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:32.263432 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a0bdc09-9e29-427b-93b8-eb75886d34e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:32.287446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5a0bdc09-9e29-427b-93b8-eb75886d34e5 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:32.289369 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5a0bdc09-9e29-427b-93b8-eb75886d34e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:32.308944 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1095/2192] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:32.310804 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bdc09-9e29-427b-93b8-eb75886d34e5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:32.322921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a0bdc09-9e29-427b-93b8-eb75886d34e5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:32.333126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a73ffc-5f08-4299-826f-c1e54ca06afa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:32.334077 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a73ffc-5f08-4299-826f-c1e54ca06afa admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:32.334577 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a73ffc-5f08-4299-826f-c1e54ca06afa admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:32.335184 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a73ffc-5f08-4299-826f-c1e54ca06afa admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:32.336133 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a73ffc-5f08-4299-826f-c1e54ca06afa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:32.336604 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a73ffc-5f08-4299-826f-c1e54ca06afa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:32.339462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a73ffc-5f08-4299-826f-c1e54ca06afa admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:32.363822 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1096/2193] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:38:32.364813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a73ffc-5f08-4299-826f-c1e54ca06afa admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:32.381236 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a73ffc-5f08-4299-826f-c1e54ca06afa admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:32.388600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2d38e-80a8-49fb-a6d6-11c72b4626ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:32.389380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2d38e-80a8-49fb-a6d6-11c72b4626ea admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:32.392991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2d38e-80a8-49fb-a6d6-11c72b4626ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:32.392991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc2d38e-80a8-49fb-a6d6-11c72b4626ea admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:32.392991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2d38e-80a8-49fb-a6d6-11c72b4626ea admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:32.393311 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc2d38e-80a8-49fb-a6d6-11c72b4626ea admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:32.474792 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1098/2194] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:32 2022] POST /identity/v3/users => generated 306 bytes in 381 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:38:32.479126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5801b0-36d8-422d-8655-ac025ce2a523 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:32.491020 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-fe5801b0-36d8-422d-8655-ac025ce2a523 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:32.511490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5801b0-36d8-422d-8655-ac025ce2a523 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:32.522929 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d9d25-40b9-4b61-849d-f416dafb5d34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:32.523925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d9d25-40b9-4b61-849d-f416dafb5d34 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:32.525219 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d9d25-40b9-4b61-849d-f416dafb5d34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:32.525866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79d9d25-40b9-4b61-849d-f416dafb5d34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:32.544950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d9d25-40b9-4b61-849d-f416dafb5d34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:32.545353 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1097/2195] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:32 2022] POST /identity/v3/projects => generated 371 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:32.545477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79d9d25-40b9-4b61-849d-f416dafb5d34 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:32.545583 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2d38e-80a8-49fb-a6d6-11c72b4626ea admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:32.569864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1099/2196] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:32.570929 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d9d25-40b9-4b61-849d-f416dafb5d34 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:32.584528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79d9d25-40b9-4b61-849d-f416dafb5d34 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:32.682438 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b584e4f-f450-485f-b304-ea8ec9fa82a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:32.685624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b584e4f-f450-485f-b304-ea8ec9fa82a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:32.685909 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b584e4f-f450-485f-b304-ea8ec9fa82a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:32.686188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b584e4f-f450-485f-b304-ea8ec9fa82a8 admin admin] PATH_INFO: `/v3/projects/d48e45517b994f288b859512c878cb69/users/c89ee70a3b544692a67e8f74794757f0/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:32.687267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc2d38e-80a8-49fb-a6d6-11c72b4626ea admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:32.712051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b584e4f-f450-485f-b304-ea8ec9fa82a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48e45517b994f288b859512c878cb69, user_id=c89ee70a3b544692a67e8f74794757f0, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:32.715303 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b584e4f-f450-485f-b304-ea8ec9fa82a8 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:32.718500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2508e1-d61b-435b-bc20-0eb9059aec93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:32.719305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2508e1-d61b-435b-bc20-0eb9059aec93 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:32.719639 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2508e1-d61b-435b-bc20-0eb9059aec93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:32.719874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2508e1-d61b-435b-bc20-0eb9059aec93 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:32.722085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2508e1-d61b-435b-bc20-0eb9059aec93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:32.731014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2508e1-d61b-435b-bc20-0eb9059aec93 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:32.811767 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1100/2197] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:32 2022] PUT /identity/v3/projects/d48e45517b994f288b859512c878cb69/users/c89ee70a3b544692a67e8f74794757f0/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:32.819727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b584e4f-f450-485f-b304-ea8ec9fa82a8 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:32.868418 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1098/2198] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:32 2022] POST /identity/v3/users => generated 286 bytes in 323 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:38:32.869716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2508e1-d61b-435b-bc20-0eb9059aec93 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:32.907967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2508e1-d61b-435b-bc20-0eb9059aec93 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:32.977257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b584e4f-f450-485f-b304-ea8ec9fa82a8 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:32.990363 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7889eb-4981-4156-bd78-f2d94642ebb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:32.992707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7889eb-4981-4156-bd78-f2d94642ebb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:32.993503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7889eb-4981-4156-bd78-f2d94642ebb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:32.993954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7889eb-4981-4156-bd78-f2d94642ebb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:32.995064 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7889eb-4981-4156-bd78-f2d94642ebb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:32.997086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc7889eb-4981-4156-bd78-f2d94642ebb8 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:33.013998 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1101/2199] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:33.054162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:33.055766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7889eb-4981-4156-bd78-f2d94642ebb8 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:33.059605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7cd7b-89ab-46b4-a108-db1058b47605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:33.064449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7cd7b-89ab-46b4-a108-db1058b47605 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:33.064449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7cd7b-89ab-46b4-a108-db1058b47605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:33.064449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7cd7b-89ab-46b4-a108-db1058b47605 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:33.064449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7cd7b-89ab-46b4-a108-db1058b47605 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:33.071166 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7cd7b-89ab-46b4-a108-db1058b47605 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:33.078178 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7889eb-4981-4156-bd78-f2d94642ebb8 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:33.095024 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb85f2f-690b-4e53-9b4a-01bdc78b13ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:33.096224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb85f2f-690b-4e53-9b4a-01bdc78b13ac admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:33.096513 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb85f2f-690b-4e53-9b4a-01bdc78b13ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:33.096792 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb85f2f-690b-4e53-9b4a-01bdc78b13ac admin admin] PATH_INFO: `/v3/projects/d48e45517b994f288b859512c878cb69/users/c89ee70a3b544692a67e8f74794757f0/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:33.097643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1099/2200] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:32 2022] GET /identity/v3/roles => generated 1420 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:33.101987 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb85f2f-690b-4e53-9b4a-01bdc78b13ac admin admin] RBAC: Authorizing `identity:create_grant(project_id=d48e45517b994f288b859512c878cb69, user_id=c89ee70a3b544692a67e8f74794757f0, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:33.102533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7cd7b-89ab-46b4-a108-db1058b47605 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:33.104733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb85f2f-690b-4e53-9b4a-01bdc78b13ac admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:33.121969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7cd7b-89ab-46b4-a108-db1058b47605 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:33.128552 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4c29d-90e3-4400-9418-8c5b5d5a2b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:33.129416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c29d-90e3-4400-9418-8c5b5d5a2b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:33.129821 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c29d-90e3-4400-9418-8c5b5d5a2b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:33.130456 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e4c29d-90e3-4400-9418-8c5b5d5a2b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:33.131570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4c29d-90e3-4400-9418-8c5b5d5a2b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:33.133353 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e4c29d-90e3-4400-9418-8c5b5d5a2b29 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:33.142805 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1102/2201] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:33 2022] PUT /identity/v3/projects/d48e45517b994f288b859512c878cb69/users/c89ee70a3b544692a67e8f74794757f0/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:33.146727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1100/2202] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:33 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:33.156682 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bc5f4-479f-43fb-9f61-f62ca15169bf None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:33.157074 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bc5f4-479f-43fb-9f61-f62ca15169bf None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:33.157299 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0bc5f4-479f-43fb-9f61-f62ca15169bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:33.159757 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4c29d-90e3-4400-9418-8c5b5d5a2b29 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:33.180938 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e4c29d-90e3-4400-9418-8c5b5d5a2b29 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:33.202559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-8a0bc5f4-479f-43fb-9f61-f62ca15169bf None None] MFA Rules not processed for user `c89ee70a3b544692a67e8f74794757f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:33.204011 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8a0bc5f4-479f-43fb-9f61-f62ca15169bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:33.320241 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1103/2203] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:33 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:33.329885 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bc5f4-479f-43fb-9f61-f62ca15169bf None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:33.333110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8a0bc5f4-479f-43fb-9f61-f62ca15169bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:33.344815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727f359-1747-4a8e-98e1-bd32d66efdd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:33.345736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727f359-1747-4a8e-98e1-bd32d66efdd8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:33.347096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727f359-1747-4a8e-98e1-bd32d66efdd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:33.347096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d727f359-1747-4a8e-98e1-bd32d66efdd8 admin admin] PATH_INFO: `/v3/projects/141fed31de664856af87955d21b96a0d/users/82eb827c288747b399e885b09a5c3865/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:33.376337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727f359-1747-4a8e-98e1-bd32d66efdd8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=141fed31de664856af87955d21b96a0d, user_id=82eb827c288747b399e885b09a5c3865, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:33.379355 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d727f359-1747-4a8e-98e1-bd32d66efdd8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:33.453108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0bc5f4-479f-43fb-9f61-f62ca15169bf None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:33.459525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e340d069-87bf-4c05-bdf2-7d2f49353039 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:33.464646 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340d069-87bf-4c05-bdf2-7d2f49353039 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:33.464646 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340d069-87bf-4c05-bdf2-7d2f49353039 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:33.464646 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e340d069-87bf-4c05-bdf2-7d2f49353039 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:33.475229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340d069-87bf-4c05-bdf2-7d2f49353039 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:33.477032 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e340d069-87bf-4c05-bdf2-7d2f49353039 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:33.491198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1104/2204] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:33 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:33.502814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1101/2205] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:33 2022] PUT /identity/v3/projects/141fed31de664856af87955d21b96a0d/users/82eb827c288747b399e885b09a5c3865/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:33.519255 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962db3e-78be-48f2-872e-b593590c0127 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:33.519769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962db3e-78be-48f2-872e-b593590c0127 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:33.520121 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9962db3e-78be-48f2-872e-b593590c0127 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:33.587670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-9962db3e-78be-48f2-872e-b593590c0127 None None] MFA Rules not processed for user `82eb827c288747b399e885b09a5c3865`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:33.589494 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9962db3e-78be-48f2-872e-b593590c0127 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:33.707924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1105/2206] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:33.794907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727f359-1747-4a8e-98e1-bd32d66efdd8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:33.863725 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d727f359-1747-4a8e-98e1-bd32d66efdd8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:33.869478 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34424f0e-43f3-4d06-a484-012a72e3e680 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:33.870142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34424f0e-43f3-4d06-a484-012a72e3e680 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:33.870422 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34424f0e-43f3-4d06-a484-012a72e3e680 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:33.870695 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34424f0e-43f3-4d06-a484-012a72e3e680 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:33.882067 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34424f0e-43f3-4d06-a484-012a72e3e680 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:33.883644 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34424f0e-43f3-4d06-a484-012a72e3e680 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:33.894421 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1102/2207] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:33.959616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962db3e-78be-48f2-872e-b593590c0127 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:33.971218 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9962db3e-78be-48f2-872e-b593590c0127 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:33.975073 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb93165-5a10-40bd-902f-69a191a3384b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:33.975805 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb93165-5a10-40bd-902f-69a191a3384b service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:33.976178 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb93165-5a10-40bd-902f-69a191a3384b service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:33.976524 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb93165-5a10-40bd-902f-69a191a3384b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:33.978821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8cb93165-5a10-40bd-902f-69a191a3384b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:34.067894 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb93165-5a10-40bd-902f-69a191a3384b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:34.069871 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb93165-5a10-40bd-902f-69a191a3384b service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:34.082620 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1106/2208] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:33 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:34.429164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006e9d2-abf5-46cb-a883-dd738169f68e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:34.429451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006e9d2-abf5-46cb-a883-dd738169f68e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:34.429733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0006e9d2-abf5-46cb-a883-dd738169f68e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:34.449613 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-0006e9d2-abf5-46cb-a883-dd738169f68e None None] MFA Rules not processed for user `9a1371db30294725bead27951b6cdb25`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:34.450932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0006e9d2-abf5-46cb-a883-dd738169f68e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:34.524059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1103/2209] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:34 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:34.901539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb93165-5a10-40bd-902f-69a191a3384b service cinder] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:34.903414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8cb93165-5a10-40bd-902f-69a191a3384b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:34.990852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb93165-5a10-40bd-902f-69a191a3384b service cinder] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:34.996688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdccf25-69e5-4a0b-b5d3-1c3d4835d637 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:34.997571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdccf25-69e5-4a0b-b5d3-1c3d4835d637 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:34.998348 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdccf25-69e5-4a0b-b5d3-1c3d4835d637 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:34.998693 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdccf25-69e5-4a0b-b5d3-1c3d4835d637 admin admin] PATH_INFO: `/v3/users/90f0281e2b0046f8a395fea6a128ac7f` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:35.001583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdccf25-69e5-4a0b-b5d3-1c3d4835d637 admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f0281e2b0046f8a395fea6a128ac7f)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:35.003474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdccf25-69e5-4a0b-b5d3-1c3d4835d637 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:35.363123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-abdccf25-69e5-4a0b-b5d3-1c3d4835d637 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f0281e2b0046f8a395fea6a128ac7f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:35.363791 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-abdccf25-69e5-4a0b-b5d3-1c3d4835d637 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f0281e2b0046f8a395fea6a128ac7f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:35.547676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-abdccf25-69e5-4a0b-b5d3-1c3d4835d637 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f0281e2b0046f8a395fea6a128ac7f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:35.548394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-abdccf25-69e5-4a0b-b5d3-1c3d4835d637 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f0281e2b0046f8a395fea6a128ac7f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:35.563577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-abdccf25-69e5-4a0b-b5d3-1c3d4835d637 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f0281e2b0046f8a395fea6a128ac7f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:35.588670 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1107/2210] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:34 2022] DELETE /identity/v3/users/90f0281e2b0046f8a395fea6a128ac7f => generated 0 bytes in 688 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:35.618831 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755cf1b-dfd2-4b4e-aba2-cc20e174af72 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:35.619325 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755cf1b-dfd2-4b4e-aba2-cc20e174af72 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:35.619638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b755cf1b-dfd2-4b4e-aba2-cc20e174af72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:35.640142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b755cf1b-dfd2-4b4e-aba2-cc20e174af72 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:35.641437 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b755cf1b-dfd2-4b4e-aba2-cc20e174af72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:35.716362 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1104/2211] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:35.726070 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdccf25-69e5-4a0b-b5d3-1c3d4835d637 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:35.735212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-abdccf25-69e5-4a0b-b5d3-1c3d4835d637 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:35.788398 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdccf25-69e5-4a0b-b5d3-1c3d4835d637 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:35.792009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03b77e-5007-455b-b96d-72a533dc1bb7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:35.792650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03b77e-5007-455b-b96d-72a533dc1bb7 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:35.797994 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03b77e-5007-455b-b96d-72a533dc1bb7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:35.797994 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b03b77e-5007-455b-b96d-72a533dc1bb7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:35.803004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03b77e-5007-455b-b96d-72a533dc1bb7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:35.804431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b03b77e-5007-455b-b96d-72a533dc1bb7 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:35.814812 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1108/2212] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:36.202538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=93,keystone:DELETE=5,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:36.486945 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755cf1b-dfd2-4b4e-aba2-cc20e174af72 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:36.488975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b755cf1b-dfd2-4b4e-aba2-cc20e174af72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:36.502050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b755cf1b-dfd2-4b4e-aba2-cc20e174af72 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:36.507146 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:36.512340 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:36.512340 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:36.512340 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7 admin admin] PATH_INFO: `/v3/projects/e767c1a76b15451ca1f4196c216fec78` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:36.512340 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e767c1a76b15451ca1f4196c216fec78)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:36.512340 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:36.623357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e767c1a76b15451ca1f4196c216fec78', 'request_id': 'req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:36.631140 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e767c1a76b15451ca1f4196c216fec78', 'request_id': 'req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:36.637980 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e767c1a76b15451ca1f4196c216fec78', 'request_id': 'req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:36.736142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7 admin admin] The token cache is being invalidate because project e767c1a76b15451ca1f4196c216fec78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:36.736142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:36.736142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:36.736142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1105/2213] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:36 2022] DELETE /identity/v3/projects/e767c1a76b15451ca1f4196c216fec78 => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:36.739791 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03b77e-5007-455b-b96d-72a533dc1bb7 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:36.749811 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b03b77e-5007-455b-b96d-72a533dc1bb7 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:36.810772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f16a71-25f4-498f-8bc9-183ebb342a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:36.811662 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f16a71-25f4-498f-8bc9-183ebb342a3c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:36.811945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f16a71-25f4-498f-8bc9-183ebb342a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:36.812224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f16a71-25f4-498f-8bc9-183ebb342a3c admin admin] PATH_INFO: `/v3/users/52ef92c1390d4203aeb0bc5f88e2aedd` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:36.813707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f16a71-25f4-498f-8bc9-183ebb342a3c admin admin] RBAC: Authorizing `identity:delete_user(user_id=52ef92c1390d4203aeb0bc5f88e2aedd)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:36.815700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f16a71-25f4-498f-8bc9-183ebb342a3c admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:36.832310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:37.050527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-99f16a71-25f4-498f-8bc9-183ebb342a3c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52ef92c1390d4203aeb0bc5f88e2aedd'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:37.051247 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-99f16a71-25f4-498f-8bc9-183ebb342a3c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52ef92c1390d4203aeb0bc5f88e2aedd'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:37.199465 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-99f16a71-25f4-498f-8bc9-183ebb342a3c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52ef92c1390d4203aeb0bc5f88e2aedd'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:37.200159 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-99f16a71-25f4-498f-8bc9-183ebb342a3c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52ef92c1390d4203aeb0bc5f88e2aedd'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:37.214469 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-99f16a71-25f4-498f-8bc9-183ebb342a3c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52ef92c1390d4203aeb0bc5f88e2aedd'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:37.228527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1109/2214] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:36 2022] DELETE /identity/v3/users/52ef92c1390d4203aeb0bc5f88e2aedd => generated 0 bytes in 489 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:37.733462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:37.735914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:37.750625 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d2eb7d-523c-44a7-9b3b-3a7468c69ba7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:37.819195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e07296-5161-4b0d-ae8b-a137821fb22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:37.820141 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e07296-5161-4b0d-ae8b-a137821fb22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:37.820550 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e07296-5161-4b0d-ae8b-a137821fb22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:37.820972 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e07296-5161-4b0d-ae8b-a137821fb22b admin admin] PATH_INFO: `/v3/projects/1d3bd5cc7cac492dbcb7b95afffa0d08` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:37.822530 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e07296-5161-4b0d-ae8b-a137821fb22b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d3bd5cc7cac492dbcb7b95afffa0d08)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:37.824622 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e07296-5161-4b0d-ae8b-a137821fb22b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:38.000171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e8e07296-5161-4b0d-ae8b-a137821fb22b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d3bd5cc7cac492dbcb7b95afffa0d08', 'request_id': 'req-e8e07296-5161-4b0d-ae8b-a137821fb22b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:38.010463 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e8e07296-5161-4b0d-ae8b-a137821fb22b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d3bd5cc7cac492dbcb7b95afffa0d08', 'request_id': 'req-e8e07296-5161-4b0d-ae8b-a137821fb22b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:38.019710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e8e07296-5161-4b0d-ae8b-a137821fb22b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d3bd5cc7cac492dbcb7b95afffa0d08', 'request_id': 'req-e8e07296-5161-4b0d-ae8b-a137821fb22b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:38.139173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e8e07296-5161-4b0d-ae8b-a137821fb22b admin admin] The token cache is being invalidate because project 1d3bd5cc7cac492dbcb7b95afffa0d08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:38.139486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e8e07296-5161-4b0d-ae8b-a137821fb22b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:38.140256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e8e07296-5161-4b0d-ae8b-a137821fb22b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:38.142055 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1106/2215] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:37 2022] DELETE /identity/v3/projects/1d3bd5cc7cac492dbcb7b95afffa0d08 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:38.148856 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ab388-afbf-4a64-8fc9-ddb4a3dab455 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:38.148856 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ab388-afbf-4a64-8fc9-ddb4a3dab455 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:38.149131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9ab388-afbf-4a64-8fc9-ddb4a3dab455 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:38.174195 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-fa9ab388-afbf-4a64-8fc9-ddb4a3dab455 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:38.175436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-fa9ab388-afbf-4a64-8fc9-ddb4a3dab455 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:38.247668 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1110/2216] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:38:38.256567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392f58-31f1-4aca-97e4-62ea867825fb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:38.257109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392f58-31f1-4aca-97e4-62ea867825fb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:38.257500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83392f58-31f1-4aca-97e4-62ea867825fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:38.282228 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-83392f58-31f1-4aca-97e4-62ea867825fb None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:38.283827 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-83392f58-31f1-4aca-97e4-62ea867825fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:38.292097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1107/2217] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:38:38.296598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ab388-afbf-4a64-8fc9-ddb4a3dab455 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:38.306905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9ab388-afbf-4a64-8fc9-ddb4a3dab455 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:38.311928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216f56d-5fda-45c3-a95c-c10f81b340f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:38.312660 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216f56d-5fda-45c3-a95c-c10f81b340f0 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:38.312944 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216f56d-5fda-45c3-a95c-c10f81b340f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:38.313223 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9216f56d-5fda-45c3-a95c-c10f81b340f0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:38.313960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216f56d-5fda-45c3-a95c-c10f81b340f0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:38.314272 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216f56d-5fda-45c3-a95c-c10f81b340f0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:38.315952 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9216f56d-5fda-45c3-a95c-c10f81b340f0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:38.328968 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1111/2218] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:38:38.336215 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83392f58-31f1-4aca-97e4-62ea867825fb None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:38.346219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83392f58-31f1-4aca-97e4-62ea867825fb None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:38.350915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c2564-b167-41db-ab71-c43bcd869933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:38.351563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c2564-b167-41db-ab71-c43bcd869933 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:38.351847 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c2564-b167-41db-ab71-c43bcd869933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:38.352123 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04c2564-b167-41db-ab71-c43bcd869933 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:38.352816 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c2564-b167-41db-ab71-c43bcd869933 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:38.354738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d04c2564-b167-41db-ab71-c43bcd869933 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:38.522083 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1108/2219] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:38 2022] POST /identity/v3/projects => generated 377 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:38.526030 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216f56d-5fda-45c3-a95c-c10f81b340f0 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:38.538129 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9216f56d-5fda-45c3-a95c-c10f81b340f0 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:38.607678 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fc3b7-da66-4a04-8b01-d2e8666feba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:38.608473 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fc3b7-da66-4a04-8b01-d2e8666feba0 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:38.608758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fc3b7-da66-4a04-8b01-d2e8666feba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:38.609030 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97fc3b7-da66-4a04-8b01-d2e8666feba0 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:38.609782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fc3b7-da66-4a04-8b01-d2e8666feba0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:38.611924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97fc3b7-da66-4a04-8b01-d2e8666feba0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:38.760111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1112/2220] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:38 2022] POST /identity/v3/users => generated 289 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:38:38.764212 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c2564-b167-41db-ab71-c43bcd869933 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:38.785761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d04c2564-b167-41db-ab71-c43bcd869933 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:38.792320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35651062-f322-4c15-913b-b91f75a0f7f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:38.793109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35651062-f322-4c15-913b-b91f75a0f7f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:38.793399 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35651062-f322-4c15-913b-b91f75a0f7f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:38.793694 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35651062-f322-4c15-913b-b91f75a0f7f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:38.794975 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35651062-f322-4c15-913b-b91f75a0f7f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:38.798092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35651062-f322-4c15-913b-b91f75a0f7f9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:38.823888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1109/2221] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:38.825490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fc3b7-da66-4a04-8b01-d2e8666feba0 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:38.840793 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97fc3b7-da66-4a04-8b01-d2e8666feba0 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:38.854055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9037e6ae-a097-401e-989c-411961b2fead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:38.855014 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037e6ae-a097-401e-989c-411961b2fead admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:38.855547 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037e6ae-a097-401e-989c-411961b2fead admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:38.856046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9037e6ae-a097-401e-989c-411961b2fead admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:38.857063 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037e6ae-a097-401e-989c-411961b2fead admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:38.858710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9037e6ae-a097-401e-989c-411961b2fead admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:38.879468 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1113/2222] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:38 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:38.883943 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35651062-f322-4c15-913b-b91f75a0f7f9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:38.908657 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35651062-f322-4c15-913b-b91f75a0f7f9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:38.921119 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba28ac-9852-478d-8cf6-a736903a1347 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:38.922063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba28ac-9852-478d-8cf6-a736903a1347 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:38.922348 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba28ac-9852-478d-8cf6-a736903a1347 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:38.922627 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ba28ac-9852-478d-8cf6-a736903a1347 admin admin] PATH_INFO: `/v3/projects/017bae83ab3e4ee1b68a3cbd011df4dc/users/842f1ad4329747b9a13f67cc508937a6/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:38.989788 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba28ac-9852-478d-8cf6-a736903a1347 admin admin] RBAC: Authorizing `identity:create_grant(project_id=017bae83ab3e4ee1b68a3cbd011df4dc, user_id=842f1ad4329747b9a13f67cc508937a6, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:38.989788 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ba28ac-9852-478d-8cf6-a736903a1347 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:39.370722 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1110/2223] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:38 2022] PUT /identity/v3/projects/017bae83ab3e4ee1b68a3cbd011df4dc/users/842f1ad4329747b9a13f67cc508937a6/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:38:39.383829 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c110c9-0250-43fc-9e8e-e37023049da9 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:39.384396 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c110c9-0250-43fc-9e8e-e37023049da9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:39.384396 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c110c9-0250-43fc-9e8e-e37023049da9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:39.413237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a5c110c9-0250-43fc-9e8e-e37023049da9 None None] MFA Rules not processed for user `842f1ad4329747b9a13f67cc508937a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:39.414802 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a5c110c9-0250-43fc-9e8e-e37023049da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:39.491669 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1114/2224] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:39 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:38:39.499372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba28ac-9852-478d-8cf6-a736903a1347 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:39.501759 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-10ba28ac-9852-478d-8cf6-a736903a1347 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:39.561459 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ba28ac-9852-478d-8cf6-a736903a1347 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:39.565578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a362a8da-ebf1-4e8f-b35e-619957092c8a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:39.566344 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362a8da-ebf1-4e8f-b35e-619957092c8a service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:39.566705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362a8da-ebf1-4e8f-b35e-619957092c8a service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:39.567097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a362a8da-ebf1-4e8f-b35e-619957092c8a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:39.576239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362a8da-ebf1-4e8f-b35e-619957092c8a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:39.577704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a362a8da-ebf1-4e8f-b35e-619957092c8a service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:39.588183 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1111/2225] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:41.159253 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:41.189811 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c110c9-0250-43fc-9e8e-e37023049da9 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:41.192682 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a5c110c9-0250-43fc-9e8e-e37023049da9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:41.341972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c110c9-0250-43fc-9e8e-e37023049da9 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:41.356810 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f5eb2-1d61-4500-893e-4d6ce280bf28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:41.357777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f5eb2-1d61-4500-893e-4d6ce280bf28 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:41.358054 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f5eb2-1d61-4500-893e-4d6ce280bf28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:41.358336 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79f5eb2-1d61-4500-893e-4d6ce280bf28 admin admin] PATH_INFO: `/v3/users/3fc4dce9de4d4d79a1103d7e0b5aa7fd` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:41.359780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f5eb2-1d61-4500-893e-4d6ce280bf28 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3fc4dce9de4d4d79a1103d7e0b5aa7fd)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:41.361748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79f5eb2-1d61-4500-893e-4d6ce280bf28 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:41.690053 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c79f5eb2-1d61-4500-893e-4d6ce280bf28 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3fc4dce9de4d4d79a1103d7e0b5aa7fd'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:41.690733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c79f5eb2-1d61-4500-893e-4d6ce280bf28 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3fc4dce9de4d4d79a1103d7e0b5aa7fd'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:41.779525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c79f5eb2-1d61-4500-893e-4d6ce280bf28 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3fc4dce9de4d4d79a1103d7e0b5aa7fd'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:41.780242 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c79f5eb2-1d61-4500-893e-4d6ce280bf28 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3fc4dce9de4d4d79a1103d7e0b5aa7fd'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:41.795303 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c79f5eb2-1d61-4500-893e-4d6ce280bf28 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3fc4dce9de4d4d79a1103d7e0b5aa7fd'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:41.808304 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1115/2226] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:41 2022] DELETE /identity/v3/users/3fc4dce9de4d4d79a1103d7e0b5aa7fd => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:41.814288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dbfe7-1f6f-44ca-9505-5f6fd66da867 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:41.815270 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dbfe7-1f6f-44ca-9505-5f6fd66da867 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:41.815830 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130dbfe7-1f6f-44ca-9505-5f6fd66da867 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:41.836427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-130dbfe7-1f6f-44ca-9505-5f6fd66da867 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:41.837712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-130dbfe7-1f6f-44ca-9505-5f6fd66da867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:41.916710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1112/2227] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:41.931655 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f5eb2-1d61-4500-893e-4d6ce280bf28 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:41.933320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c79f5eb2-1d61-4500-893e-4d6ce280bf28 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:42.016252 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79f5eb2-1d61-4500-893e-4d6ce280bf28 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:42.020849 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43189884-2abb-40ad-b8df-907f2361b9e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:42.021372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43189884-2abb-40ad-b8df-907f2361b9e2 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:42.021738 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43189884-2abb-40ad-b8df-907f2361b9e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:42.021924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43189884-2abb-40ad-b8df-907f2361b9e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:42.032311 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43189884-2abb-40ad-b8df-907f2361b9e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:42.033811 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43189884-2abb-40ad-b8df-907f2361b9e2 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:42.055160 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1116/2228] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:42.864313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dbfe7-1f6f-44ca-9505-5f6fd66da867 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:42.865774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-130dbfe7-1f6f-44ca-9505-5f6fd66da867 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:42.889736 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:42.897141 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130dbfe7-1f6f-44ca-9505-5f6fd66da867 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:42.915439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51daa64-1e40-4d77-8516-4c5f99f48114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:42.916401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51daa64-1e40-4d77-8516-4c5f99f48114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:42.918332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51daa64-1e40-4d77-8516-4c5f99f48114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:42.920020 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51daa64-1e40-4d77-8516-4c5f99f48114 admin admin] PATH_INFO: `/v3/projects/89225e19622c427b98345cff38c538a5` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:42.933967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51daa64-1e40-4d77-8516-4c5f99f48114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89225e19622c427b98345cff38c538a5)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:42.933967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51daa64-1e40-4d77-8516-4c5f99f48114 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:43.121526 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a51daa64-1e40-4d77-8516-4c5f99f48114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89225e19622c427b98345cff38c538a5', 'request_id': 'req-a51daa64-1e40-4d77-8516-4c5f99f48114'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:43.129137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a51daa64-1e40-4d77-8516-4c5f99f48114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89225e19622c427b98345cff38c538a5', 'request_id': 'req-a51daa64-1e40-4d77-8516-4c5f99f48114'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:43.135626 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a51daa64-1e40-4d77-8516-4c5f99f48114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89225e19622c427b98345cff38c538a5', 'request_id': 'req-a51daa64-1e40-4d77-8516-4c5f99f48114'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:43.378925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a51daa64-1e40-4d77-8516-4c5f99f48114 admin admin] The token cache is being invalidate because project 89225e19622c427b98345cff38c538a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:43.378925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a51daa64-1e40-4d77-8516-4c5f99f48114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:43.379335 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a51daa64-1e40-4d77-8516-4c5f99f48114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:43.381822 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1113/2229] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:42 2022] DELETE /identity/v3/projects/89225e19622c427b98345cff38c538a5 => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:43.385536 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43189884-2abb-40ad-b8df-907f2361b9e2 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:43.401819 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43189884-2abb-40ad-b8df-907f2361b9e2 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:43.475100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7e23d7-8892-4930-b6dc-ea6e557e79f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:43.476446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e23d7-8892-4930-b6dc-ea6e557e79f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:43.476805 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e23d7-8892-4930-b6dc-ea6e557e79f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:43.477285 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7e23d7-8892-4930-b6dc-ea6e557e79f0 admin admin] PATH_INFO: `/v3/users/c89ee70a3b544692a67e8f74794757f0` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:43.478585 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e23d7-8892-4930-b6dc-ea6e557e79f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c89ee70a3b544692a67e8f74794757f0)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:43.481089 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7e23d7-8892-4930-b6dc-ea6e557e79f0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:43.736973 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0a7e23d7-8892-4930-b6dc-ea6e557e79f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c89ee70a3b544692a67e8f74794757f0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:43.738203 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0a7e23d7-8892-4930-b6dc-ea6e557e79f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c89ee70a3b544692a67e8f74794757f0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:43.827410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0a7e23d7-8892-4930-b6dc-ea6e557e79f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c89ee70a3b544692a67e8f74794757f0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:43.828619 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0a7e23d7-8892-4930-b6dc-ea6e557e79f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c89ee70a3b544692a67e8f74794757f0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:43.843635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0a7e23d7-8892-4930-b6dc-ea6e557e79f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c89ee70a3b544692a67e8f74794757f0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:43.859246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1117/2230] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:43 2022] DELETE /identity/v3/users/c89ee70a3b544692a67e8f74794757f0 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:44.558001 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51daa64-1e40-4d77-8516-4c5f99f48114 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:44.562320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a51daa64-1e40-4d77-8516-4c5f99f48114 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:44.574235 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51daa64-1e40-4d77-8516-4c5f99f48114 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:44.634277 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be2d103-84e9-43be-8077-c6202a23d6c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:44.635180 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2d103-84e9-43be-8077-c6202a23d6c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:44.635459 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2d103-84e9-43be-8077-c6202a23d6c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:44.635731 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be2d103-84e9-43be-8077-c6202a23d6c5 admin admin] PATH_INFO: `/v3/projects/d48e45517b994f288b859512c878cb69` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:44.636921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2d103-84e9-43be-8077-c6202a23d6c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d48e45517b994f288b859512c878cb69)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:44.638884 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be2d103-84e9-43be-8077-c6202a23d6c5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:44.783166 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0be2d103-84e9-43be-8077-c6202a23d6c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd48e45517b994f288b859512c878cb69', 'request_id': 'req-0be2d103-84e9-43be-8077-c6202a23d6c5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:44.790093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0be2d103-84e9-43be-8077-c6202a23d6c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd48e45517b994f288b859512c878cb69', 'request_id': 'req-0be2d103-84e9-43be-8077-c6202a23d6c5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:44.799848 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0be2d103-84e9-43be-8077-c6202a23d6c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd48e45517b994f288b859512c878cb69', 'request_id': 'req-0be2d103-84e9-43be-8077-c6202a23d6c5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:44.895761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0be2d103-84e9-43be-8077-c6202a23d6c5 admin admin] The token cache is being invalidate because project d48e45517b994f288b859512c878cb69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:44.896053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0be2d103-84e9-43be-8077-c6202a23d6c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:44.896685 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0be2d103-84e9-43be-8077-c6202a23d6c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:44.899165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1114/2231] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:44 2022] DELETE /identity/v3/projects/d48e45517b994f288b859512c878cb69 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:44.903968 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14691dc-88ed-4cdf-8968-ab32c3824f23 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:44.904428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14691dc-88ed-4cdf-8968-ab32c3824f23 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:44.904707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14691dc-88ed-4cdf-8968-ab32c3824f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:44.924121 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a14691dc-88ed-4cdf-8968-ab32c3824f23 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:44.925329 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a14691dc-88ed-4cdf-8968-ab32c3824f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:44.985848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1118/2232] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:44.993807 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd326596-abdc-49a7-a4b9-6c1d16d9f15d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:44.994094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd326596-abdc-49a7-a4b9-6c1d16d9f15d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:44.994397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd326596-abdc-49a7-a4b9-6c1d16d9f15d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:45.013489 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-bd326596-abdc-49a7-a4b9-6c1d16d9f15d None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:45.014706 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bd326596-abdc-49a7-a4b9-6c1d16d9f15d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:45.023793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1115/2233] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:45.028270 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14691dc-88ed-4cdf-8968-ab32c3824f23 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:45.038553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14691dc-88ed-4cdf-8968-ab32c3824f23 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:45.043546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b43a1-c4a0-4f88-ba32-dbcf4566e539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:45.044249 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b43a1-c4a0-4f88-ba32-dbcf4566e539 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:45.044500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b43a1-c4a0-4f88-ba32-dbcf4566e539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:45.044803 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b43a1-c4a0-4f88-ba32-dbcf4566e539 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:45.045563 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b43a1-c4a0-4f88-ba32-dbcf4566e539 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:45.045876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b43a1-c4a0-4f88-ba32-dbcf4566e539 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:45.048440 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e5b43a1-c4a0-4f88-ba32-dbcf4566e539 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:45.060827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1119/2234] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:38:45.065422 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd326596-abdc-49a7-a4b9-6c1d16d9f15d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:45.076189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd326596-abdc-49a7-a4b9-6c1d16d9f15d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:45.081280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787cb88-9ca3-4b8c-b439-5cbeefd24f3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:45.081937 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787cb88-9ca3-4b8c-b439-5cbeefd24f3b admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:45.082222 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787cb88-9ca3-4b8c-b439-5cbeefd24f3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:45.082591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6787cb88-9ca3-4b8c-b439-5cbeefd24f3b admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:45.083459 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787cb88-9ca3-4b8c-b439-5cbeefd24f3b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:45.085452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6787cb88-9ca3-4b8c-b439-5cbeefd24f3b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:45.276373 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1116/2235] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:45 2022] POST /identity/v3/projects => generated 409 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:45.280464 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b43a1-c4a0-4f88-ba32-dbcf4566e539 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:45.291902 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b43a1-c4a0-4f88-ba32-dbcf4566e539 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:45.423829 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16cfc0-a9ce-4c5b-a625-5865a35d4bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:45.424659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16cfc0-a9ce-4c5b-a625-5865a35d4bfd admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:45.424946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16cfc0-a9ce-4c5b-a625-5865a35d4bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:45.425224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c16cfc0-a9ce-4c5b-a625-5865a35d4bfd admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:45.426244 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16cfc0-a9ce-4c5b-a625-5865a35d4bfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:45.428537 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c16cfc0-a9ce-4c5b-a625-5865a35d4bfd admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:45.568339 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1120/2236] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:45 2022] POST /identity/v3/users => generated 305 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:38:45.572697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787cb88-9ca3-4b8c-b439-5cbeefd24f3b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:45.588282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6787cb88-9ca3-4b8c-b439-5cbeefd24f3b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:45.593387 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90bacc-1be5-4261-a57b-0b25bd374721 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:45.594363 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90bacc-1be5-4261-a57b-0b25bd374721 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:45.594898 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90bacc-1be5-4261-a57b-0b25bd374721 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:45.595189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb90bacc-1be5-4261-a57b-0b25bd374721 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:45.595936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90bacc-1be5-4261-a57b-0b25bd374721 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:45.597563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb90bacc-1be5-4261-a57b-0b25bd374721 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:45.611592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1117/2237] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:45.614025 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16cfc0-a9ce-4c5b-a625-5865a35d4bfd admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:45.635602 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c16cfc0-a9ce-4c5b-a625-5865a35d4bfd admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:45.641056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f59cd5-101b-4ef8-88db-733f9b0e80b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:45.641949 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f59cd5-101b-4ef8-88db-733f9b0e80b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:45.642230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f59cd5-101b-4ef8-88db-733f9b0e80b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:45.642501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f59cd5-101b-4ef8-88db-733f9b0e80b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:45.643434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f59cd5-101b-4ef8-88db-733f9b0e80b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:45.645027 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f59cd5-101b-4ef8-88db-733f9b0e80b6 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:45.655490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1121/2238] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:45 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:38:45.660390 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90bacc-1be5-4261-a57b-0b25bd374721 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:45.676527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb90bacc-1be5-4261-a57b-0b25bd374721 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:45.681952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1858bb6b-125d-48d7-bc62-b1807625def4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:45.682884 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858bb6b-125d-48d7-bc62-b1807625def4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:45.683172 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858bb6b-125d-48d7-bc62-b1807625def4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:45.683451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1858bb6b-125d-48d7-bc62-b1807625def4 admin admin] PATH_INFO: `/v3/projects/1fffb8a51f874cba9b9a1b5016f30daf/users/a5cddead43a04f1eb7f2df5fe0372f9c/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:45.700050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858bb6b-125d-48d7-bc62-b1807625def4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1fffb8a51f874cba9b9a1b5016f30daf, user_id=a5cddead43a04f1eb7f2df5fe0372f9c, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:45.702704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1858bb6b-125d-48d7-bc62-b1807625def4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:45.751192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f59cd5-101b-4ef8-88db-733f9b0e80b6 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:45.752966 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-44f59cd5-101b-4ef8-88db-733f9b0e80b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:45.767001 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f59cd5-101b-4ef8-88db-733f9b0e80b6 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:45.772567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89207792-0b15-4ce8-b5b4-402344fe9c02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:45.773642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89207792-0b15-4ce8-b5b4-402344fe9c02 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:45.773907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89207792-0b15-4ce8-b5b4-402344fe9c02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:45.774183 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89207792-0b15-4ce8-b5b4-402344fe9c02 admin admin] PATH_INFO: `/v3/users/4014febac1134a659ebec171b8eddc5b` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:45.775425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89207792-0b15-4ce8-b5b4-402344fe9c02 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4014febac1134a659ebec171b8eddc5b)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:45.777326 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89207792-0b15-4ce8-b5b4-402344fe9c02 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:45.846574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1118/2239] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:45 2022] PUT /identity/v3/projects/1fffb8a51f874cba9b9a1b5016f30daf/users/a5cddead43a04f1eb7f2df5fe0372f9c/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:45.857632 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac4200-c441-4613-89f1-3c7a2d994d0b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:45.857916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac4200-c441-4613-89f1-3c7a2d994d0b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:45.858218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ac4200-c441-4613-89f1-3c7a2d994d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:45.893960 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-64ac4200-c441-4613-89f1-3c7a2d994d0b None None] MFA Rules not processed for user `a5cddead43a04f1eb7f2df5fe0372f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:45.893960 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-64ac4200-c441-4613-89f1-3c7a2d994d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:45.954939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1119/2240] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:45 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:38:45.959420 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac4200-c441-4613-89f1-3c7a2d994d0b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.065763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ac4200-c441-4613-89f1-3c7a2d994d0b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.065763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dd303-dad2-484a-8608-588d0a148186 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.065763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dd303-dad2-484a-8608-588d0a148186 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.065763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dd303-dad2-484a-8608-588d0a148186 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.066503 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9dd303-dad2-484a-8608-588d0a148186 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.066503 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dd303-dad2-484a-8608-588d0a148186 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.066503 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9dd303-dad2-484a-8608-588d0a148186 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.152483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:46.160540 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1120/2241] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:45 2022] POST /identity/v3/projects => generated 409 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:38:46.165079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dd303-dad2-484a-8608-588d0a148186 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.172565 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-89207792-0b15-4ce8-b5b4-402344fe9c02 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4014febac1134a659ebec171b8eddc5b'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:46.174716 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-89207792-0b15-4ce8-b5b4-402344fe9c02 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4014febac1134a659ebec171b8eddc5b'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:46.241685 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9dd303-dad2-484a-8608-588d0a148186 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.246868 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16d118-7168-487e-852b-cec2a5698685 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.247553 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16d118-7168-487e-852b-cec2a5698685 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.248007 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16d118-7168-487e-852b-cec2a5698685 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.248455 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d16d118-7168-487e-852b-cec2a5698685 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.249031 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16d118-7168-487e-852b-cec2a5698685 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.251057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d16d118-7168-487e-852b-cec2a5698685 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.296551 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-89207792-0b15-4ce8-b5b4-402344fe9c02 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4014febac1134a659ebec171b8eddc5b'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:46.297989 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-89207792-0b15-4ce8-b5b4-402344fe9c02 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4014febac1134a659ebec171b8eddc5b'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:46.313650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-89207792-0b15-4ce8-b5b4-402344fe9c02 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4014febac1134a659ebec171b8eddc5b'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:46.328907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1122/2242] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:45 2022] DELETE /identity/v3/users/4014febac1134a659ebec171b8eddc5b => generated 0 bytes in 579 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:46.334033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa89c-efb6-4068-8220-5936a4e20d12 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.334474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa89c-efb6-4068-8220-5936a4e20d12 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.334621 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2caa89c-efb6-4068-8220-5936a4e20d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.350479 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1121/2243] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:46 2022] POST /identity/v3/users => generated 311 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:46.355698 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16d118-7168-487e-852b-cec2a5698685 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.357560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1d16d118-7168-487e-852b-cec2a5698685 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:46.361656 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f2caa89c-efb6-4068-8220-5936a4e20d12 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:46.362951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f2caa89c-efb6-4068-8220-5936a4e20d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:46.371989 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d16d118-7168-487e-852b-cec2a5698685 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.433734 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1123/2244] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:46.444920 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caa89c-efb6-4068-8220-5936a4e20d12 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.446466 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f2caa89c-efb6-4068-8220-5936a4e20d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:46.452662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af119efb-856c-45dc-8c2b-c621f7f2e0a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.453914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af119efb-856c-45dc-8c2b-c621f7f2e0a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.454203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af119efb-856c-45dc-8c2b-c621f7f2e0a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.454697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af119efb-856c-45dc-8c2b-c621f7f2e0a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.455357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af119efb-856c-45dc-8c2b-c621f7f2e0a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.461961 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af119efb-856c-45dc-8c2b-c621f7f2e0a9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.471620 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1122/2245] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:46.473343 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af119efb-856c-45dc-8c2b-c621f7f2e0a9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.485049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af119efb-856c-45dc-8c2b-c621f7f2e0a9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.491010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06de7a-b7a6-499d-b6fd-349feff722f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.492406 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06de7a-b7a6-499d-b6fd-349feff722f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.492690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06de7a-b7a6-499d-b6fd-349feff722f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.492994 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e06de7a-b7a6-499d-b6fd-349feff722f2 admin admin] PATH_INFO: `/v3/projects/e2d7ef189f4e4a91ac765700bbbe57e5/users/cca400764fc64ca3999c3891d8e49081/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.512907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2caa89c-efb6-4068-8220-5936a4e20d12 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.516580 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06de7a-b7a6-499d-b6fd-349feff722f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d7ef189f4e4a91ac765700bbbe57e5, user_id=cca400764fc64ca3999c3891d8e49081, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.519401 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930f286-7306-4309-8e58-e5f260e40258 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.519401 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930f286-7306-4309-8e58-e5f260e40258 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.519401 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930f286-7306-4309-8e58-e5f260e40258 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.519401 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0930f286-7306-4309-8e58-e5f260e40258 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.520730 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e06de7a-b7a6-499d-b6fd-349feff722f2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.529692 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930f286-7306-4309-8e58-e5f260e40258 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.531270 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0930f286-7306-4309-8e58-e5f260e40258 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.542608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1124/2246] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:38:46.686248 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1123/2247] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:46 2022] PUT /identity/v3/projects/e2d7ef189f4e4a91ac765700bbbe57e5/users/cca400764fc64ca3999c3891d8e49081/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:46.691557 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930f286-7306-4309-8e58-e5f260e40258 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.725292 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0930f286-7306-4309-8e58-e5f260e40258 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.855896 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff3cc9-d293-4ac7-b186-e369c9326304 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.856911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff3cc9-d293-4ac7-b186-e369c9326304 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.857404 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff3cc9-d293-4ac7-b186-e369c9326304 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.857868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff3cc9-d293-4ac7-b186-e369c9326304 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.859828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff3cc9-d293-4ac7-b186-e369c9326304 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.861879 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff3cc9-d293-4ac7-b186-e369c9326304 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.878960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1125/2248] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:46 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:46.886771 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06de7a-b7a6-499d-b6fd-349feff722f2 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:46.913215 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e06de7a-b7a6-499d-b6fd-349feff722f2 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:46.922569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8a4a7-70f0-41b6-ad79-6bd69341012d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:46.924190 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8a4a7-70f0-41b6-ad79-6bd69341012d admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.924825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8a4a7-70f0-41b6-ad79-6bd69341012d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.925270 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff8a4a7-70f0-41b6-ad79-6bd69341012d admin admin] PATH_INFO: `/v3/projects/e2d7ef189f4e4a91ac765700bbbe57e5/users/cca400764fc64ca3999c3891d8e49081/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:46.929747 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8a4a7-70f0-41b6-ad79-6bd69341012d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2d7ef189f4e4a91ac765700bbbe57e5, user_id=cca400764fc64ca3999c3891d8e49081, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:46.934075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff8a4a7-70f0-41b6-ad79-6bd69341012d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:46.959260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1124/2249] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:46 2022] PUT /identity/v3/projects/e2d7ef189f4e4a91ac765700bbbe57e5/users/cca400764fc64ca3999c3891d8e49081/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:46.971181 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53c76d-9c35-4641-9675-da1252007401 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:46.971688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53c76d-9c35-4641-9675-da1252007401 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:46.972151 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a53c76d-9c35-4641-9675-da1252007401 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:47.005493 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-8a53c76d-9c35-4641-9675-da1252007401 None None] MFA Rules not processed for user `cca400764fc64ca3999c3891d8e49081`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:47.006891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8a53c76d-9c35-4641-9675-da1252007401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:47.098043 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1126/2250] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:46 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:38:47.105588 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:47.106334 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8a4a7-70f0-41b6-ad79-6bd69341012d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:47.108322 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-eff8a4a7-70f0-41b6-ad79-6bd69341012d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:47.179218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff8a4a7-70f0-41b6-ad79-6bd69341012d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:47.183358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497c7f3-a429-4d28-99d1-b25302ec020f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:47.184239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497c7f3-a429-4d28-99d1-b25302ec020f service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:47.184584 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497c7f3-a429-4d28-99d1-b25302ec020f service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:47.184946 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497c7f3-a429-4d28-99d1-b25302ec020f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:47.196409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497c7f3-a429-4d28-99d1-b25302ec020f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:47.198131 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497c7f3-a429-4d28-99d1-b25302ec020f service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:47.218533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1125/2251] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:47 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:47.272629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53c76d-9c35-4641-9675-da1252007401 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:47.274611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8a53c76d-9c35-4641-9675-da1252007401 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:47.369490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a53c76d-9c35-4641-9675-da1252007401 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:47.374302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314021f-6489-4dce-ba5b-7d3f483b4244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:47.375720 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314021f-6489-4dce-ba5b-7d3f483b4244 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:47.376027 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314021f-6489-4dce-ba5b-7d3f483b4244 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:47.376299 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314021f-6489-4dce-ba5b-7d3f483b4244 admin admin] PATH_INFO: `/v3/projects/5a85dd6dee5e4ba5aaf86cea1ce84dc0` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:47.377564 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314021f-6489-4dce-ba5b-7d3f483b4244 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5a85dd6dee5e4ba5aaf86cea1ce84dc0)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:47.379732 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3314021f-6489-4dce-ba5b-7d3f483b4244 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:47.537570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-3314021f-6489-4dce-ba5b-7d3f483b4244 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5a85dd6dee5e4ba5aaf86cea1ce84dc0', 'request_id': 'req-3314021f-6489-4dce-ba5b-7d3f483b4244'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:47.616616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-3314021f-6489-4dce-ba5b-7d3f483b4244 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5a85dd6dee5e4ba5aaf86cea1ce84dc0', 'request_id': 'req-3314021f-6489-4dce-ba5b-7d3f483b4244'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:47.623592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-3314021f-6489-4dce-ba5b-7d3f483b4244 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5a85dd6dee5e4ba5aaf86cea1ce84dc0', 'request_id': 'req-3314021f-6489-4dce-ba5b-7d3f483b4244'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:47.635438 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-3314021f-6489-4dce-ba5b-7d3f483b4244 admin admin] The token cache is being invalidate because project 5a85dd6dee5e4ba5aaf86cea1ce84dc0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:47.635727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-3314021f-6489-4dce-ba5b-7d3f483b4244 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:47.639024 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-3314021f-6489-4dce-ba5b-7d3f483b4244 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:47.639024 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1127/2252] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:47 2022] DELETE /identity/v3/projects/5a85dd6dee5e4ba5aaf86cea1ce84dc0 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:47.648595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566c664-5662-4eaa-aa97-8e6e94779746 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:47.648595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566c664-5662-4eaa-aa97-8e6e94779746 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:47.648595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1566c664-5662-4eaa-aa97-8e6e94779746 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:47.656561 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314021f-6489-4dce-ba5b-7d3f483b4244 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:47.657993 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3314021f-6489-4dce-ba5b-7d3f483b4244 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:47.677735 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1566c664-5662-4eaa-aa97-8e6e94779746 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:47.679237 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1566c664-5662-4eaa-aa97-8e6e94779746 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:47.736800 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314021f-6489-4dce-ba5b-7d3f483b4244 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:47.745083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e2bed-734e-429c-819d-e169687c5c90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:47.746865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e2bed-734e-429c-819d-e169687c5c90 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:47.747128 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e2bed-734e-429c-819d-e169687c5c90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:47.747449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14e2bed-734e-429c-819d-e169687c5c90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:47.752551 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a14e2bed-734e-429c-819d-e169687c5c90 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:47.788260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1126/2253] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:38:47.797380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d3ffc-7eee-4132-87ba-06ffe43fb55a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:47.797799 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d3ffc-7eee-4132-87ba-06ffe43fb55a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:47.798638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7d3ffc-7eee-4132-87ba-06ffe43fb55a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:47.823117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-df7d3ffc-7eee-4132-87ba-06ffe43fb55a None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:47.825515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-df7d3ffc-7eee-4132-87ba-06ffe43fb55a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:47.847746 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1127/2254] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:47.852187 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d3ffc-7eee-4132-87ba-06ffe43fb55a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:47.860100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e2bed-734e-429c-819d-e169687c5c90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:47.863919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14e2bed-734e-429c-819d-e169687c5c90 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:47.870329 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7d3ffc-7eee-4132-87ba-06ffe43fb55a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:47.881793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd697541-e318-402e-97b2-45cdc7021efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:47.882962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd697541-e318-402e-97b2-45cdc7021efc admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:47.883384 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd697541-e318-402e-97b2-45cdc7021efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:47.883765 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd697541-e318-402e-97b2-45cdc7021efc admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:47.884899 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd697541-e318-402e-97b2-45cdc7021efc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:47.885168 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd697541-e318-402e-97b2-45cdc7021efc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:47.887170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd697541-e318-402e-97b2-45cdc7021efc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:47.895015 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1128/2255] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:47 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:38:47.909490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1128/2256] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:38:47.909595 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e2bed-734e-429c-819d-e169687c5c90 service cinder] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:47.941811 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14e2bed-734e-429c-819d-e169687c5c90 service cinder] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:47.950008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365960e-554b-4b84-aa21-6c7cf5e88d0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:47.950914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365960e-554b-4b84-aa21-6c7cf5e88d0f admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:47.951348 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365960e-554b-4b84-aa21-6c7cf5e88d0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:47.951951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8365960e-554b-4b84-aa21-6c7cf5e88d0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:47.968122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365960e-554b-4b84-aa21-6c7cf5e88d0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:47.970271 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8365960e-554b-4b84-aa21-6c7cf5e88d0f admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:48.134468 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1129/2257] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:47 2022] POST /identity/v3/projects => generated 365 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:48.138666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd697541-e318-402e-97b2-45cdc7021efc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:48.160031 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd697541-e318-402e-97b2-45cdc7021efc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:48.174737 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365960e-554b-4b84-aa21-6c7cf5e88d0f admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:48.178291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8365960e-554b-4b84-aa21-6c7cf5e88d0f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:48.232060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e37ed-f721-4e4a-8249-0de22b1781f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:48.232803 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e37ed-f721-4e4a-8249-0de22b1781f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:48.233119 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e37ed-f721-4e4a-8249-0de22b1781f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:48.233366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-863e37ed-f721-4e4a-8249-0de22b1781f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:48.234080 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e37ed-f721-4e4a-8249-0de22b1781f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:48.236217 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-863e37ed-f721-4e4a-8249-0de22b1781f4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:48.262687 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8365960e-554b-4b84-aa21-6c7cf5e88d0f admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:48.267682 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6e87f-0744-47ef-bda9-cd35e187cbf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:48.268558 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6e87f-0744-47ef-bda9-cd35e187cbf0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:48.268843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6e87f-0744-47ef-bda9-cd35e187cbf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:48.269123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6e87f-0744-47ef-bda9-cd35e187cbf0 admin admin] PATH_INFO: `/v3/users/82eb827c288747b399e885b09a5c3865` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:48.270322 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6e87f-0744-47ef-bda9-cd35e187cbf0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=82eb827c288747b399e885b09a5c3865)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:48.273008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6e87f-0744-47ef-bda9-cd35e187cbf0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:48.376615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1129/2258] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:48 2022] POST /identity/v3/users => generated 283 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:38:48.376615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e37ed-f721-4e4a-8249-0de22b1781f4 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:48.388768 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-863e37ed-f721-4e4a-8249-0de22b1781f4 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:48.393874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0449af-6b56-407d-9193-9f47d9020abf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:48.394631 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0449af-6b56-407d-9193-9f47d9020abf admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:48.395418 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0449af-6b56-407d-9193-9f47d9020abf admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:48.395704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0449af-6b56-407d-9193-9f47d9020abf admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:48.396483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0449af-6b56-407d-9193-9f47d9020abf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:48.398094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0449af-6b56-407d-9193-9f47d9020abf admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:48.410125 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1130/2259] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:38:48.415462 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0449af-6b56-407d-9193-9f47d9020abf admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:48.431482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0449af-6b56-407d-9193-9f47d9020abf admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:48.433731 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51790210-db54-4410-9ad4-204a2dfdfdd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:48.434409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51790210-db54-4410-9ad4-204a2dfdfdd0 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:48.434700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51790210-db54-4410-9ad4-204a2dfdfdd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:48.435047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51790210-db54-4410-9ad4-204a2dfdfdd0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:48.435791 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51790210-db54-4410-9ad4-204a2dfdfdd0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:48.437957 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51790210-db54-4410-9ad4-204a2dfdfdd0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:48.454337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1131/2260] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:38:48 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:38:48.464884 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51790210-db54-4410-9ad4-204a2dfdfdd0 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:48.476043 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51790210-db54-4410-9ad4-204a2dfdfdd0 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:48.481151 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62b417bf-07bf-4a9c-8985-13fdec7c67c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:48.482063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b417bf-07bf-4a9c-8985-13fdec7c67c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:48.482361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b417bf-07bf-4a9c-8985-13fdec7c67c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:48.482638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62b417bf-07bf-4a9c-8985-13fdec7c67c2 admin admin] PATH_INFO: `/v3/projects/4887b1af8f41437b8537ea96348f8858/users/3a80e9b06ea64b0f81b36d03659e19ec/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:48.508587 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b417bf-07bf-4a9c-8985-13fdec7c67c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4887b1af8f41437b8537ea96348f8858, user_id=3a80e9b06ea64b0f81b36d03659e19ec, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:48.512234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62b417bf-07bf-4a9c-8985-13fdec7c67c2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:48.530512 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-35c6e87f-0744-47ef-bda9-cd35e187cbf0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '82eb827c288747b399e885b09a5c3865'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:48.530512 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-35c6e87f-0744-47ef-bda9-cd35e187cbf0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '82eb827c288747b399e885b09a5c3865'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:48.636315 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-35c6e87f-0744-47ef-bda9-cd35e187cbf0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '82eb827c288747b399e885b09a5c3865'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:48.637082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-35c6e87f-0744-47ef-bda9-cd35e187cbf0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '82eb827c288747b399e885b09a5c3865'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:48.643397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1132/2261] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:38:48 2022] PUT /identity/v3/projects/4887b1af8f41437b8537ea96348f8858/users/3a80e9b06ea64b0f81b36d03659e19ec/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:48.654548 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d16fd1-795f-4b4b-9fef-1b23d9e9b2bb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:48.654984 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d16fd1-795f-4b4b-9fef-1b23d9e9b2bb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:48.655346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d16fd1-795f-4b4b-9fef-1b23d9e9b2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:48.662536 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-35c6e87f-0744-47ef-bda9-cd35e187cbf0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '82eb827c288747b399e885b09a5c3865'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:48.677078 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1130/2262] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:48 2022] DELETE /identity/v3/users/82eb827c288747b399e885b09a5c3865 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:38:48.681515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331952ba-6ce9-475a-9eb5-98c56c71ea0a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:48.681808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331952ba-6ce9-475a-9eb5-98c56c71ea0a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:48.682087 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331952ba-6ce9-475a-9eb5-98c56c71ea0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:48.687245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-43d16fd1-795f-4b4b-9fef-1b23d9e9b2bb None None] MFA Rules not processed for user `3a80e9b06ea64b0f81b36d03659e19ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:48.688628 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-43d16fd1-795f-4b4b-9fef-1b23d9e9b2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:48.699812 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-331952ba-6ce9-475a-9eb5-98c56c71ea0a None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:48.701369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-331952ba-6ce9-475a-9eb5-98c56c71ea0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:48.763961 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1133/2263] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:48 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:38:48.774140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1131/2264] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:48.787954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d16fd1-795f-4b4b-9fef-1b23d9e9b2bb None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:48.789384 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-43d16fd1-795f-4b4b-9fef-1b23d9e9b2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:48.865285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d16fd1-795f-4b4b-9fef-1b23d9e9b2bb None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:48.871180 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab80c76-fe09-43bd-bab9-b204fd20db89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:48.872088 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab80c76-fe09-43bd-bab9-b204fd20db89 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:48.872425 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab80c76-fe09-43bd-bab9-b204fd20db89 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:48.872768 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab80c76-fe09-43bd-bab9-b204fd20db89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:48.883405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab80c76-fe09-43bd-bab9-b204fd20db89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:48.884947 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab80c76-fe09-43bd-bab9-b204fd20db89 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:48.902845 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331952ba-6ce9-475a-9eb5-98c56c71ea0a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:48.903317 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1134/2265] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:48.904452 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-331952ba-6ce9-475a-9eb5-98c56c71ea0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:49.000576 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331952ba-6ce9-475a-9eb5-98c56c71ea0a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:49.005388 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba47c1f-4120-4843-a4e3-cbcbc54c59f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:49.006464 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba47c1f-4120-4843-a4e3-cbcbc54c59f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:49.006921 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba47c1f-4120-4843-a4e3-cbcbc54c59f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:49.007328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba47c1f-4120-4843-a4e3-cbcbc54c59f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:49.019246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba47c1f-4120-4843-a4e3-cbcbc54c59f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:49.021961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba47c1f-4120-4843-a4e3-cbcbc54c59f1 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:49.036491 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1132/2266] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:48 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:38:49.270006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef3449-e8d3-49e6-a8ea-ad8bd97717e6 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:49.271646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef3449-e8d3-49e6-a8ea-ad8bd97717e6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:49.272968 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cef3449-e8d3-49e6-a8ea-ad8bd97717e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:49.298735 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6cef3449-e8d3-49e6-a8ea-ad8bd97717e6 None None] MFA Rules not processed for user `deed55901c264b8da58e57c21840c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:49.299863 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6cef3449-e8d3-49e6-a8ea-ad8bd97717e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:49.366543 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1135/2267] 10.222.0.40 () {58 vars in 1009 bytes} [Fri Jul 15 19:38:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:49.447962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba47c1f-4120-4843-a4e3-cbcbc54c59f1 service cinder] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:49.450174 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5ba47c1f-4120-4843-a4e3-cbcbc54c59f1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:49.559029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba47c1f-4120-4843-a4e3-cbcbc54c59f1 service cinder] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:49.565772 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c19e93d-fcd3-44ee-bef1-19d575eb77d1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0402e1bd20b042cdbdcb890616b22726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:49.566450 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19e93d-fcd3-44ee-bef1-19d575eb77d1 service swift] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:49.566734 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19e93d-fcd3-44ee-bef1-19d575eb77d1 service swift] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:49.567060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c19e93d-fcd3-44ee-bef1-19d575eb77d1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:49.578984 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19e93d-fcd3-44ee-bef1-19d575eb77d1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:49.580592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c19e93d-fcd3-44ee-bef1-19d575eb77d1 service swift] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:49.589807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1133/2268] 10.222.0.40 () {60 vars in 1384 bytes} [Fri Jul 15 19:38:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:38:49.760212 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef3449-e8d3-49e6-a8ea-ad8bd97717e6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:49.762155 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6cef3449-e8d3-49e6-a8ea-ad8bd97717e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:49.796281 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cef3449-e8d3-49e6-a8ea-ad8bd97717e6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:49.804416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e0ac3-1ae2-49dc-a298-1423b845f239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:49.806149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0ac3-1ae2-49dc-a298-1423b845f239 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:49.806820 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0ac3-1ae2-49dc-a298-1423b845f239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:49.807186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0ac3-1ae2-49dc-a298-1423b845f239 admin admin] PATH_INFO: `/v3/projects/141fed31de664856af87955d21b96a0d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:49.808956 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e0ac3-1ae2-49dc-a298-1423b845f239 admin admin] RBAC: Authorizing `identity:delete_project(project_id=141fed31de664856af87955d21b96a0d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:49.811738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1e0ac3-1ae2-49dc-a298-1423b845f239 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:49.998578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd1e0ac3-1ae2-49dc-a298-1423b845f239 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '141fed31de664856af87955d21b96a0d', 'request_id': 'req-bd1e0ac3-1ae2-49dc-a298-1423b845f239'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:50.010995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd1e0ac3-1ae2-49dc-a298-1423b845f239 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '141fed31de664856af87955d21b96a0d', 'request_id': 'req-bd1e0ac3-1ae2-49dc-a298-1423b845f239'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:50.040305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd1e0ac3-1ae2-49dc-a298-1423b845f239 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '141fed31de664856af87955d21b96a0d', 'request_id': 'req-bd1e0ac3-1ae2-49dc-a298-1423b845f239'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:50.148121 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:50.166097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd1e0ac3-1ae2-49dc-a298-1423b845f239 admin admin] The token cache is being invalidate because project 141fed31de664856af87955d21b96a0d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:50.166486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd1e0ac3-1ae2-49dc-a298-1423b845f239 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:50.167375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bd1e0ac3-1ae2-49dc-a298-1423b845f239 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:50.171050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1136/2269] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:49 2022] DELETE /identity/v3/projects/141fed31de664856af87955d21b96a0d => generated 0 bytes in 412 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:50.591447 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:51.189508 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adddd97-92de-41b8-bcc1-01db3461081c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:51.190034 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adddd97-92de-41b8-bcc1-01db3461081c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:51.190034 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adddd97-92de-41b8-bcc1-01db3461081c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:51.216956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-0adddd97-92de-41b8-bcc1-01db3461081c None None] MFA Rules not processed for user `deed55901c264b8da58e57c21840c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:51.219029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0adddd97-92de-41b8-bcc1-01db3461081c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:51.288188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1134/2270] 10.222.0.40 () {58 vars in 967 bytes} [Fri Jul 15 19:38:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:51.304426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e0ac3-1ae2-49dc-a298-1423b845f239 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:51.307586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bd1e0ac3-1ae2-49dc-a298-1423b845f239 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:51.390048 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e0ac3-1ae2-49dc-a298-1423b845f239 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:51.395816 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740c461-a36c-4b37-b94e-959389b31567 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0402e1bd20b042cdbdcb890616b22726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:51.396496 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740c461-a36c-4b37-b94e-959389b31567 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:51.396783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740c461-a36c-4b37-b94e-959389b31567 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:51.397062 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0740c461-a36c-4b37-b94e-959389b31567 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:51.405690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740c461-a36c-4b37-b94e-959389b31567 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:51.407989 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0740c461-a36c-4b37-b94e-959389b31567 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:51.416576 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1137/2271] 10.222.0.40 () {60 vars in 1384 bytes} [Fri Jul 15 19:38:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:38:52.520328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac007-9337-440c-9738-6125fd208422 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:52.521154 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac007-9337-440c-9738-6125fd208422 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:52.521605 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fac007-9337-440c-9738-6125fd208422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:52.592531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-16fac007-9337-440c-9738-6125fd208422 None None] MFA Rules not processed for user `deed55901c264b8da58e57c21840c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:52.593948 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-16fac007-9337-440c-9738-6125fd208422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:52.601560 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1135/2272] 10.222.0.40 () {58 vars in 1009 bytes} [Fri Jul 15 19:38:52 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:52.616379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740c461-a36c-4b37-b94e-959389b31567 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:52.631313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0740c461-a36c-4b37-b94e-959389b31567 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:52.638726 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90771e86-5078-45b2-bc8c-53ab941b48fe service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0402e1bd20b042cdbdcb890616b22726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:52.639810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90771e86-5078-45b2-bc8c-53ab941b48fe service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:52.641090 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90771e86-5078-45b2-bc8c-53ab941b48fe service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:52.641705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90771e86-5078-45b2-bc8c-53ab941b48fe service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:52.653680 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90771e86-5078-45b2-bc8c-53ab941b48fe service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:52.663224 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90771e86-5078-45b2-bc8c-53ab941b48fe service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:52.673178 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1138/2273] 10.222.0.40 () {60 vars in 1384 bytes} [Fri Jul 15 19:38:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:38:52.936396 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf6fa7-94f4-4be8-b726-2ea8540210c1 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:52.936592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf6fa7-94f4-4be8-b726-2ea8540210c1 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:52.937072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bf6fa7-94f4-4be8-b726-2ea8540210c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:52.956760 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-99bf6fa7-94f4-4be8-b726-2ea8540210c1 None None] MFA Rules not processed for user `efaba747710744f59d77350e6f78f18b`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:52.968573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-99bf6fa7-94f4-4be8-b726-2ea8540210c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:53.024147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1136/2274] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:52 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:53.593550 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c07cb-0bfb-4e20-9aa3-dcb28598b5b5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:53.594213 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c07cb-0bfb-4e20-9aa3-dcb28598b5b5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:53.594724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4c07cb-0bfb-4e20-9aa3-dcb28598b5b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:53.616366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-cb4c07cb-0bfb-4e20-9aa3-dcb28598b5b5 None None] MFA Rules not processed for user `deed55901c264b8da58e57c21840c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:53.617838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cb4c07cb-0bfb-4e20-9aa3-dcb28598b5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:53.627734 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1139/2275] 10.222.0.40 () {58 vars in 967 bytes} [Fri Jul 15 19:38:53 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:53.642476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf6fa7-94f4-4be8-b726-2ea8540210c1 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:53.657545 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bf6fa7-94f4-4be8-b726-2ea8540210c1 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:53.663055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cb9bc-2bdf-4e11-833c-9bf20e1b4a6d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0402e1bd20b042cdbdcb890616b22726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:53.663703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cb9bc-2bdf-4e11-833c-9bf20e1b4a6d service swift] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:53.664183 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cb9bc-2bdf-4e11-833c-9bf20e1b4a6d service swift] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:53.664502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cb9bc-2bdf-4e11-833c-9bf20e1b4a6d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:53.674353 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cb9bc-2bdf-4e11-833c-9bf20e1b4a6d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:53.676183 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cb9bc-2bdf-4e11-833c-9bf20e1b4a6d service swift] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:53.684826 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1137/2276] 10.222.0.40 () {60 vars in 1384 bytes} [Fri Jul 15 19:38:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:38:56.240224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:56.613272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:57.043271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c07cb-0bfb-4e20-9aa3-dcb28598b5b5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:57.044944 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cb4c07cb-0bfb-4e20-9aa3-dcb28598b5b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:57.153083 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4c07cb-0bfb-4e20-9aa3-dcb28598b5b5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:57.164285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a42cde23-e771-4cc5-9671-b0a3bdefc05a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:57.167430 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cde23-e771-4cc5-9671-b0a3bdefc05a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:57.168114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cde23-e771-4cc5-9671-b0a3bdefc05a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:57.168730 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a42cde23-e771-4cc5-9671-b0a3bdefc05a admin admin] PATH_INFO: `/v3/users/a5cddead43a04f1eb7f2df5fe0372f9c` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:57.170314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42cde23-e771-4cc5-9671-b0a3bdefc05a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5cddead43a04f1eb7f2df5fe0372f9c)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:57.173017 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a42cde23-e771-4cc5-9671-b0a3bdefc05a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:57.251432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cb9bc-2bdf-4e11-833c-9bf20e1b4a6d service swift] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:57.253399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2d7cb9bc-2bdf-4e11-833c-9bf20e1b4a6d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:57.281307 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cb9bc-2bdf-4e11-833c-9bf20e1b4a6d service swift] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:57.303719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77ba9bc8-b1be-4cda-8950-322a509d3aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:57.310522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba9bc8-b1be-4cda-8950-322a509d3aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:57.310522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba9bc8-b1be-4cda-8950-322a509d3aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:57.310522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77ba9bc8-b1be-4cda-8950-322a509d3aeb admin admin] PATH_INFO: `/v3/users/f8a4c4ddb11c486db79906fb776356ce` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:57.310522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba9bc8-b1be-4cda-8950-322a509d3aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8a4c4ddb11c486db79906fb776356ce)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:57.310522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77ba9bc8-b1be-4cda-8950-322a509d3aeb admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:57.497515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a42cde23-e771-4cc5-9671-b0a3bdefc05a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5cddead43a04f1eb7f2df5fe0372f9c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:57.513878 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a42cde23-e771-4cc5-9671-b0a3bdefc05a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5cddead43a04f1eb7f2df5fe0372f9c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:57.514999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a42cde23-e771-4cc5-9671-b0a3bdefc05a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5cddead43a04f1eb7f2df5fe0372f9c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:57.515702 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a42cde23-e771-4cc5-9671-b0a3bdefc05a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5cddead43a04f1eb7f2df5fe0372f9c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:57.525031 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a42cde23-e771-4cc5-9671-b0a3bdefc05a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5cddead43a04f1eb7f2df5fe0372f9c'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:57.597507 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-77ba9bc8-b1be-4cda-8950-322a509d3aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8a4c4ddb11c486db79906fb776356ce'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:57.598286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-77ba9bc8-b1be-4cda-8950-322a509d3aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8a4c4ddb11c486db79906fb776356ce'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:57.663939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1140/2277] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:57 2022] DELETE /identity/v3/users/a5cddead43a04f1eb7f2df5fe0372f9c => generated 0 bytes in 619 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:57.667407 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5c727-9e24-438d-8109-4152f937a7b9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:57.667817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5c727-9e24-438d-8109-4152f937a7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:57.668005 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a5c727-9e24-438d-8109-4152f937a7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:57.686486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-07a5c727-9e24-438d-8109-4152f937a7b9 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:57.688444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-07a5c727-9e24-438d-8109-4152f937a7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:57.725055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-77ba9bc8-b1be-4cda-8950-322a509d3aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8a4c4ddb11c486db79906fb776356ce'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:57.725963 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-77ba9bc8-b1be-4cda-8950-322a509d3aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8a4c4ddb11c486db79906fb776356ce'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:57.742061 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-77ba9bc8-b1be-4cda-8950-322a509d3aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8a4c4ddb11c486db79906fb776356ce'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:57.757661 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1138/2278] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:57 2022] DELETE /identity/v3/users/f8a4c4ddb11c486db79906fb776356ce => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:38:57.764356 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d74a9f-1a77-48f8-a5e0-5d13ecf14ecf None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:57.764962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d74a9f-1a77-48f8-a5e0-5d13ecf14ecf None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:57.766040 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d74a9f-1a77-48f8-a5e0-5d13ecf14ecf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:57.770906 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1141/2279] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:38:57.783452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5c727-9e24-438d-8109-4152f937a7b9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:57.785852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-b8d74a9f-1a77-48f8-a5e0-5d13ecf14ecf None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:57.786219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-07a5c727-9e24-438d-8109-4152f937a7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:57.787539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b8d74a9f-1a77-48f8-a5e0-5d13ecf14ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:57.872664 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1139/2280] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:57.881820 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a5c727-9e24-438d-8109-4152f937a7b9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:57.891283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d74a9f-1a77-48f8-a5e0-5d13ecf14ecf None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:57.892638 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b8d74a9f-1a77-48f8-a5e0-5d13ecf14ecf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:57.894857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:57.953509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df14fc3-ff87-4266-b6e3-b40a0fca4beb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:57.954571 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df14fc3-ff87-4266-b6e3-b40a0fca4beb service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:57.955019 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df14fc3-ff87-4266-b6e3-b40a0fca4beb service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:57.955301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df14fc3-ff87-4266-b6e3-b40a0fca4beb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:57.966319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df14fc3-ff87-4266-b6e3-b40a0fca4beb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:57.968185 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df14fc3-ff87-4266-b6e3-b40a0fca4beb service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:57.980912 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1142/2281] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:38:57.988012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d74a9f-1a77-48f8-a5e0-5d13ecf14ecf None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:57.992748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c9307-90e0-4304-ba6f-0ef4105916ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:57.993413 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c9307-90e0-4304-ba6f-0ef4105916ea service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:57.994174 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c9307-90e0-4304-ba6f-0ef4105916ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:57.994174 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935c9307-90e0-4304-ba6f-0ef4105916ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:58.005022 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c9307-90e0-4304-ba6f-0ef4105916ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:58.007033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935c9307-90e0-4304-ba6f-0ef4105916ea service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:58.020298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1140/2282] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:38:58.363694 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df14fc3-ff87-4266-b6e3-b40a0fca4beb service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:58.365154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5df14fc3-ff87-4266-b6e3-b40a0fca4beb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:58.398921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df14fc3-ff87-4266-b6e3-b40a0fca4beb service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:58.408721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec42408-ecc9-4217-bbbe-61cbb1650f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:58.409781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec42408-ecc9-4217-bbbe-61cbb1650f9d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:58.410227 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec42408-ecc9-4217-bbbe-61cbb1650f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:58.410730 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec42408-ecc9-4217-bbbe-61cbb1650f9d admin admin] PATH_INFO: `/v3/projects/9df05408162f486b838398697e6ec96f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:58.414913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec42408-ecc9-4217-bbbe-61cbb1650f9d admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df05408162f486b838398697e6ec96f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:58.415765 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec42408-ecc9-4217-bbbe-61cbb1650f9d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:58.610041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2ec42408-ecc9-4217-bbbe-61cbb1650f9d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df05408162f486b838398697e6ec96f', 'request_id': 'req-2ec42408-ecc9-4217-bbbe-61cbb1650f9d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:58.617309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2ec42408-ecc9-4217-bbbe-61cbb1650f9d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df05408162f486b838398697e6ec96f', 'request_id': 'req-2ec42408-ecc9-4217-bbbe-61cbb1650f9d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:58.622552 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2ec42408-ecc9-4217-bbbe-61cbb1650f9d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df05408162f486b838398697e6ec96f', 'request_id': 'req-2ec42408-ecc9-4217-bbbe-61cbb1650f9d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:58.694990 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c9307-90e0-4304-ba6f-0ef4105916ea service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:58.697902 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-935c9307-90e0-4304-ba6f-0ef4105916ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:58.717806 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935c9307-90e0-4304-ba6f-0ef4105916ea service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:58.725320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2ec42408-ecc9-4217-bbbe-61cbb1650f9d admin admin] The token cache is being invalidate because project 9df05408162f486b838398697e6ec96f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:58.725860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2ec42408-ecc9-4217-bbbe-61cbb1650f9d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:58.727014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2ec42408-ecc9-4217-bbbe-61cbb1650f9d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:58.729266 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1143/2283] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:58 2022] DELETE /identity/v3/projects/9df05408162f486b838398697e6ec96f => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:58.737833 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd8cee-cf79-4914-b83b-232cfca9dbfc None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:58.740805 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd8cee-cf79-4914-b83b-232cfca9dbfc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:58.741268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fd8cee-cf79-4914-b83b-232cfca9dbfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:58.783355 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-65fd8cee-cf79-4914-b83b-232cfca9dbfc None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:58.784728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-65fd8cee-cf79-4914-b83b-232cfca9dbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:58.816436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7142f62-9c57-4acb-99ac-01a225a2b53e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:58.817541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7142f62-9c57-4acb-99ac-01a225a2b53e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:58.818021 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7142f62-9c57-4acb-99ac-01a225a2b53e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:58.818302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7142f62-9c57-4acb-99ac-01a225a2b53e admin admin] PATH_INFO: `/v3/projects/1fffb8a51f874cba9b9a1b5016f30daf` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:58.820164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7142f62-9c57-4acb-99ac-01a225a2b53e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1fffb8a51f874cba9b9a1b5016f30daf)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:58.823867 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7142f62-9c57-4acb-99ac-01a225a2b53e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:58.853078 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1144/2284] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:58.853941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd8cee-cf79-4914-b83b-232cfca9dbfc None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:58.855281 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-65fd8cee-cf79-4914-b83b-232cfca9dbfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:58.867810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fd8cee-cf79-4914-b83b-232cfca9dbfc None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:58.872573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760d231-497f-4bb8-bbb6-1adb1b0e85cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:58.873438 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760d231-497f-4bb8-bbb6-1adb1b0e85cb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:58.873723 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760d231-497f-4bb8-bbb6-1adb1b0e85cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:58.873999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1760d231-497f-4bb8-bbb6-1adb1b0e85cb admin admin] PATH_INFO: `/v3/users/842f1ad4329747b9a13f67cc508937a6` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:58.875411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760d231-497f-4bb8-bbb6-1adb1b0e85cb admin admin] RBAC: Authorizing `identity:delete_user(user_id=842f1ad4329747b9a13f67cc508937a6)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:58.877787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1760d231-497f-4bb8-bbb6-1adb1b0e85cb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:59.023441 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:59.049587 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d7142f62-9c57-4acb-99ac-01a225a2b53e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1fffb8a51f874cba9b9a1b5016f30daf', 'request_id': 'req-d7142f62-9c57-4acb-99ac-01a225a2b53e'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:59.151751 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d7142f62-9c57-4acb-99ac-01a225a2b53e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1fffb8a51f874cba9b9a1b5016f30daf', 'request_id': 'req-d7142f62-9c57-4acb-99ac-01a225a2b53e'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:59.161067 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d7142f62-9c57-4acb-99ac-01a225a2b53e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1fffb8a51f874cba9b9a1b5016f30daf', 'request_id': 'req-d7142f62-9c57-4acb-99ac-01a225a2b53e'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:59.176487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d7142f62-9c57-4acb-99ac-01a225a2b53e admin admin] The token cache is being invalidate because project 1fffb8a51f874cba9b9a1b5016f30daf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:38:59.176779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d7142f62-9c57-4acb-99ac-01a225a2b53e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:59.177442 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d7142f62-9c57-4acb-99ac-01a225a2b53e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:59.179040 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1141/2285] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:38:58 2022] DELETE /identity/v3/projects/1fffb8a51f874cba9b9a1b5016f30daf => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:59.183226 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fd926-7eee-42fe-8adb-a2927c1d26ba None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:59.183557 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fd926-7eee-42fe-8adb-a2927c1d26ba None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:59.183840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4fd926-7eee-42fe-8adb-a2927c1d26ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:59.202465 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-0d4fd926-7eee-42fe-8adb-a2927c1d26ba None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:59.204285 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0d4fd926-7eee-42fe-8adb-a2927c1d26ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:59.232823 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1760d231-497f-4bb8-bbb6-1adb1b0e85cb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '842f1ad4329747b9a13f67cc508937a6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:59.246043 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1760d231-497f-4bb8-bbb6-1adb1b0e85cb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '842f1ad4329747b9a13f67cc508937a6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:59.247101 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1760d231-497f-4bb8-bbb6-1adb1b0e85cb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '842f1ad4329747b9a13f67cc508937a6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:59.247841 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1760d231-497f-4bb8-bbb6-1adb1b0e85cb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '842f1ad4329747b9a13f67cc508937a6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:59.260242 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-1760d231-497f-4bb8-bbb6-1adb1b0e85cb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '842f1ad4329747b9a13f67cc508937a6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:59.277510 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1142/2286] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:59.278774 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fd926-7eee-42fe-8adb-a2927c1d26ba None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:59.280058 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0d4fd926-7eee-42fe-8adb-a2927c1d26ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:59.292214 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4fd926-7eee-42fe-8adb-a2927c1d26ba None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:59.297010 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b12a06-9574-44db-b6d7-c5f566048d88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:59.297886 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b12a06-9574-44db-b6d7-c5f566048d88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:59.298167 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b12a06-9574-44db-b6d7-c5f566048d88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:59.298444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b12a06-9574-44db-b6d7-c5f566048d88 admin admin] PATH_INFO: `/v3/users/cca400764fc64ca3999c3891d8e49081` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:59.299674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b12a06-9574-44db-b6d7-c5f566048d88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cca400764fc64ca3999c3891d8e49081)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:59.301607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b12a06-9574-44db-b6d7-c5f566048d88 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:59.314239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:38:59.377426 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1145/2287] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:58 2022] DELETE /identity/v3/users/842f1ad4329747b9a13f67cc508937a6 => generated 0 bytes in 523 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:59.378091 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760d231-497f-4bb8-bbb6-1adb1b0e85cb admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:59.445705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1760d231-497f-4bb8-bbb6-1adb1b0e85cb admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:59.450295 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1fa2ea7-dbe9-4af3-99eb-01d3d9c51235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:59.450980 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa2ea7-dbe9-4af3-99eb-01d3d9c51235 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:59.451264 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa2ea7-dbe9-4af3-99eb-01d3d9c51235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:59.451538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1fa2ea7-dbe9-4af3-99eb-01d3d9c51235 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:59.452272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa2ea7-dbe9-4af3-99eb-01d3d9c51235 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:38:59.452604 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa2ea7-dbe9-4af3-99eb-01d3d9c51235 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:59.454813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1fa2ea7-dbe9-4af3-99eb-01d3d9c51235 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:59.466432 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1146/2288] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:38:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:38:59.467888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ac7a6-288b-4def-adae-f704b1fc2684 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:59.468176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ac7a6-288b-4def-adae-f704b1fc2684 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:59.468532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ac7a6-288b-4def-adae-f704b1fc2684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:59.485986 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7c7ac7a6-288b-4def-adae-f704b1fc2684 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:38:59.487153 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7c7ac7a6-288b-4def-adae-f704b1fc2684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:59.501485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1147/2289] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:38:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:38:59.502322 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ac7a6-288b-4def-adae-f704b1fc2684 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:59.513690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ac7a6-288b-4def-adae-f704b1fc2684 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:59.519979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3e383-d1a1-483c-ad1b-f425b2492988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:59.520907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3e383-d1a1-483c-ad1b-f425b2492988 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:59.521255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3e383-d1a1-483c-ad1b-f425b2492988 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:59.521606 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd3e383-d1a1-483c-ad1b-f425b2492988 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:59.522460 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3e383-d1a1-483c-ad1b-f425b2492988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:59.524592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd3e383-d1a1-483c-ad1b-f425b2492988 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:38:59.611844 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a3b12a06-9574-44db-b6d7-c5f566048d88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cca400764fc64ca3999c3891d8e49081'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:59.612456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a3b12a06-9574-44db-b6d7-c5f566048d88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cca400764fc64ca3999c3891d8e49081'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:59.629111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1148/2290] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:38:59 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:38:59.629826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3e383-d1a1-483c-ad1b-f425b2492988 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:59.632049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-edd3e383-d1a1-483c-ad1b-f425b2492988 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:59.696445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a3b12a06-9574-44db-b6d7-c5f566048d88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cca400764fc64ca3999c3891d8e49081'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:59.697882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a3b12a06-9574-44db-b6d7-c5f566048d88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cca400764fc64ca3999c3891d8e49081'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:59.714178 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd3e383-d1a1-483c-ad1b-f425b2492988 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:59.716541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a3b12a06-9574-44db-b6d7-c5f566048d88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cca400764fc64ca3999c3891d8e49081'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:38:59.718553 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7023a-e85f-4aa4-91a9-7761b9178e42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:59.719488 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7023a-e85f-4aa4-91a9-7761b9178e42 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:59.719770 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7023a-e85f-4aa4-91a9-7761b9178e42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:59.720040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb7023a-e85f-4aa4-91a9-7761b9178e42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:59.721920 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-abb7023a-e85f-4aa4-91a9-7761b9178e42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:59.731963 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1143/2291] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:38:59 2022] DELETE /identity/v3/users/cca400764fc64ca3999c3891d8e49081 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:38:59.746766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b12a06-9574-44db-b6d7-c5f566048d88 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:38:59.752593 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a3b12a06-9574-44db-b6d7-c5f566048d88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:38:59.964379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b12a06-9574-44db-b6d7-c5f566048d88 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:38:59.976674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb02579-374a-4c30-9c53-9fb8738f3fde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:38:59.977398 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02579-374a-4c30-9c53-9fb8738f3fde admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:38:59.977691 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02579-374a-4c30-9c53-9fb8738f3fde admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:38:59.977974 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb02579-374a-4c30-9c53-9fb8738f3fde admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:38:59.979194 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb02579-374a-4c30-9c53-9fb8738f3fde admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:38:59.985465 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb02579-374a-4c30-9c53-9fb8738f3fde admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:00.040582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7023a-e85f-4aa4-91a9-7761b9178e42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:00.040582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb7023a-e85f-4aa4-91a9-7761b9178e42 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:00.052931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1149/2292] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:38:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:00.143026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1144/2293] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:38:59 2022] POST /identity/v3/users => generated 287 bytes in 410 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:00.145949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7023a-e85f-4aa4-91a9-7761b9178e42 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:00.169720 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb7023a-e85f-4aa4-91a9-7761b9178e42 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:00.182777 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b2ef9-281b-4a2b-97c6-624674f22c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:00.184644 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b2ef9-281b-4a2b-97c6-624674f22c23 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:00.184962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b2ef9-281b-4a2b-97c6-624674f22c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:00.185244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20b2ef9-281b-4a2b-97c6-624674f22c23 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:00.186154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b2ef9-281b-4a2b-97c6-624674f22c23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:00.195395 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20b2ef9-281b-4a2b-97c6-624674f22c23 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:00.213500 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1150/2294] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:00.217571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb02579-374a-4c30-9c53-9fb8738f3fde admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:00.246135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb02579-374a-4c30-9c53-9fb8738f3fde admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:00.257258 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-260acba3-18fa-4e12-94f6-cfb3684b3f8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:00.258142 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260acba3-18fa-4e12-94f6-cfb3684b3f8f admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:00.261387 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260acba3-18fa-4e12-94f6-cfb3684b3f8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:00.261387 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-260acba3-18fa-4e12-94f6-cfb3684b3f8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:00.262482 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260acba3-18fa-4e12-94f6-cfb3684b3f8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:00.266627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-260acba3-18fa-4e12-94f6-cfb3684b3f8f admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:00.279526 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1145/2295] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:00 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:00.283483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b2ef9-281b-4a2b-97c6-624674f22c23 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:00.299444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20b2ef9-281b-4a2b-97c6-624674f22c23 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:00.306858 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376b78b-7c57-462e-9332-79f42cb8199c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:00.307841 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b78b-7c57-462e-9332-79f42cb8199c admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:00.308144 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b78b-7c57-462e-9332-79f42cb8199c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:00.308502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8376b78b-7c57-462e-9332-79f42cb8199c admin admin] PATH_INFO: `/v3/projects/9b10d15caef145b79d057687cf936285/users/006ea7f9977c442aa8ed8979c89a592b/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:00.326063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376b78b-7c57-462e-9332-79f42cb8199c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b10d15caef145b79d057687cf936285, user_id=006ea7f9977c442aa8ed8979c89a592b, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:00.329368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8376b78b-7c57-462e-9332-79f42cb8199c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:00.468629 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1151/2296] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:00 2022] PUT /identity/v3/projects/9b10d15caef145b79d057687cf936285/users/006ea7f9977c442aa8ed8979c89a592b/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:00.471358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14650813-ee9e-4e2f-94cc-9443068b40a6 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:00.472671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14650813-ee9e-4e2f-94cc-9443068b40a6 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:00.473268 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14650813-ee9e-4e2f-94cc-9443068b40a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:00.506474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-14650813-ee9e-4e2f-94cc-9443068b40a6 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:00.508163 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-14650813-ee9e-4e2f-94cc-9443068b40a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:00.621701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1146/2297] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:00.624357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376b78b-7c57-462e-9332-79f42cb8199c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:00.627112 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8376b78b-7c57-462e-9332-79f42cb8199c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:00.639833 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14650813-ee9e-4e2f-94cc-9443068b40a6 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:00.643329 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8376b78b-7c57-462e-9332-79f42cb8199c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:00.644763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-14650813-ee9e-4e2f-94cc-9443068b40a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:00.656521 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b25522-e5ee-4e1c-aa3c-93b96a02ab9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:00.657773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b25522-e5ee-4e1c-aa3c-93b96a02ab9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:00.658269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b25522-e5ee-4e1c-aa3c-93b96a02ab9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:00.658780 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b25522-e5ee-4e1c-aa3c-93b96a02ab9f admin admin] PATH_INFO: `/v3/projects/e2d7ef189f4e4a91ac765700bbbe57e5` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:00.660429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b25522-e5ee-4e1c-aa3c-93b96a02ab9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2d7ef189f4e4a91ac765700bbbe57e5)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:00.663257 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b25522-e5ee-4e1c-aa3c-93b96a02ab9f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:00.742891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14650813-ee9e-4e2f-94cc-9443068b40a6 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:00.747882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a096022-6ece-494b-8bf5-e6f75607d4fc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:00.753247 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a096022-6ece-494b-8bf5-e6f75607d4fc service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:00.753247 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a096022-6ece-494b-8bf5-e6f75607d4fc service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:00.753247 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a096022-6ece-494b-8bf5-e6f75607d4fc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:00.760732 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a096022-6ece-494b-8bf5-e6f75607d4fc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:00.762264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a096022-6ece-494b-8bf5-e6f75607d4fc service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:00.772499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1147/2298] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:39:00.821506 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a096022-6ece-494b-8bf5-e6f75607d4fc service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:00.824205 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8a096022-6ece-494b-8bf5-e6f75607d4fc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:00.856644 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a096022-6ece-494b-8bf5-e6f75607d4fc service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:00.857073 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b7b25522-e5ee-4e1c-aa3c-93b96a02ab9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2d7ef189f4e4a91ac765700bbbe57e5', 'request_id': 'req-b7b25522-e5ee-4e1c-aa3c-93b96a02ab9f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:00.867354 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b7b25522-e5ee-4e1c-aa3c-93b96a02ab9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2d7ef189f4e4a91ac765700bbbe57e5', 'request_id': 'req-b7b25522-e5ee-4e1c-aa3c-93b96a02ab9f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:00.878012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b7b25522-e5ee-4e1c-aa3c-93b96a02ab9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2d7ef189f4e4a91ac765700bbbe57e5', 'request_id': 'req-b7b25522-e5ee-4e1c-aa3c-93b96a02ab9f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:00.934343 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e565b322-0524-4b95-842f-26998b538678 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:00.935287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565b322-0524-4b95-842f-26998b538678 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:00.935566 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565b322-0524-4b95-842f-26998b538678 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:00.935838 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e565b322-0524-4b95-842f-26998b538678 admin admin] PATH_INFO: `/v3/projects/017bae83ab3e4ee1b68a3cbd011df4dc` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:00.937596 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565b322-0524-4b95-842f-26998b538678 admin admin] RBAC: Authorizing `identity:delete_project(project_id=017bae83ab3e4ee1b68a3cbd011df4dc)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:00.939558 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e565b322-0524-4b95-842f-26998b538678 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:01.008021 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b7b25522-e5ee-4e1c-aa3c-93b96a02ab9f admin admin] The token cache is being invalidate because project e2d7ef189f4e4a91ac765700bbbe57e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:39:01.008314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b7b25522-e5ee-4e1c-aa3c-93b96a02ab9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:01.009200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b7b25522-e5ee-4e1c-aa3c-93b96a02ab9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:01.015568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1152/2299] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:39:00 2022] DELETE /identity/v3/projects/e2d7ef189f4e4a91ac765700bbbe57e5 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:01.017347 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb1dc6-8a6a-4715-a1cc-b88f88d9a9c4 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:01.017690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb1dc6-8a6a-4715-a1cc-b88f88d9a9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:01.017997 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb1dc6-8a6a-4715-a1cc-b88f88d9a9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:01.042372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9eeb1dc6-8a6a-4715-a1cc-b88f88d9a9c4 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:01.043679 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9eeb1dc6-8a6a-4715-a1cc-b88f88d9a9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:01.053598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1153/2300] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:01.061334 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5ace7-b8cf-4146-95d2-3b15606f3431 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:01.061682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5ace7-b8cf-4146-95d2-3b15606f3431 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:01.062016 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5ace7-b8cf-4146-95d2-3b15606f3431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:01.101893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-e565b322-0524-4b95-842f-26998b538678 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '017bae83ab3e4ee1b68a3cbd011df4dc', 'request_id': 'req-e565b322-0524-4b95-842f-26998b538678'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:01.113306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d8a5ace7-b8cf-4146-95d2-3b15606f3431 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:01.117942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d8a5ace7-b8cf-4146-95d2-3b15606f3431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:01.206368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1154/2301] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:39:01.210810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5ace7-b8cf-4146-95d2-3b15606f3431 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:01.226255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5ace7-b8cf-4146-95d2-3b15606f3431 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:01.232151 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cddf31-d47c-4b92-9206-0efa5c91b056 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:01.232827 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cddf31-d47c-4b92-9206-0efa5c91b056 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:01.233114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cddf31-d47c-4b92-9206-0efa5c91b056 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:01.233392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cddf31-d47c-4b92-9206-0efa5c91b056 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:01.234781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cddf31-d47c-4b92-9206-0efa5c91b056 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:39:01.235067 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cddf31-d47c-4b92-9206-0efa5c91b056 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:01.236690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9cddf31-d47c-4b92-9206-0efa5c91b056 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:01.249392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1155/2302] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:39:01.255942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cddf31-d47c-4b92-9206-0efa5c91b056 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:01.267823 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9cddf31-d47c-4b92-9206-0efa5c91b056 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:01.274027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b09ffe-3578-4c5c-b97c-bab48d668a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:01.274726 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b09ffe-3578-4c5c-b97c-bab48d668a19 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:01.275048 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b09ffe-3578-4c5c-b97c-bab48d668a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:01.275326 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b09ffe-3578-4c5c-b97c-bab48d668a19 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:01.277339 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b09ffe-3578-4c5c-b97c-bab48d668a19 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:01.278433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b09ffe-3578-4c5c-b97c-bab48d668a19 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:01.313255 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-e565b322-0524-4b95-842f-26998b538678 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '017bae83ab3e4ee1b68a3cbd011df4dc', 'request_id': 'req-e565b322-0524-4b95-842f-26998b538678'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:01.320207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-e565b322-0524-4b95-842f-26998b538678 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '017bae83ab3e4ee1b68a3cbd011df4dc', 'request_id': 'req-e565b322-0524-4b95-842f-26998b538678'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:01.332124 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-e565b322-0524-4b95-842f-26998b538678 admin admin] The token cache is being invalidate because project 017bae83ab3e4ee1b68a3cbd011df4dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:39:01.332531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-e565b322-0524-4b95-842f-26998b538678 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:01.333185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-e565b322-0524-4b95-842f-26998b538678 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:01.335419 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1148/2303] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:39:00 2022] DELETE /identity/v3/projects/017bae83ab3e4ee1b68a3cbd011df4dc => generated 0 bytes in 515 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:01.340751 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c61892-26de-483b-9069-ea94cbe314ab None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:01.340751 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c61892-26de-483b-9069-ea94cbe314ab None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:01.340938 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c61892-26de-483b-9069-ea94cbe314ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:01.360450 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-52c61892-26de-483b-9069-ea94cbe314ab None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:01.361715 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-52c61892-26de-483b-9069-ea94cbe314ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:01.370677 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1149/2304] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:39:01.380818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e00e7d-d0d2-4454-b81d-fe60a5f4370f None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:01.380818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e00e7d-d0d2-4454-b81d-fe60a5f4370f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:01.381205 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e00e7d-d0d2-4454-b81d-fe60a5f4370f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:01.400587 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a8e00e7d-d0d2-4454-b81d-fe60a5f4370f None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:01.401806 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a8e00e7d-d0d2-4454-b81d-fe60a5f4370f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:01.410769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1150/2305] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:39:01.415427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e00e7d-d0d2-4454-b81d-fe60a5f4370f None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:01.424931 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e00e7d-d0d2-4454-b81d-fe60a5f4370f None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:01.429967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca6c2c-be6a-4f08-bacb-f44bab8b8ad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:01.430630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6c2c-be6a-4f08-bacb-f44bab8b8ad1 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:01.430946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6c2c-be6a-4f08-bacb-f44bab8b8ad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:01.431228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ca6c2c-be6a-4f08-bacb-f44bab8b8ad1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:01.431952 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca6c2c-be6a-4f08-bacb-f44bab8b8ad1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:39:01.432261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca6c2c-be6a-4f08-bacb-f44bab8b8ad1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:01.433846 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ca6c2c-be6a-4f08-bacb-f44bab8b8ad1 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:01.447613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1151/2306] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:39:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:39:01.452205 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca6c2c-be6a-4f08-bacb-f44bab8b8ad1 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:01.463443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ca6c2c-be6a-4f08-bacb-f44bab8b8ad1 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:01.471186 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a4118-7fab-48d9-91da-0325410f9c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:01.471850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4118-7fab-48d9-91da-0325410f9c8f admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:01.472266 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4118-7fab-48d9-91da-0325410f9c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:01.472545 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697a4118-7fab-48d9-91da-0325410f9c8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:01.473235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a4118-7fab-48d9-91da-0325410f9c8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:01.475314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697a4118-7fab-48d9-91da-0325410f9c8f admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:01.475423 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1156/2307] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:39:01 2022] POST /identity/v3/projects => generated 381 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:39:01.479628 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b09ffe-3578-4c5c-b97c-bab48d668a19 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:01.482157 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-67b09ffe-3578-4c5c-b97c-bab48d668a19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:01.570569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b09ffe-3578-4c5c-b97c-bab48d668a19 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:01.575714 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c14d90-7218-4182-84cd-c021c2fe6845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:01.576495 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c14d90-7218-4182-84cd-c021c2fe6845 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:01.576755 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c14d90-7218-4182-84cd-c021c2fe6845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:01.577033 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c14d90-7218-4182-84cd-c021c2fe6845 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:01.578255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c14d90-7218-4182-84cd-c021c2fe6845 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:01.580233 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c14d90-7218-4182-84cd-c021c2fe6845 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:01.615523 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1152/2308] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:39:01 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:39:01.619783 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a4118-7fab-48d9-91da-0325410f9c8f admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:01.688212 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697a4118-7fab-48d9-91da-0325410f9c8f admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:01.696237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75138a6b-1473-4988-9c4d-1043f4ddd8ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:01.696969 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75138a6b-1473-4988-9c4d-1043f4ddd8ac admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:01.697261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75138a6b-1473-4988-9c4d-1043f4ddd8ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:01.697542 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75138a6b-1473-4988-9c4d-1043f4ddd8ac admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:01.698292 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75138a6b-1473-4988-9c4d-1043f4ddd8ac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:01.700505 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75138a6b-1473-4988-9c4d-1043f4ddd8ac admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:01.749359 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1157/2309] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:39:01 2022] POST /identity/v3/users => generated 291 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:39:01.753503 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c14d90-7218-4182-84cd-c021c2fe6845 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:01.764495 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c14d90-7218-4182-84cd-c021c2fe6845 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:01.770203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73092c8-a002-409b-bbe4-313e57055234 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:01.771033 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73092c8-a002-409b-bbe4-313e57055234 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:01.771320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73092c8-a002-409b-bbe4-313e57055234 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:01.771597 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73092c8-a002-409b-bbe4-313e57055234 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:01.772339 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73092c8-a002-409b-bbe4-313e57055234 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:01.773951 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b73092c8-a002-409b-bbe4-313e57055234 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:01.786034 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1158/2310] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:39:01.792439 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73092c8-a002-409b-bbe4-313e57055234 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:01.803292 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73092c8-a002-409b-bbe4-313e57055234 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:01.808356 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1384f-b354-4a75-aa2f-7e474ec3a843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:01.809153 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1384f-b354-4a75-aa2f-7e474ec3a843 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:01.809437 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1384f-b354-4a75-aa2f-7e474ec3a843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:01.809713 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b1384f-b354-4a75-aa2f-7e474ec3a843 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:01.810452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1384f-b354-4a75-aa2f-7e474ec3a843 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:01.812469 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b1384f-b354-4a75-aa2f-7e474ec3a843 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:01.825432 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1159/2311] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:39:01.830515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1384f-b354-4a75-aa2f-7e474ec3a843 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:01.841255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b1384f-b354-4a75-aa2f-7e474ec3a843 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:01.846991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69af4cd-0df5-4575-939d-04e76ec81c25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:01.848073 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69af4cd-0df5-4575-939d-04e76ec81c25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:01.848315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69af4cd-0df5-4575-939d-04e76ec81c25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:01.848587 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69af4cd-0df5-4575-939d-04e76ec81c25 admin admin] PATH_INFO: `/v3/projects/cadba93c4a7943ebb8caebbac8602d2e/users/093087a5e05749fc84a78a4b45c97e5f/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:01.866372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1153/2312] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:39:01 2022] POST /identity/v3/users => generated 288 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:01.870317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75138a6b-1473-4988-9c4d-1043f4ddd8ac admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:01.875916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69af4cd-0df5-4575-939d-04e76ec81c25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cadba93c4a7943ebb8caebbac8602d2e, user_id=093087a5e05749fc84a78a4b45c97e5f, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:01.879202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69af4cd-0df5-4575-939d-04e76ec81c25 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:01.883104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75138a6b-1473-4988-9c4d-1043f4ddd8ac admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:01.891879 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a304e7b-55cd-48fc-ae3a-2ee2a2323b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:01.893105 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304e7b-55cd-48fc-ae3a-2ee2a2323b10 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:01.893375 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304e7b-55cd-48fc-ae3a-2ee2a2323b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:01.893657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a304e7b-55cd-48fc-ae3a-2ee2a2323b10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:01.894459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a304e7b-55cd-48fc-ae3a-2ee2a2323b10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:01.896194 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a304e7b-55cd-48fc-ae3a-2ee2a2323b10 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:01.908523 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1154/2313] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:39:01.912681 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a304e7b-55cd-48fc-ae3a-2ee2a2323b10 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:01.923351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a304e7b-55cd-48fc-ae3a-2ee2a2323b10 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:01.928060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d84ae8-135b-4201-8515-9d499fd0a486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:01.928750 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84ae8-135b-4201-8515-9d499fd0a486 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:01.929009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84ae8-135b-4201-8515-9d499fd0a486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:01.929289 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d84ae8-135b-4201-8515-9d499fd0a486 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:01.930012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d84ae8-135b-4201-8515-9d499fd0a486 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:01.931698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d84ae8-135b-4201-8515-9d499fd0a486 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:01.942952 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1155/2314] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:01 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:39:01.947129 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d84ae8-135b-4201-8515-9d499fd0a486 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:01.958048 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d84ae8-135b-4201-8515-9d499fd0a486 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:01.963013 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64fc448c-c6d3-483c-af00-a334747625c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:01.963985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc448c-c6d3-483c-af00-a334747625c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:01.964306 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc448c-c6d3-483c-af00-a334747625c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:01.964585 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64fc448c-c6d3-483c-af00-a334747625c4 admin admin] PATH_INFO: `/v3/projects/8e0a96d6eaf54af2b001262346e354ba/users/69c4991448804c1cb5721c99b25e17db/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:01.980464 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc448c-c6d3-483c-af00-a334747625c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e0a96d6eaf54af2b001262346e354ba, user_id=69c4991448804c1cb5721c99b25e17db, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:01.983318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64fc448c-c6d3-483c-af00-a334747625c4 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:01.984709 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1160/2315] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:01 2022] PUT /identity/v3/projects/cadba93c4a7943ebb8caebbac8602d2e/users/093087a5e05749fc84a78a4b45c97e5f/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:39:01.995249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a3b6b-e3df-40df-87ad-13eeb47b7564 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:01.995538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a3b6b-e3df-40df-87ad-13eeb47b7564 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:01.995815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87a3b6b-e3df-40df-87ad-13eeb47b7564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:02.014909 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:02.026888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b87a3b6b-e3df-40df-87ad-13eeb47b7564 None None] MFA Rules not processed for user `093087a5e05749fc84a78a4b45c97e5f`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:02.028196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b87a3b6b-e3df-40df-87ad-13eeb47b7564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:02.080595 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1156/2316] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:01 2022] PUT /identity/v3/projects/8e0a96d6eaf54af2b001262346e354ba/users/69c4991448804c1cb5721c99b25e17db/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:39:02.088747 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4924-a589-4e6e-bc1f-138c27ef756d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:02.089106 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4924-a589-4e6e-bc1f-138c27ef756d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:02.089420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acde4924-a589-4e6e-bc1f-138c27ef756d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:02.110141 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1161/2317] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:01 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:39:02.117158 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a3b6b-e3df-40df-87ad-13eeb47b7564 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:02.121594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-acde4924-a589-4e6e-bc1f-138c27ef756d None None] MFA Rules not processed for user `69c4991448804c1cb5721c99b25e17db`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:02.122830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-acde4924-a589-4e6e-bc1f-138c27ef756d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:02.198292 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87a3b6b-e3df-40df-87ad-13eeb47b7564 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:02.213780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1157/2318] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:02 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:02.228592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde4924-a589-4e6e-bc1f-138c27ef756d None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:02.230548 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-acde4924-a589-4e6e-bc1f-138c27ef756d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:02.280884 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b87dc9-f839-4087-9b13-01892713e3a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:02.281649 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b87dc9-f839-4087-9b13-01892713e3a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:02.282174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b87dc9-f839-4087-9b13-01892713e3a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:02.282520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5b87dc9-f839-4087-9b13-01892713e3a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:02.283429 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b87dc9-f839-4087-9b13-01892713e3a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:02.285457 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5b87dc9-f839-4087-9b13-01892713e3a6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:02.292796 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acde4924-a589-4e6e-bc1f-138c27ef756d None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:02.296549 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8689cfa-8964-4812-8bff-6f3f5142722d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:02.297572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8689cfa-8964-4812-8bff-6f3f5142722d service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:02.301918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8689cfa-8964-4812-8bff-6f3f5142722d service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:02.301918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8689cfa-8964-4812-8bff-6f3f5142722d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:02.307073 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8689cfa-8964-4812-8bff-6f3f5142722d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:02.308529 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8689cfa-8964-4812-8bff-6f3f5142722d service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:02.311090 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:02.318485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1158/2319] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:39:02.402865 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1162/2320] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:39:02 2022] POST /identity/v3/projects => generated 381 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:39:02.405446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8689cfa-8964-4812-8bff-6f3f5142722d service cinder] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:02.418809 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8689cfa-8964-4812-8bff-6f3f5142722d service cinder] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:02.509322 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47828ce0-24cf-44a6-b2b7-3c0885dec428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:02.510053 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47828ce0-24cf-44a6-b2b7-3c0885dec428 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:02.510281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47828ce0-24cf-44a6-b2b7-3c0885dec428 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:02.511187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47828ce0-24cf-44a6-b2b7-3c0885dec428 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:02.512322 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47828ce0-24cf-44a6-b2b7-3c0885dec428 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:02.515234 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47828ce0-24cf-44a6-b2b7-3c0885dec428 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:02.675046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1159/2321] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:39:02 2022] POST /identity/v3/users => generated 297 bytes in 267 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:02.676792 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b87dc9-f839-4087-9b13-01892713e3a6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:02.689622 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5b87dc9-f839-4087-9b13-01892713e3a6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:02.694935 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510155d-2398-4094-ba7b-cc7f0d77f033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:02.695647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510155d-2398-4094-ba7b-cc7f0d77f033 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:02.695923 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510155d-2398-4094-ba7b-cc7f0d77f033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:02.696195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3510155d-2398-4094-ba7b-cc7f0d77f033 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:02.696936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510155d-2398-4094-ba7b-cc7f0d77f033 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:02.698603 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3510155d-2398-4094-ba7b-cc7f0d77f033 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:02.715202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1163/2322] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:02.725385 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47828ce0-24cf-44a6-b2b7-3c0885dec428 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:02.744067 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47828ce0-24cf-44a6-b2b7-3c0885dec428 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:02.750721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed42b1-c332-4df3-a974-d7bea10247c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:02.752401 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed42b1-c332-4df3-a974-d7bea10247c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:02.752866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed42b1-c332-4df3-a974-d7bea10247c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:02.753355 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ed42b1-c332-4df3-a974-d7bea10247c4 admin admin] PATH_INFO: `/v3/projects/c3f169e8c5024f1bb760ca23e4806bfd/users/0c1af8ebb934499ca059590f759eed48/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:02.773173 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed42b1-c332-4df3-a974-d7bea10247c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f169e8c5024f1bb760ca23e4806bfd, user_id=0c1af8ebb934499ca059590f759eed48, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:02.776627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ed42b1-c332-4df3-a974-d7bea10247c4 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:02.872540 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1160/2323] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:02 2022] PUT /identity/v3/projects/c3f169e8c5024f1bb760ca23e4806bfd/users/0c1af8ebb934499ca059590f759eed48/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:02.877248 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510155d-2398-4094-ba7b-cc7f0d77f033 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:02.891557 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3510155d-2398-4094-ba7b-cc7f0d77f033 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:02.957956 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac36c3f-d870-4873-8a80-4478a67c8b58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:02.958627 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36c3f-d870-4873-8a80-4478a67c8b58 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:02.958937 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36c3f-d870-4873-8a80-4478a67c8b58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:02.959210 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac36c3f-d870-4873-8a80-4478a67c8b58 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:02.960412 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac36c3f-d870-4873-8a80-4478a67c8b58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:02.961647 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac36c3f-d870-4873-8a80-4478a67c8b58 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:03.002248 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1164/2324] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:02 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:39:03.003604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed42b1-c332-4df3-a974-d7bea10247c4 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:03.023642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ed42b1-c332-4df3-a974-d7bea10247c4 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:03.036423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b95cd9-5321-4d45-80d5-c8f6ff88d75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:03.037357 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b95cd9-5321-4d45-80d5-c8f6ff88d75e admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:03.039149 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b95cd9-5321-4d45-80d5-c8f6ff88d75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:03.039454 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b95cd9-5321-4d45-80d5-c8f6ff88d75e admin admin] PATH_INFO: `/v3/projects/c3f169e8c5024f1bb760ca23e4806bfd/users/0c1af8ebb934499ca059590f759eed48/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:03.045316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b95cd9-5321-4d45-80d5-c8f6ff88d75e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3f169e8c5024f1bb760ca23e4806bfd, user_id=0c1af8ebb934499ca059590f759eed48, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:03.050794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b95cd9-5321-4d45-80d5-c8f6ff88d75e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:03.085706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1161/2325] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:03 2022] PUT /identity/v3/projects/c3f169e8c5024f1bb760ca23e4806bfd/users/0c1af8ebb934499ca059590f759eed48/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:03.105072 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735f753-20af-4346-b104-3d8e7e328558 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:03.105370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735f753-20af-4346-b104-3d8e7e328558 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:03.107706 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7735f753-20af-4346-b104-3d8e7e328558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:03.140973 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7735f753-20af-4346-b104-3d8e7e328558 None None] MFA Rules not processed for user `0c1af8ebb934499ca059590f759eed48`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:03.142325 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7735f753-20af-4346-b104-3d8e7e328558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:03.258478 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1165/2326] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:03 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:39:03.330960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b95cd9-5321-4d45-80d5-c8f6ff88d75e admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:03.422276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b95cd9-5321-4d45-80d5-c8f6ff88d75e admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:03.447077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac24726-37f7-485d-8cf1-dd5083d411c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:03.448617 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24726-37f7-485d-8cf1-dd5083d411c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:03.452080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24726-37f7-485d-8cf1-dd5083d411c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:03.452683 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac24726-37f7-485d-8cf1-dd5083d411c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:03.480158 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac24726-37f7-485d-8cf1-dd5083d411c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:03.486045 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac24726-37f7-485d-8cf1-dd5083d411c8 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:03.508534 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1162/2327] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:03 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:04.113627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:04.306026 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735f753-20af-4346-b104-3d8e7e328558 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:04.390996 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7735f753-20af-4346-b104-3d8e7e328558 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:04.395942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7329e-f059-4a65-b24f-909234936db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:04.396808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7329e-f059-4a65-b24f-909234936db2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:04.397085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7329e-f059-4a65-b24f-909234936db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:04.397357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7329e-f059-4a65-b24f-909234936db2 admin admin] PATH_INFO: `/v3/users/093087a5e05749fc84a78a4b45c97e5f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:04.398541 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7329e-f059-4a65-b24f-909234936db2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=093087a5e05749fc84a78a4b45c97e5f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:04.400601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a7329e-f059-4a65-b24f-909234936db2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:04.676372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:04.699264 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-09a7329e-f059-4a65-b24f-909234936db2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '093087a5e05749fc84a78a4b45c97e5f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:04.746623 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-09a7329e-f059-4a65-b24f-909234936db2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '093087a5e05749fc84a78a4b45c97e5f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:04.747521 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-09a7329e-f059-4a65-b24f-909234936db2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '093087a5e05749fc84a78a4b45c97e5f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:04.748367 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-09a7329e-f059-4a65-b24f-909234936db2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '093087a5e05749fc84a78a4b45c97e5f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:04.759612 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-09a7329e-f059-4a65-b24f-909234936db2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '093087a5e05749fc84a78a4b45c97e5f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:04.860347 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1166/2328] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:39:04 2022] DELETE /identity/v3/users/093087a5e05749fc84a78a4b45c97e5f => generated 0 bytes in 555 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:04.865044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa0b1b-2534-4d78-8aa1-a25a5ed8aa59 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:04.865545 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa0b1b-2534-4d78-8aa1-a25a5ed8aa59 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:04.866116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebaa0b1b-2534-4d78-8aa1-a25a5ed8aa59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:04.892924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-ebaa0b1b-2534-4d78-8aa1-a25a5ed8aa59 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:04.894661 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ebaa0b1b-2534-4d78-8aa1-a25a5ed8aa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:05.012890 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1163/2329] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:05.036020 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7329e-f059-4a65-b24f-909234936db2 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:05.037238 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-09a7329e-f059-4a65-b24f-909234936db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:05.139961 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a7329e-f059-4a65-b24f-909234936db2 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:05.154352 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b5e798-e726-45b4-b26b-0e31330f3f5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:05.155058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5e798-e726-45b4-b26b-0e31330f3f5b service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:05.155355 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5e798-e726-45b4-b26b-0e31330f3f5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:05.155638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b5e798-e726-45b4-b26b-0e31330f3f5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:05.178017 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5e798-e726-45b4-b26b-0e31330f3f5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:05.180865 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b5e798-e726-45b4-b26b-0e31330f3f5b service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:05.197218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1167/2330] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:06.031456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa0b1b-2534-4d78-8aa1-a25a5ed8aa59 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:06.035527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ebaa0b1b-2534-4d78-8aa1-a25a5ed8aa59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:06.077614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebaa0b1b-2534-4d78-8aa1-a25a5ed8aa59 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:06.080360 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18484b46-78d4-4c7d-9922-8ec79e975b4d None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:06.081489 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18484b46-78d4-4c7d-9922-8ec79e975b4d None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:06.081980 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18484b46-78d4-4c7d-9922-8ec79e975b4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:06.088761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476da08-6c9b-4fa8-836f-30915d3461c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:06.091936 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476da08-6c9b-4fa8-836f-30915d3461c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:06.092421 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476da08-6c9b-4fa8-836f-30915d3461c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:06.092913 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c476da08-6c9b-4fa8-836f-30915d3461c6 admin admin] PATH_INFO: `/v3/projects/cadba93c4a7943ebb8caebbac8602d2e` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:06.097912 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476da08-6c9b-4fa8-836f-30915d3461c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cadba93c4a7943ebb8caebbac8602d2e)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:06.106017 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c476da08-6c9b-4fa8-836f-30915d3461c6 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:06.132283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-18484b46-78d4-4c7d-9922-8ec79e975b4d None None] MFA Rules not processed for user `4e504742dcd245e5bee9a4d68a748b92`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:06.137991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-18484b46-78d4-4c7d-9922-8ec79e975b4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:06.283137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1168/2331] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:39:06.373901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c476da08-6c9b-4fa8-836f-30915d3461c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cadba93c4a7943ebb8caebbac8602d2e', 'request_id': 'req-c476da08-6c9b-4fa8-836f-30915d3461c6'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.496317 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c476da08-6c9b-4fa8-836f-30915d3461c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cadba93c4a7943ebb8caebbac8602d2e', 'request_id': 'req-c476da08-6c9b-4fa8-836f-30915d3461c6'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.508451 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c476da08-6c9b-4fa8-836f-30915d3461c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cadba93c4a7943ebb8caebbac8602d2e', 'request_id': 'req-c476da08-6c9b-4fa8-836f-30915d3461c6'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.539423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c476da08-6c9b-4fa8-836f-30915d3461c6 admin admin] The token cache is being invalidate because project cadba93c4a7943ebb8caebbac8602d2e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:39:06.539898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c476da08-6c9b-4fa8-836f-30915d3461c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.541454 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c476da08-6c9b-4fa8-836f-30915d3461c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.543788 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1164/2332] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:39:06 2022] DELETE /identity/v3/projects/cadba93c4a7943ebb8caebbac8602d2e => generated 0 bytes in 513 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:39:06.548146 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18484b46-78d4-4c7d-9922-8ec79e975b4d None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:06.566198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18484b46-78d4-4c7d-9922-8ec79e975b4d None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:06.637144 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969925e3-e29f-4c5a-b8b5-d8701b91a07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:06.638271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969925e3-e29f-4c5a-b8b5-d8701b91a07c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:06.638596 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969925e3-e29f-4c5a-b8b5-d8701b91a07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:06.639086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969925e3-e29f-4c5a-b8b5-d8701b91a07c admin admin] PATH_INFO: `/v3/users/0c1af8ebb934499ca059590f759eed48` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:06.641119 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969925e3-e29f-4c5a-b8b5-d8701b91a07c admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c1af8ebb934499ca059590f759eed48)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:06.643664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969925e3-e29f-4c5a-b8b5-d8701b91a07c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:06.854883 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-969925e3-e29f-4c5a-b8b5-d8701b91a07c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c1af8ebb934499ca059590f759eed48'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.874640 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-969925e3-e29f-4c5a-b8b5-d8701b91a07c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c1af8ebb934499ca059590f759eed48'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.877871 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-969925e3-e29f-4c5a-b8b5-d8701b91a07c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c1af8ebb934499ca059590f759eed48'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.878560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-969925e3-e29f-4c5a-b8b5-d8701b91a07c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c1af8ebb934499ca059590f759eed48'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:06.909288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-969925e3-e29f-4c5a-b8b5-d8701b91a07c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c1af8ebb934499ca059590f759eed48'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:07.028712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1169/2333] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:39:06 2022] DELETE /identity/v3/users/0c1af8ebb934499ca059590f759eed48 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:07.556992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:07.865211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476da08-6c9b-4fa8-836f-30915d3461c6 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:07.866700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c476da08-6c9b-4fa8-836f-30915d3461c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:07.899781 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c476da08-6c9b-4fa8-836f-30915d3461c6 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:07.952236 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969925e3-e29f-4c5a-b8b5-d8701b91a07c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:07.955312 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-969925e3-e29f-4c5a-b8b5-d8701b91a07c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:08.045885 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96460ea5-1c2a-4707-9aec-dafa29587b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:08.046904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96460ea5-1c2a-4707-9aec-dafa29587b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:08.047231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96460ea5-1c2a-4707-9aec-dafa29587b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:08.047563 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96460ea5-1c2a-4707-9aec-dafa29587b03 admin admin] PATH_INFO: `/v3/users/69c4991448804c1cb5721c99b25e17db` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:08.051265 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96460ea5-1c2a-4707-9aec-dafa29587b03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69c4991448804c1cb5721c99b25e17db)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:08.053954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96460ea5-1c2a-4707-9aec-dafa29587b03 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:08.103909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969925e3-e29f-4c5a-b8b5-d8701b91a07c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:08.116906 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b127837-bf82-4b6f-8611-469f42292a3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:08.119046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b127837-bf82-4b6f-8611-469f42292a3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:08.119821 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b127837-bf82-4b6f-8611-469f42292a3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:08.122449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b127837-bf82-4b6f-8611-469f42292a3f admin admin] PATH_INFO: `/v3/projects/c3f169e8c5024f1bb760ca23e4806bfd` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:08.125888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b127837-bf82-4b6f-8611-469f42292a3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3f169e8c5024f1bb760ca23e4806bfd)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:08.131264 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b127837-bf82-4b6f-8611-469f42292a3f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:08.496917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3b127837-bf82-4b6f-8611-469f42292a3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3f169e8c5024f1bb760ca23e4806bfd', 'request_id': 'req-3b127837-bf82-4b6f-8611-469f42292a3f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:08.514623 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3b127837-bf82-4b6f-8611-469f42292a3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3f169e8c5024f1bb760ca23e4806bfd', 'request_id': 'req-3b127837-bf82-4b6f-8611-469f42292a3f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:08.527453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-96460ea5-1c2a-4707-9aec-dafa29587b03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69c4991448804c1cb5721c99b25e17db'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:08.532151 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-96460ea5-1c2a-4707-9aec-dafa29587b03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69c4991448804c1cb5721c99b25e17db'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:08.556861 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3b127837-bf82-4b6f-8611-469f42292a3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3f169e8c5024f1bb760ca23e4806bfd', 'request_id': 'req-3b127837-bf82-4b6f-8611-469f42292a3f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:08.645530 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-96460ea5-1c2a-4707-9aec-dafa29587b03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69c4991448804c1cb5721c99b25e17db'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:08.646409 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-96460ea5-1c2a-4707-9aec-dafa29587b03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69c4991448804c1cb5721c99b25e17db'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:08.666449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-96460ea5-1c2a-4707-9aec-dafa29587b03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69c4991448804c1cb5721c99b25e17db'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:08.685851 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1165/2334] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:39:07 2022] DELETE /identity/v3/users/69c4991448804c1cb5721c99b25e17db => generated 0 bytes in 821 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:08.693962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18df22-3c28-4502-9504-a90cb6d5f883 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:08.694429 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18df22-3c28-4502-9504-a90cb6d5f883 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:08.694864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a18df22-3c28-4502-9504-a90cb6d5f883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:08.723415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-9a18df22-3c28-4502-9504-a90cb6d5f883 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:08.729924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9a18df22-3c28-4502-9504-a90cb6d5f883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:08.848334 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3b127837-bf82-4b6f-8611-469f42292a3f admin admin] The token cache is being invalidate because project c3f169e8c5024f1bb760ca23e4806bfd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:39:08.848981 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3b127837-bf82-4b6f-8611-469f42292a3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:08.853157 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3b127837-bf82-4b6f-8611-469f42292a3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:08.856549 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1170/2335] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:39:07 2022] DELETE /identity/v3/projects/c3f169e8c5024f1bb760ca23e4806bfd => generated 0 bytes in 905 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:08.862030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adf7b5-2088-41b4-970e-341a59684a2c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:08.863872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adf7b5-2088-41b4-970e-341a59684a2c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:08.864370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5adf7b5-2088-41b4-970e-341a59684a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:08.911954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f5adf7b5-2088-41b4-970e-341a59684a2c None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:08.913770 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f5adf7b5-2088-41b4-970e-341a59684a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:08.916925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1166/2336] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:39:08.928091 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18df22-3c28-4502-9504-a90cb6d5f883 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:08.929942 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9a18df22-3c28-4502-9504-a90cb6d5f883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:08.938118 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1171/2337] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:08.946274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a8a7b-2d74-464b-b5df-19aedd5e5a59 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:08.946561 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a8a7b-2d74-464b-b5df-19aedd5e5a59 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:08.946867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813a8a7b-2d74-464b-b5df-19aedd5e5a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:08.992045 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-813a8a7b-2d74-464b-b5df-19aedd5e5a59 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:08.995561 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-813a8a7b-2d74-464b-b5df-19aedd5e5a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:09.010369 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1172/2338] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:39:09.018052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a8a7b-2d74-464b-b5df-19aedd5e5a59 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:09.030227 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813a8a7b-2d74-464b-b5df-19aedd5e5a59 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:09.037451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d551a-e7cd-4a81-904c-a3ae3b8ca243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:09.038522 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d551a-e7cd-4a81-904c-a3ae3b8ca243 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:09.038990 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d551a-e7cd-4a81-904c-a3ae3b8ca243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:09.039577 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9d551a-e7cd-4a81-904c-a3ae3b8ca243 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:09.040622 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d551a-e7cd-4a81-904c-a3ae3b8ca243 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:39:09.041212 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d551a-e7cd-4a81-904c-a3ae3b8ca243 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:09.043137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9d551a-e7cd-4a81-904c-a3ae3b8ca243 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:09.044239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a18df22-3c28-4502-9504-a90cb6d5f883 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:09.053244 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c120c780-374a-439c-b437-f2a6902b72c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:09.056492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120c780-374a-439c-b437-f2a6902b72c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:09.056796 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120c780-374a-439c-b437-f2a6902b72c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:09.057081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c120c780-374a-439c-b437-f2a6902b72c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:09.077241 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1173/2339] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:39:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:39:09.099723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120c780-374a-439c-b437-f2a6902b72c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:09.101214 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c120c780-374a-439c-b437-f2a6902b72c8 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:09.105708 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d551a-e7cd-4a81-904c-a3ae3b8ca243 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:09.125259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1167/2340] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:39:09.128877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9d551a-e7cd-4a81-904c-a3ae3b8ca243 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:09.129044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c4ab1-db29-4efc-b24e-2e9f37ad0bfd None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:09.129044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c4ab1-db29-4efc-b24e-2e9f37ad0bfd None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:09.129044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93c4ab1-db29-4efc-b24e-2e9f37ad0bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:09.133374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52081a-e289-456a-bc04-aa36451654be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:09.134070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52081a-e289-456a-bc04-aa36451654be admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:09.134353 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52081a-e289-456a-bc04-aa36451654be admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:09.134649 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb52081a-e289-456a-bc04-aa36451654be admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:09.135346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52081a-e289-456a-bc04-aa36451654be admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:09.139004 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb52081a-e289-456a-bc04-aa36451654be admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:09.198634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d93c4ab1-db29-4efc-b24e-2e9f37ad0bfd None None] MFA Rules not processed for user `006ea7f9977c442aa8ed8979c89a592b`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:09.201250 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d93c4ab1-db29-4efc-b24e-2e9f37ad0bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:09.307246 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1174/2341] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:39:09 2022] POST /identity/v3/projects => generated 371 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:09.308147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52081a-e289-456a-bc04-aa36451654be admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:09.348499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1168/2342] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:09 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:39:09.358055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c4ab1-db29-4efc-b24e-2e9f37ad0bfd None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:09.360250 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d93c4ab1-db29-4efc-b24e-2e9f37ad0bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:09.391126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93c4ab1-db29-4efc-b24e-2e9f37ad0bfd None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:09.483304 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb52081a-e289-456a-bc04-aa36451654be admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:09.490368 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71533d3b-7332-4eeb-a0f8-8759e0e42c59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:09.493902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71533d3b-7332-4eeb-a0f8-8759e0e42c59 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:09.494424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71533d3b-7332-4eeb-a0f8-8759e0e42c59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:09.494885 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71533d3b-7332-4eeb-a0f8-8759e0e42c59 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:09.495899 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71533d3b-7332-4eeb-a0f8-8759e0e42c59 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:09.497448 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07af6f-e27c-4887-a546-187b810f11a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:09.498127 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07af6f-e27c-4887-a546-187b810f11a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:09.498525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07af6f-e27c-4887-a546-187b810f11a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:09.498954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f07af6f-e27c-4887-a546-187b810f11a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:09.501088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07af6f-e27c-4887-a546-187b810f11a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:09.502870 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71533d3b-7332-4eeb-a0f8-8759e0e42c59 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:09.503801 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f07af6f-e27c-4887-a546-187b810f11a6 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:09.632757 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1175/2343] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:39:09 2022] POST /identity/v3/users => generated 286 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:09.633968 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71533d3b-7332-4eeb-a0f8-8759e0e42c59 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:09.649026 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71533d3b-7332-4eeb-a0f8-8759e0e42c59 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:09.657675 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:09.666690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedd0f9-f146-44e4-ad5e-c34a44557a0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:09.666690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedd0f9-f146-44e4-ad5e-c34a44557a0f admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:09.666690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedd0f9-f146-44e4-ad5e-c34a44557a0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:09.666690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aedd0f9-f146-44e4-ad5e-c34a44557a0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:09.716953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aedd0f9-f146-44e4-ad5e-c34a44557a0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:09.718444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1169/2344] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:39:09 2022] POST /identity/v3/projects => generated 369 bytes in 311 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:09.718444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07af6f-e27c-4887-a546-187b810f11a6 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:09.719172 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aedd0f9-f146-44e4-ad5e-c34a44557a0f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:09.719172 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1176/2345] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:09.720263 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedd0f9-f146-44e4-ad5e-c34a44557a0f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:09.735079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aedd0f9-f146-44e4-ad5e-c34a44557a0f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:09.777616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f07af6f-e27c-4887-a546-187b810f11a6 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:09.783811 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904c97f-119a-4ee8-85ec-2c9d601b21d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:09.784358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904c97f-119a-4ee8-85ec-2c9d601b21d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:09.785379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904c97f-119a-4ee8-85ec-2c9d601b21d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:09.785379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904c97f-119a-4ee8-85ec-2c9d601b21d6 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:09.785590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904c97f-119a-4ee8-85ec-2c9d601b21d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:09.787583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3904c97f-119a-4ee8-85ec-2c9d601b21d6 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:09.804481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff097558-0ccb-44f9-a9bb-8a39e6f9713a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:09.805532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff097558-0ccb-44f9-a9bb-8a39e6f9713a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:09.805974 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff097558-0ccb-44f9-a9bb-8a39e6f9713a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:09.806702 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff097558-0ccb-44f9-a9bb-8a39e6f9713a admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:09.807253 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff097558-0ccb-44f9-a9bb-8a39e6f9713a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:09.808932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff097558-0ccb-44f9-a9bb-8a39e6f9713a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:09.823691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1177/2346] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:09.828941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff097558-0ccb-44f9-a9bb-8a39e6f9713a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:09.839354 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff097558-0ccb-44f9-a9bb-8a39e6f9713a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:09.844236 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaa4a1-7163-4285-a65c-3c0c7178dbf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:09.845110 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaa4a1-7163-4285-a65c-3c0c7178dbf4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:09.845389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaa4a1-7163-4285-a65c-3c0c7178dbf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:09.845744 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcaaa4a1-7163-4285-a65c-3c0c7178dbf4 admin admin] PATH_INFO: `/v3/projects/970c6dff999d47f386e6837c8c07c369/users/8ad861e51bb64547a19907b1c246524f/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:09.888070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaaa4a1-7163-4285-a65c-3c0c7178dbf4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=970c6dff999d47f386e6837c8c07c369, user_id=8ad861e51bb64547a19907b1c246524f, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:09.892578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcaaa4a1-7163-4285-a65c-3c0c7178dbf4 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:09.977203 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1170/2347] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:39:09 2022] POST /identity/v3/users => generated 291 bytes in 308 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:09.978039 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904c97f-119a-4ee8-85ec-2c9d601b21d6 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:09.979730 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3904c97f-119a-4ee8-85ec-2c9d601b21d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:09.991884 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904c97f-119a-4ee8-85ec-2c9d601b21d6 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:09.996475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3e9ba-ef82-4c38-991e-dc9193d0167a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:09.997314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3e9ba-ef82-4c38-991e-dc9193d0167a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.007726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3e9ba-ef82-4c38-991e-dc9193d0167a admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.007726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c3e9ba-ef82-4c38-991e-dc9193d0167a admin admin] PATH_INFO: `/v3/projects/8e0a96d6eaf54af2b001262346e354ba` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.007726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3e9ba-ef82-4c38-991e-dc9193d0167a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e0a96d6eaf54af2b001262346e354ba)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:10.008020 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1178/2348] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:09 2022] PUT /identity/v3/projects/970c6dff999d47f386e6837c8c07c369/users/8ad861e51bb64547a19907b1c246524f/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:39:10.008020 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaa4a1-7163-4285-a65c-3c0c7178dbf4 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:10.008502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c3e9ba-ef82-4c38-991e-dc9193d0167a admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:10.071508 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcaaa4a1-7163-4285-a65c-3c0c7178dbf4 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:10.076572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387b58fc-97c7-444a-8e64-365e55db8576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:10.077598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b58fc-97c7-444a-8e64-365e55db8576 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.077694 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b58fc-97c7-444a-8e64-365e55db8576 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.077924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387b58fc-97c7-444a-8e64-365e55db8576 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.078656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b58fc-97c7-444a-8e64-365e55db8576 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:10.080319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387b58fc-97c7-444a-8e64-365e55db8576 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:10.090581 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1179/2349] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:09 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:10.091932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4789f00-f8c8-4817-9e65-05140a33314c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.092237 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4789f00-f8c8-4817-9e65-05140a33314c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.092513 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4789f00-f8c8-4817-9e65-05140a33314c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.114430 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e4789f00-f8c8-4817-9e65-05140a33314c None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:10.115868 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e4789f00-f8c8-4817-9e65-05140a33314c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:10.129950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-75c3e9ba-ef82-4c38-991e-dc9193d0167a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e0a96d6eaf54af2b001262346e354ba', 'request_id': 'req-75c3e9ba-ef82-4c38-991e-dc9193d0167a'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:10.181741 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1180/2350] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:10.182652 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4789f00-f8c8-4817-9e65-05140a33314c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:10.194042 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4789f00-f8c8-4817-9e65-05140a33314c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:10.199240 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96b234-4162-422f-abe0-218e8d6b6426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:10.200188 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96b234-4162-422f-abe0-218e8d6b6426 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.200488 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96b234-4162-422f-abe0-218e8d6b6426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.200759 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea96b234-4162-422f-abe0-218e8d6b6426 admin admin] PATH_INFO: `/v3/projects/edeea1dc01d0441eae1fbfbf4a5feb92/users/8ba85170cb6e42ebb45cf12383aedc7e/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.218053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96b234-4162-422f-abe0-218e8d6b6426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edeea1dc01d0441eae1fbfbf4a5feb92, user_id=8ba85170cb6e42ebb45cf12383aedc7e, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:10.220803 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea96b234-4162-422f-abe0-218e8d6b6426 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:10.720475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-75c3e9ba-ef82-4c38-991e-dc9193d0167a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e0a96d6eaf54af2b001262346e354ba', 'request_id': 'req-75c3e9ba-ef82-4c38-991e-dc9193d0167a'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:10.726381 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1181/2351] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:10 2022] PUT /identity/v3/projects/edeea1dc01d0441eae1fbfbf4a5feb92/users/8ba85170cb6e42ebb45cf12383aedc7e/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 544 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:10.731646 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-75c3e9ba-ef82-4c38-991e-dc9193d0167a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e0a96d6eaf54af2b001262346e354ba', 'request_id': 'req-75c3e9ba-ef82-4c38-991e-dc9193d0167a'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:10.731840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96b234-4162-422f-abe0-218e8d6b6426 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:10.732313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ea96b234-4162-422f-abe0-218e8d6b6426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:10.748766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-75c3e9ba-ef82-4c38-991e-dc9193d0167a admin admin] The token cache is being invalidate because project 8e0a96d6eaf54af2b001262346e354ba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:39:10.749225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-75c3e9ba-ef82-4c38-991e-dc9193d0167a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:10.750363 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-75c3e9ba-ef82-4c38-991e-dc9193d0167a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:10.755930 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1171/2352] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:39:09 2022] DELETE /identity/v3/projects/8e0a96d6eaf54af2b001262346e354ba => generated 0 bytes in 774 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:10.755930 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3e9ba-ef82-4c38-991e-dc9193d0167a admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:10.755930 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-75c3e9ba-ef82-4c38-991e-dc9193d0167a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:10.770523 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c3e9ba-ef82-4c38-991e-dc9193d0167a admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:10.814720 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea96b234-4162-422f-abe0-218e8d6b6426 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:10.818652 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43481b0-90f7-4742-be38-700dc373c586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:10.819333 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43481b0-90f7-4742-be38-700dc373c586 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.819620 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43481b0-90f7-4742-be38-700dc373c586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.819959 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43481b0-90f7-4742-be38-700dc373c586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.823920 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d43481b0-90f7-4742-be38-700dc373c586 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:10.844731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd09c12-031e-4d90-8775-1db122a5bc25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:10.845423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd09c12-031e-4d90-8775-1db122a5bc25 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.845803 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd09c12-031e-4d90-8775-1db122a5bc25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.845989 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd09c12-031e-4d90-8775-1db122a5bc25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.846764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd09c12-031e-4d90-8775-1db122a5bc25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:10.848613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd09c12-031e-4d90-8775-1db122a5bc25 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:10.859849 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1172/2353] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:10 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:10.861235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d7c4e-5ca8-4748-9755-ce9223ce822b None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.861550 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d7c4e-5ca8-4748-9755-ce9223ce822b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.862146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d7c4e-5ca8-4748-9755-ce9223ce822b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.885522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-117d7c4e-5ca8-4748-9755-ce9223ce822b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:10.886920 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-117d7c4e-5ca8-4748-9755-ce9223ce822b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:10.897156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1173/2354] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:10.898232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d7c4e-5ca8-4748-9755-ce9223ce822b None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:10.909423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d7c4e-5ca8-4748-9755-ce9223ce822b None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:10.914982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a763a2c-399b-4fbc-bdb4-e91f83250dd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:10.919500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a763a2c-399b-4fbc-bdb4-e91f83250dd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.919500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a763a2c-399b-4fbc-bdb4-e91f83250dd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.919500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a763a2c-399b-4fbc-bdb4-e91f83250dd0 admin admin] PATH_INFO: `/v3/projects/edeea1dc01d0441eae1fbfbf4a5feb92/users/8ba85170cb6e42ebb45cf12383aedc7e/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.919500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a763a2c-399b-4fbc-bdb4-e91f83250dd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edeea1dc01d0441eae1fbfbf4a5feb92, user_id=8ba85170cb6e42ebb45cf12383aedc7e, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:10.921808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a763a2c-399b-4fbc-bdb4-e91f83250dd0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:10.937812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43481b0-90f7-4742-be38-700dc373c586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:10.938078 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1174/2355] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:10 2022] PUT /identity/v3/projects/edeea1dc01d0441eae1fbfbf4a5feb92/users/8ba85170cb6e42ebb45cf12383aedc7e/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:10.939377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a7c7c-f198-4230-a49b-ce89844e1701 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:10.939643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43481b0-90f7-4742-be38-700dc373c586 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:10.939766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a7c7c-f198-4230-a49b-ce89844e1701 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:10.939932 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68a7c7c-f198-4230-a49b-ce89844e1701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:10.958073 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1182/2356] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:10.961637 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f68a7c7c-f198-4230-a49b-ce89844e1701 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:10.962912 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f68a7c7c-f198-4230-a49b-ce89844e1701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:11.005278 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:11.058628 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1175/2357] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:11.063361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43481b0-90f7-4742-be38-700dc373c586 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:11.076250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43481b0-90f7-4742-be38-700dc373c586 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:11.093036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5215e5-1d3a-4b2d-bb5c-c61e4de63dd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:11.094713 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5215e5-1d3a-4b2d-bb5c-c61e4de63dd9 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:11.095062 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5215e5-1d3a-4b2d-bb5c-c61e4de63dd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:11.095339 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5215e5-1d3a-4b2d-bb5c-c61e4de63dd9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:11.096087 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5215e5-1d3a-4b2d-bb5c-c61e4de63dd9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:39:11.096406 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5215e5-1d3a-4b2d-bb5c-c61e4de63dd9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:11.104662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5215e5-1d3a-4b2d-bb5c-c61e4de63dd9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:11.130792 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1183/2358] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:39:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:39:11.135274 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a7c7c-f198-4230-a49b-ce89844e1701 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:11.148986 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68a7c7c-f198-4230-a49b-ce89844e1701 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:11.157360 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f63e9-e2bf-4139-afbf-9cfb73150839 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:11.158048 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f63e9-e2bf-4139-afbf-9cfb73150839 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:11.158336 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f63e9-e2bf-4139-afbf-9cfb73150839 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:11.158619 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa4f63e9-e2bf-4139-afbf-9cfb73150839 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:11.159942 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f63e9-e2bf-4139-afbf-9cfb73150839 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:11.162782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa4f63e9-e2bf-4139-afbf-9cfb73150839 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:11.341361 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1176/2359] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:39:11 2022] POST /identity/v3/projects => generated 373 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:11.342553 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5215e5-1d3a-4b2d-bb5c-c61e4de63dd9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:11.352723 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5215e5-1d3a-4b2d-bb5c-c61e4de63dd9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:11.455492 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c17aeb-3cb7-4b77-b33b-4f15079be6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:11.456759 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c17aeb-3cb7-4b77-b33b-4f15079be6aa admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:11.457111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c17aeb-3cb7-4b77-b33b-4f15079be6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:11.457770 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c17aeb-3cb7-4b77-b33b-4f15079be6aa admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:11.460200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c17aeb-3cb7-4b77-b33b-4f15079be6aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:11.468678 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c17aeb-3cb7-4b77-b33b-4f15079be6aa admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:11.598638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1184/2360] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:39:11 2022] POST /identity/v3/users => generated 287 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:11.602945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f63e9-e2bf-4139-afbf-9cfb73150839 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:11.615302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa4f63e9-e2bf-4139-afbf-9cfb73150839 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:11.623706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7bc5b-a3b8-4cee-a47b-b4ffd29a49ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:11.624161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7bc5b-a3b8-4cee-a47b-b4ffd29a49ad admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:11.624556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7bc5b-a3b8-4cee-a47b-b4ffd29a49ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:11.624976 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7bc5b-a3b8-4cee-a47b-b4ffd29a49ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:11.625933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7bc5b-a3b8-4cee-a47b-b4ffd29a49ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:11.628250 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a7bc5b-a3b8-4cee-a47b-b4ffd29a49ad admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:11.648498 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1177/2361] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:11.652775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c17aeb-3cb7-4b77-b33b-4f15079be6aa admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:11.664888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c17aeb-3cb7-4b77-b33b-4f15079be6aa admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:11.670815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5190e7-301e-43e0-88c4-e9ea3e2fc8a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:11.671626 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5190e7-301e-43e0-88c4-e9ea3e2fc8a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:11.672013 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5190e7-301e-43e0-88c4-e9ea3e2fc8a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:11.672356 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5190e7-301e-43e0-88c4-e9ea3e2fc8a5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:11.673733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5190e7-301e-43e0-88c4-e9ea3e2fc8a5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:11.676216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5190e7-301e-43e0-88c4-e9ea3e2fc8a5 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:11.694668 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1185/2362] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:11 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:11.699182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7bc5b-a3b8-4cee-a47b-b4ffd29a49ad admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:11.711787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a7bc5b-a3b8-4cee-a47b-b4ffd29a49ad admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:11.717380 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69519474-ef96-42b5-970f-f9194454d945 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:11.719200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519474-ef96-42b5-970f-f9194454d945 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:11.719697 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519474-ef96-42b5-970f-f9194454d945 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:11.720568 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69519474-ef96-42b5-970f-f9194454d945 admin admin] PATH_INFO: `/v3/projects/0be1cd7e371f43afbb7ac5557aa34b9b/users/7141523781b3439f98b6860d8e276dc0/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:11.748942 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69519474-ef96-42b5-970f-f9194454d945 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0be1cd7e371f43afbb7ac5557aa34b9b, user_id=7141523781b3439f98b6860d8e276dc0, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:11.752268 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69519474-ef96-42b5-970f-f9194454d945 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:11.852694 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1178/2363] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:11 2022] PUT /identity/v3/projects/0be1cd7e371f43afbb7ac5557aa34b9b/users/7141523781b3439f98b6860d8e276dc0/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:11.960789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3194bd-1fd7-4118-99b6-a4d133ab82fa None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:11.961493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3194bd-1fd7-4118-99b6-a4d133ab82fa None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:11.961493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d3194bd-1fd7-4118-99b6-a4d133ab82fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:12.018601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4d3194bd-1fd7-4118-99b6-a4d133ab82fa None None] MFA Rules not processed for user `7141523781b3439f98b6860d8e276dc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:12.019925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4d3194bd-1fd7-4118-99b6-a4d133ab82fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:12.257658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1186/2364] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:12.262162 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69519474-ef96-42b5-970f-f9194454d945 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:12.398813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69519474-ef96-42b5-970f-f9194454d945 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:12.405668 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52c4d7-c4d6-4b37-87c1-c8c53ebe4332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:12.406362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52c4d7-c4d6-4b37-87c1-c8c53ebe4332 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:12.406643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52c4d7-c4d6-4b37-87c1-c8c53ebe4332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:12.407140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a52c4d7-c4d6-4b37-87c1-c8c53ebe4332 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:12.408005 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52c4d7-c4d6-4b37-87c1-c8c53ebe4332 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:12.410959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a52c4d7-c4d6-4b37-87c1-c8c53ebe4332 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:12.570830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1179/2365] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:39:12 2022] POST /identity/v3/projects => generated 375 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:12.571767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3194bd-1fd7-4118-99b6-a4d133ab82fa None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:12.589940 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d3194bd-1fd7-4118-99b6-a4d133ab82fa None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:12.712581 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:12.734285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a981382-54fb-49dc-b957-601f1a38ecac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:12.735309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a981382-54fb-49dc-b957-601f1a38ecac admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:12.740057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a981382-54fb-49dc-b957-601f1a38ecac admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:12.740057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a981382-54fb-49dc-b957-601f1a38ecac admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:12.740057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a981382-54fb-49dc-b957-601f1a38ecac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:12.740057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a981382-54fb-49dc-b957-601f1a38ecac admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:12.825570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1187/2366] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:39:12 2022] POST /identity/v3/users => generated 288 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:39:12.830655 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52c4d7-c4d6-4b37-87c1-c8c53ebe4332 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:12.852965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a52c4d7-c4d6-4b37-87c1-c8c53ebe4332 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:12.859008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757ce66-73ed-4158-aba5-832b6c827f32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:12.859892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ce66-73ed-4158-aba5-832b6c827f32 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:12.860234 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ce66-73ed-4158-aba5-832b6c827f32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:12.860656 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2757ce66-73ed-4158-aba5-832b6c827f32 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:12.863644 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757ce66-73ed-4158-aba5-832b6c827f32 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:12.863903 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2757ce66-73ed-4158-aba5-832b6c827f32 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:12.877686 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1180/2367] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:12.882452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a981382-54fb-49dc-b957-601f1a38ecac admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:12.897973 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a981382-54fb-49dc-b957-601f1a38ecac admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:12.903843 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512941f-9e6d-4ec5-af15-e408eb34ec9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:12.904678 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512941f-9e6d-4ec5-af15-e408eb34ec9a admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:12.905033 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512941f-9e6d-4ec5-af15-e408eb34ec9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:12.905963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512941f-9e6d-4ec5-af15-e408eb34ec9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:12.906774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512941f-9e6d-4ec5-af15-e408eb34ec9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:12.912040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512941f-9e6d-4ec5-af15-e408eb34ec9a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:12.920642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1188/2368] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:12 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:12.929109 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757ce66-73ed-4158-aba5-832b6c827f32 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:12.956676 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2757ce66-73ed-4158-aba5-832b6c827f32 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:12.962524 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91736e8f-d4ec-4285-8274-2369175ad80b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:12.963938 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91736e8f-d4ec-4285-8274-2369175ad80b admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:12.964395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91736e8f-d4ec-4285-8274-2369175ad80b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:12.964771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91736e8f-d4ec-4285-8274-2369175ad80b admin admin] PATH_INFO: `/v3/projects/5109fcb8fcbc4d8eb3c2c65aa402e888/users/570ab5b53f5249fba7638b6df4cf351f/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:12.993472 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91736e8f-d4ec-4285-8274-2369175ad80b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5109fcb8fcbc4d8eb3c2c65aa402e888, user_id=570ab5b53f5249fba7638b6df4cf351f, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:12.997507 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91736e8f-d4ec-4285-8274-2369175ad80b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:13.102281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1181/2369] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:12 2022] PUT /identity/v3/projects/5109fcb8fcbc4d8eb3c2c65aa402e888/users/570ab5b53f5249fba7638b6df4cf351f/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:13.113601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647d801-a2dd-42f3-90fd-9e97d7f3ef06 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:13.120772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647d801-a2dd-42f3-90fd-9e97d7f3ef06 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:13.120772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4647d801-a2dd-42f3-90fd-9e97d7f3ef06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:13.151265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4647d801-a2dd-42f3-90fd-9e97d7f3ef06 None None] MFA Rules not processed for user `570ab5b53f5249fba7638b6df4cf351f`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:13.152788 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4647d801-a2dd-42f3-90fd-9e97d7f3ef06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:13.260026 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1189/2370] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:13 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:13.267282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91736e8f-d4ec-4285-8274-2369175ad80b admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:13.372691 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91736e8f-d4ec-4285-8274-2369175ad80b admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:13.380609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0eafb8a-e679-482d-94d8-500accb33025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:13.381925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eafb8a-e679-482d-94d8-500accb33025 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:13.382423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eafb8a-e679-482d-94d8-500accb33025 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:13.382916 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0eafb8a-e679-482d-94d8-500accb33025 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:13.384136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eafb8a-e679-482d-94d8-500accb33025 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:13.387658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0eafb8a-e679-482d-94d8-500accb33025 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:13.517480 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1182/2371] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:39:13 2022] POST /identity/v3/projects => generated 375 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:13.521466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647d801-a2dd-42f3-90fd-9e97d7f3ef06 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:13.557226 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4647d801-a2dd-42f3-90fd-9e97d7f3ef06 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:13.674171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ae61b-78d1-47dd-a30b-e92484b454a4 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:13.674463 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ae61b-78d1-47dd-a30b-e92484b454a4 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:13.674978 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32ae61b-78d1-47dd-a30b-e92484b454a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:13.742346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2eee91-529c-41d7-8dc7-bfd8781875bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:13.744295 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eee91-529c-41d7-8dc7-bfd8781875bb admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:13.744982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eee91-529c-41d7-8dc7-bfd8781875bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:13.746191 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2eee91-529c-41d7-8dc7-bfd8781875bb admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:13.748690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2eee91-529c-41d7-8dc7-bfd8781875bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:13.750086 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a32ae61b-78d1-47dd-a30b-e92484b454a4 None None] MFA Rules not processed for user `8ad861e51bb64547a19907b1c246524f`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:13.751804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a32ae61b-78d1-47dd-a30b-e92484b454a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:13.755845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2eee91-529c-41d7-8dc7-bfd8781875bb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:13.887974 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1190/2372] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:39:13 2022] POST /identity/v3/users => generated 294 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:13.892504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2eee91-529c-41d7-8dc7-bfd8781875bb admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:13.913934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2eee91-529c-41d7-8dc7-bfd8781875bb admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:13.924611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58123282-26a9-42b9-aeac-3e877be294d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:13.928008 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58123282-26a9-42b9-aeac-3e877be294d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:13.928008 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58123282-26a9-42b9-aeac-3e877be294d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:13.928327 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58123282-26a9-42b9-aeac-3e877be294d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:13.929685 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58123282-26a9-42b9-aeac-3e877be294d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:13.934070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58123282-26a9-42b9-aeac-3e877be294d1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:13.960320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1183/2373] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:13 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:39:13.963087 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ae61b-78d1-47dd-a30b-e92484b454a4 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:13.965398 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a32ae61b-78d1-47dd-a30b-e92484b454a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:13.970852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1191/2374] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:13 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:13.973007 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58123282-26a9-42b9-aeac-3e877be294d1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:13.993886 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58123282-26a9-42b9-aeac-3e877be294d1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:13.996284 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32ae61b-78d1-47dd-a30b-e92484b454a4 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:14.006481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f5c23-c781-4e50-9844-d3d0699f1e9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:14.007028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18986d73-bb68-4835-bd13-c5e07f9376af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:14.007169 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f5c23-c781-4e50-9844-d3d0699f1e9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:14.009033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18986d73-bb68-4835-bd13-c5e07f9376af admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:14.009482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f5c23-c781-4e50-9844-d3d0699f1e9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:14.009814 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f5c23-c781-4e50-9844-d3d0699f1e9c admin admin] PATH_INFO: `/v3/projects/0bdad1b212884b6e92fd446e019b9dde/users/23f698028aa0444491416ef43a14a5b2/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:14.010089 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18986d73-bb68-4835-bd13-c5e07f9376af admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:14.010623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18986d73-bb68-4835-bd13-c5e07f9376af admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:14.012008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18986d73-bb68-4835-bd13-c5e07f9376af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:14.017222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18986d73-bb68-4835-bd13-c5e07f9376af admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:14.033501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f5c23-c781-4e50-9844-d3d0699f1e9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bdad1b212884b6e92fd446e019b9dde, user_id=23f698028aa0444491416ef43a14a5b2, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:14.044211 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f5c23-c781-4e50-9844-d3d0699f1e9c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:14.125380 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1184/2375] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:39:13 2022] POST /identity/v3/projects => generated 373 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:39:14.132012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18986d73-bb68-4835-bd13-c5e07f9376af admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:14.159514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1192/2376] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:13 2022] PUT /identity/v3/projects/0bdad1b212884b6e92fd446e019b9dde/users/23f698028aa0444491416ef43a14a5b2/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:14.161098 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f5c23-c781-4e50-9844-d3d0699f1e9c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:14.269997 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f5c23-c781-4e50-9844-d3d0699f1e9c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:14.283822 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804c4e5-1038-4415-8507-b45543c68490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:14.284942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c4e5-1038-4415-8507-b45543c68490 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:14.284942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c4e5-1038-4415-8507-b45543c68490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:14.285147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804c4e5-1038-4415-8507-b45543c68490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:14.285913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804c4e5-1038-4415-8507-b45543c68490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:14.287783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804c4e5-1038-4415-8507-b45543c68490 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:14.299327 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18986d73-bb68-4835-bd13-c5e07f9376af admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:14.306360 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5a652-153b-4522-a660-90ba6aa85876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:14.309254 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5a652-153b-4522-a660-90ba6aa85876 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:14.309820 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5a652-153b-4522-a660-90ba6aa85876 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:14.310309 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc5a652-153b-4522-a660-90ba6aa85876 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:14.319039 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1193/2377] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:14.320087 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804c4e5-1038-4415-8507-b45543c68490 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:14.323749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5a652-153b-4522-a660-90ba6aa85876 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:14.326380 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc5a652-153b-4522-a660-90ba6aa85876 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:14.338976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804c4e5-1038-4415-8507-b45543c68490 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:14.350336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40c2963-07af-4e44-a359-ba6583132ca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:14.351481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c2963-07af-4e44-a359-ba6583132ca2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:14.353295 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c2963-07af-4e44-a359-ba6583132ca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:14.353295 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40c2963-07af-4e44-a359-ba6583132ca2 admin admin] PATH_INFO: `/v3/projects/0bdad1b212884b6e92fd446e019b9dde/users/23f698028aa0444491416ef43a14a5b2/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:14.355746 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c2963-07af-4e44-a359-ba6583132ca2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0bdad1b212884b6e92fd446e019b9dde, user_id=23f698028aa0444491416ef43a14a5b2, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:14.358549 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40c2963-07af-4e44-a359-ba6583132ca2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:14.372570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1194/2378] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:14 2022] PUT /identity/v3/projects/0bdad1b212884b6e92fd446e019b9dde/users/23f698028aa0444491416ef43a14a5b2/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:14.380848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:14.386518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231011c9-b89d-4dba-9f0b-50becc56cf59 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:14.387672 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231011c9-b89d-4dba-9f0b-50becc56cf59 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:14.387672 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231011c9-b89d-4dba-9f0b-50becc56cf59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:14.417718 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1185/2379] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:39:14 2022] POST /identity/v3/users => generated 293 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:14.422545 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5a652-153b-4522-a660-90ba6aa85876 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:14.437199 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-231011c9-b89d-4dba-9f0b-50becc56cf59 None None] MFA Rules not processed for user `23f698028aa0444491416ef43a14a5b2`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:14.437811 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc5a652-153b-4522-a660-90ba6aa85876 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:14.438448 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-231011c9-b89d-4dba-9f0b-50becc56cf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:14.507699 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04db5d-8be3-487b-b8cb-d2f2433f105c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:14.508395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04db5d-8be3-487b-b8cb-d2f2433f105c admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:14.508710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04db5d-8be3-487b-b8cb-d2f2433f105c admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:14.509098 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb04db5d-8be3-487b-b8cb-d2f2433f105c admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:14.510992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04db5d-8be3-487b-b8cb-d2f2433f105c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:14.512806 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb04db5d-8be3-487b-b8cb-d2f2433f105c admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:14.529491 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1186/2380] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:14.531686 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04db5d-8be3-487b-b8cb-d2f2433f105c admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:14.550539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb04db5d-8be3-487b-b8cb-d2f2433f105c admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:14.564120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91e11c-4d48-4e12-b36e-a3d604475ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:14.565248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e11c-4d48-4e12-b36e-a3d604475ff5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:14.565537 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e11c-4d48-4e12-b36e-a3d604475ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:14.565813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f91e11c-4d48-4e12-b36e-a3d604475ff5 admin admin] PATH_INFO: `/v3/projects/42aa0d37003e49f99a2dc25a18801e65/users/a05f7b5ae54a4607b0e9e5eb706de745/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:14.583620 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1195/2381] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:14 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:14.592810 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91e11c-4d48-4e12-b36e-a3d604475ff5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42aa0d37003e49f99a2dc25a18801e65, user_id=a05f7b5ae54a4607b0e9e5eb706de745, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:14.593113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231011c9-b89d-4dba-9f0b-50becc56cf59 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:14.594517 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-231011c9-b89d-4dba-9f0b-50becc56cf59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:14.596627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f91e11c-4d48-4e12-b36e-a3d604475ff5 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:14.683104 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231011c9-b89d-4dba-9f0b-50becc56cf59 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:14.698741 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc04820-f808-46e6-afe9-c4360c63d3f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:14.699619 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc04820-f808-46e6-afe9-c4360c63d3f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:14.700167 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc04820-f808-46e6-afe9-c4360c63d3f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:14.700529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc04820-f808-46e6-afe9-c4360c63d3f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:14.746018 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:14.751357 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1187/2382] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:14 2022] PUT /identity/v3/projects/42aa0d37003e49f99a2dc25a18801e65/users/a05f7b5ae54a4607b0e9e5eb706de745/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 221 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:14.755570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91e11c-4d48-4e12-b36e-a3d604475ff5 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:14.802579 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc04820-f808-46e6-afe9-c4360c63d3f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:14.804573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc04820-f808-46e6-afe9-c4360c63d3f1 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:14.838772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1196/2383] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:14 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 246 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:14.930882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f91e11c-4d48-4e12-b36e-a3d604475ff5 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:14.937638 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec06e69-5212-47af-bc31-abaeb739848e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:14.938545 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec06e69-5212-47af-bc31-abaeb739848e admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:14.938889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec06e69-5212-47af-bc31-abaeb739848e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:14.939173 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec06e69-5212-47af-bc31-abaeb739848e admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:14.940000 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec06e69-5212-47af-bc31-abaeb739848e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:14.942424 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec06e69-5212-47af-bc31-abaeb739848e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:14.960588 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1188/2384] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:14 2022] GET /identity/v3/roles => generated 1420 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:14.961904 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc04820-f808-46e6-afe9-c4360c63d3f1 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:14.988393 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc04820-f808-46e6-afe9-c4360c63d3f1 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:15.000286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50ea1418-303d-4da8-a66e-974e3c272357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:15.001646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea1418-303d-4da8-a66e-974e3c272357 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:15.002280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea1418-303d-4da8-a66e-974e3c272357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:15.002991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50ea1418-303d-4da8-a66e-974e3c272357 admin admin] PATH_INFO: `/v3/projects/42aa0d37003e49f99a2dc25a18801e65/users/a05f7b5ae54a4607b0e9e5eb706de745/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:15.006348 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea1418-303d-4da8-a66e-974e3c272357 admin admin] RBAC: Authorizing `identity:create_grant(project_id=42aa0d37003e49f99a2dc25a18801e65, user_id=a05f7b5ae54a4607b0e9e5eb706de745, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:15.011197 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50ea1418-303d-4da8-a66e-974e3c272357 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:15.038415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1197/2385] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:14 2022] PUT /identity/v3/projects/42aa0d37003e49f99a2dc25a18801e65/users/a05f7b5ae54a4607b0e9e5eb706de745/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:39:15.397290 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:16.845819 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:17.566866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec06e69-5212-47af-bc31-abaeb739848e admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:17.568916 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-bec06e69-5212-47af-bc31-abaeb739848e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:17.674626 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec06e69-5212-47af-bc31-abaeb739848e admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:17.754811 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244c9ecd-da7f-458d-a9a7-0495a4bcac7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:17.756385 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c9ecd-da7f-458d-a9a7-0495a4bcac7a service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:17.756773 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c9ecd-da7f-458d-a9a7-0495a4bcac7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:17.757151 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244c9ecd-da7f-458d-a9a7-0495a4bcac7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:17.871449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c9ecd-da7f-458d-a9a7-0495a4bcac7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:17.873094 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-244c9ecd-da7f-458d-a9a7-0495a4bcac7a service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:17.896720 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1189/2386] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:17 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:18.408737 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4373e9-438e-4238-adc8-610c17e0d474 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:18.409308 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4373e9-438e-4238-adc8-610c17e0d474 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:18.409308 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4373e9-438e-4238-adc8-610c17e0d474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:18.444499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-df4373e9-438e-4238-adc8-610c17e0d474 None None] MFA Rules not processed for user `a05f7b5ae54a4607b0e9e5eb706de745`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:18.446896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-df4373e9-438e-4238-adc8-610c17e0d474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:18.475562 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:18.548459 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1198/2387] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:39:18.559373 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d97b4b-394d-402b-a96c-70b33bdf5f81 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:18.559701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d97b4b-394d-402b-a96c-70b33bdf5f81 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:18.560017 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d97b4b-394d-402b-a96c-70b33bdf5f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:18.582095 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d4d97b4b-394d-402b-a96c-70b33bdf5f81 None None] MFA Rules not processed for user `8ad861e51bb64547a19907b1c246524f`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:18.583564 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d4d97b4b-394d-402b-a96c-70b33bdf5f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:18.645293 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=7,keystone:SELECT=91,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:18.667559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1190/2388] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:18 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:18.680488 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4373e9-438e-4238-adc8-610c17e0d474 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:18.682002 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-df4373e9-438e-4238-adc8-610c17e0d474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:18.757421 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4373e9-438e-4238-adc8-610c17e0d474 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:18.763192 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de87303-a186-4c38-8c7a-58416e7b89d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:18.763842 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de87303-a186-4c38-8c7a-58416e7b89d7 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:18.764128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de87303-a186-4c38-8c7a-58416e7b89d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:18.764406 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de87303-a186-4c38-8c7a-58416e7b89d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:18.773520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de87303-a186-4c38-8c7a-58416e7b89d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:18.775206 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de87303-a186-4c38-8c7a-58416e7b89d7 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:18.787360 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1199/2389] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:18 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:19.877493 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d97b4b-394d-402b-a96c-70b33bdf5f81 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:19.911329 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d97b4b-394d-402b-a96c-70b33bdf5f81 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:19.924120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7faf9-fa60-4c7c-ab55-c20102fcabf9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:19.924892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7faf9-fa60-4c7c-ab55-c20102fcabf9 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:19.925088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7faf9-fa60-4c7c-ab55-c20102fcabf9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:19.925400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c7faf9-fa60-4c7c-ab55-c20102fcabf9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:20.031538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7faf9-fa60-4c7c-ab55-c20102fcabf9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:20.033001 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2c7faf9-fa60-4c7c-ab55-c20102fcabf9 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:20.044592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1191/2390] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:19 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:20.636534 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e675535-965e-4ab6-869c-7b1aaccb6086 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:20.637000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e675535-965e-4ab6-869c-7b1aaccb6086 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:20.637109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e675535-965e-4ab6-869c-7b1aaccb6086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:20.669922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6e675535-965e-4ab6-869c-7b1aaccb6086 None None] MFA Rules not processed for user `8ba85170cb6e42ebb45cf12383aedc7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:20.671617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6e675535-965e-4ab6-869c-7b1aaccb6086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:20.751518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1200/2391] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:20 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:20.768240 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7faf9-fa60-4c7c-ab55-c20102fcabf9 service cinder] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:20.781971 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c7faf9-fa60-4c7c-ab55-c20102fcabf9 service cinder] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:20.788258 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ed555-1541-405c-b1a1-846e8d8b1487 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:20.788923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ed555-1541-405c-b1a1-846e8d8b1487 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:20.793538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ed555-1541-405c-b1a1-846e8d8b1487 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:20.793538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f81ed555-1541-405c-b1a1-846e8d8b1487 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:20.793538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f81ed555-1541-405c-b1a1-846e8d8b1487 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:20.861545 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ed555-1541-405c-b1a1-846e8d8b1487 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:20.863246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f81ed555-1541-405c-b1a1-846e8d8b1487 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:20.873213 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1192/2392] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:20 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:22.667886 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:22.988175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:25.166290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05634bc6-0b82-4431-89d3-bd1dd402a520 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:25.167003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05634bc6-0b82-4431-89d3-bd1dd402a520 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:25.167003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05634bc6-0b82-4431-89d3-bd1dd402a520 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:25.188219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-05634bc6-0b82-4431-89d3-bd1dd402a520 None None] MFA Rules not processed for user `006ea7f9977c442aa8ed8979c89a592b`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:25.189955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-05634bc6-0b82-4431-89d3-bd1dd402a520 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:25.209079 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1201/2393] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:25.482119 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ed555-1541-405c-b1a1-846e8d8b1487 service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:25.582705 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f81ed555-1541-405c-b1a1-846e8d8b1487 service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:25.597252 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fa44d-7191-4b19-8d15-a72b9acfe826 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:25.598655 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fa44d-7191-4b19-8d15-a72b9acfe826 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:25.599130 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fa44d-7191-4b19-8d15-a72b9acfe826 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:25.599576 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680fa44d-7191-4b19-8d15-a72b9acfe826 admin admin] PATH_INFO: `/v3/users/7141523781b3439f98b6860d8e276dc0` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:25.602041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fa44d-7191-4b19-8d15-a72b9acfe826 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7141523781b3439f98b6860d8e276dc0)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:25.604045 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680fa44d-7191-4b19-8d15-a72b9acfe826 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:25.887917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-680fa44d-7191-4b19-8d15-a72b9acfe826 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7141523781b3439f98b6860d8e276dc0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:25.888803 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-680fa44d-7191-4b19-8d15-a72b9acfe826 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7141523781b3439f98b6860d8e276dc0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:25.987837 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-680fa44d-7191-4b19-8d15-a72b9acfe826 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7141523781b3439f98b6860d8e276dc0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:25.988629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-680fa44d-7191-4b19-8d15-a72b9acfe826 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7141523781b3439f98b6860d8e276dc0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:26.008306 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-680fa44d-7191-4b19-8d15-a72b9acfe826 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7141523781b3439f98b6860d8e276dc0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:26.026613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1193/2394] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:39:25 2022] DELETE /identity/v3/users/7141523781b3439f98b6860d8e276dc0 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:26.033019 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74f777-5394-41e8-a430-5a64d87f232f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:26.033652 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74f777-5394-41e8-a430-5a64d87f232f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:26.034088 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f74f777-5394-41e8-a430-5a64d87f232f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:26.054689 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3f74f777-5394-41e8-a430-5a64d87f232f None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:26.056001 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3f74f777-5394-41e8-a430-5a64d87f232f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:26.147685 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1202/2395] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:39:26.158511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fa44d-7191-4b19-8d15-a72b9acfe826 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:26.162488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-680fa44d-7191-4b19-8d15-a72b9acfe826 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:26.270222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680fa44d-7191-4b19-8d15-a72b9acfe826 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:26.274045 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfc841-3c2e-4c2b-ab3c-0974f713cd87 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:26.275052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfc841-3c2e-4c2b-ab3c-0974f713cd87 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:26.275531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfc841-3c2e-4c2b-ab3c-0974f713cd87 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:26.275704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dcfc841-3c2e-4c2b-ab3c-0974f713cd87 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:26.287028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfc841-3c2e-4c2b-ab3c-0974f713cd87 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:26.288456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dcfc841-3c2e-4c2b-ab3c-0974f713cd87 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:26.301268 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:26.301434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1194/2396] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:26.622443 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:26.880752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74f777-5394-41e8-a430-5a64d87f232f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:26.882433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3f74f777-5394-41e8-a430-5a64d87f232f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:26.901364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f74f777-5394-41e8-a430-5a64d87f232f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:26.911606 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe7798-68db-4f8d-8f09-1711b375732f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:26.912550 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe7798-68db-4f8d-8f09-1711b375732f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:26.912933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe7798-68db-4f8d-8f09-1711b375732f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:26.913093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe7798-68db-4f8d-8f09-1711b375732f admin admin] PATH_INFO: `/v3/projects/0be1cd7e371f43afbb7ac5557aa34b9b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:26.914339 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe7798-68db-4f8d-8f09-1711b375732f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0be1cd7e371f43afbb7ac5557aa34b9b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:26.918609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe7798-68db-4f8d-8f09-1711b375732f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:27.062837 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cafe7798-68db-4f8d-8f09-1711b375732f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0be1cd7e371f43afbb7ac5557aa34b9b', 'request_id': 'req-cafe7798-68db-4f8d-8f09-1711b375732f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:27.070137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cafe7798-68db-4f8d-8f09-1711b375732f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0be1cd7e371f43afbb7ac5557aa34b9b', 'request_id': 'req-cafe7798-68db-4f8d-8f09-1711b375732f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:27.077271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cafe7798-68db-4f8d-8f09-1711b375732f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0be1cd7e371f43afbb7ac5557aa34b9b', 'request_id': 'req-cafe7798-68db-4f8d-8f09-1711b375732f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:27.190170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cafe7798-68db-4f8d-8f09-1711b375732f admin admin] The token cache is being invalidate because project 0be1cd7e371f43afbb7ac5557aa34b9b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:39:27.190480 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cafe7798-68db-4f8d-8f09-1711b375732f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:27.195967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-cafe7798-68db-4f8d-8f09-1711b375732f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:27.195967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1203/2397] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:39:26 2022] DELETE /identity/v3/projects/0be1cd7e371f43afbb7ac5557aa34b9b => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:27.197337 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfc841-3c2e-4c2b-ab3c-0974f713cd87 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:27.209235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dcfc841-3c2e-4c2b-ab3c-0974f713cd87 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:27.298980 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bed97-13e8-4875-ab3a-8b7556246077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:27.299935 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bed97-13e8-4875-ab3a-8b7556246077 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:27.300278 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bed97-13e8-4875-ab3a-8b7556246077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:27.300618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-375bed97-13e8-4875-ab3a-8b7556246077 admin admin] PATH_INFO: `/v3/users/570ab5b53f5249fba7638b6df4cf351f` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:27.302235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bed97-13e8-4875-ab3a-8b7556246077 admin admin] RBAC: Authorizing `identity:delete_user(user_id=570ab5b53f5249fba7638b6df4cf351f)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:27.304864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-375bed97-13e8-4875-ab3a-8b7556246077 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:27.618392 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-375bed97-13e8-4875-ab3a-8b7556246077 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '570ab5b53f5249fba7638b6df4cf351f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:27.619065 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-375bed97-13e8-4875-ab3a-8b7556246077 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '570ab5b53f5249fba7638b6df4cf351f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:27.698887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-375bed97-13e8-4875-ab3a-8b7556246077 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '570ab5b53f5249fba7638b6df4cf351f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:27.699671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-375bed97-13e8-4875-ab3a-8b7556246077 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '570ab5b53f5249fba7638b6df4cf351f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:27.716070 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-375bed97-13e8-4875-ab3a-8b7556246077 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '570ab5b53f5249fba7638b6df4cf351f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:27.736048 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1195/2398] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:39:27 2022] DELETE /identity/v3/users/570ab5b53f5249fba7638b6df4cf351f => generated 0 bytes in 539 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:28.214537 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe7798-68db-4f8d-8f09-1711b375732f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:28.216020 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cafe7798-68db-4f8d-8f09-1711b375732f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:28.229974 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe7798-68db-4f8d-8f09-1711b375732f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:28.294835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baefccd-69f8-427b-8c67-27e8d0862815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:28.296017 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baefccd-69f8-427b-8c67-27e8d0862815 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:28.296299 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baefccd-69f8-427b-8c67-27e8d0862815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:28.296564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baefccd-69f8-427b-8c67-27e8d0862815 admin admin] PATH_INFO: `/v3/projects/5109fcb8fcbc4d8eb3c2c65aa402e888` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:28.297812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baefccd-69f8-427b-8c67-27e8d0862815 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5109fcb8fcbc4d8eb3c2c65aa402e888)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:28.299819 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baefccd-69f8-427b-8c67-27e8d0862815 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:28.440015 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:28.459565 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6baefccd-69f8-427b-8c67-27e8d0862815 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5109fcb8fcbc4d8eb3c2c65aa402e888', 'request_id': 'req-6baefccd-69f8-427b-8c67-27e8d0862815'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:28.465961 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6baefccd-69f8-427b-8c67-27e8d0862815 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5109fcb8fcbc4d8eb3c2c65aa402e888', 'request_id': 'req-6baefccd-69f8-427b-8c67-27e8d0862815'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:28.471950 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6baefccd-69f8-427b-8c67-27e8d0862815 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5109fcb8fcbc4d8eb3c2c65aa402e888', 'request_id': 'req-6baefccd-69f8-427b-8c67-27e8d0862815'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:28.571094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6baefccd-69f8-427b-8c67-27e8d0862815 admin admin] The token cache is being invalidate because project 5109fcb8fcbc4d8eb3c2c65aa402e888 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:39:28.571519 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6baefccd-69f8-427b-8c67-27e8d0862815 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:28.572378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-6baefccd-69f8-427b-8c67-27e8d0862815 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:28.580676 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1204/2399] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:39:28 2022] DELETE /identity/v3/projects/5109fcb8fcbc4d8eb3c2c65aa402e888 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:28.584543 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bed97-13e8-4875-ab3a-8b7556246077 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:28.586844 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-375bed97-13e8-4875-ab3a-8b7556246077 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:28.600443 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-375bed97-13e8-4875-ab3a-8b7556246077 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:28.665198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2089eccf-b74d-4b3e-97b8-04104cb49d1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:28.666080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089eccf-b74d-4b3e-97b8-04104cb49d1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:28.667410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089eccf-b74d-4b3e-97b8-04104cb49d1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:28.667410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2089eccf-b74d-4b3e-97b8-04104cb49d1e admin admin] PATH_INFO: `/v3/users/23f698028aa0444491416ef43a14a5b2` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:28.668132 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089eccf-b74d-4b3e-97b8-04104cb49d1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=23f698028aa0444491416ef43a14a5b2)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:28.670255 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2089eccf-b74d-4b3e-97b8-04104cb49d1e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:28.930984 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2089eccf-b74d-4b3e-97b8-04104cb49d1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23f698028aa0444491416ef43a14a5b2'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:28.931829 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2089eccf-b74d-4b3e-97b8-04104cb49d1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23f698028aa0444491416ef43a14a5b2'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:28.990611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:DELETE=11,keystone:SELECT=87,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:29.001388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baefccd-69f8-427b-8c67-27e8d0862815 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:29.002958 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6baefccd-69f8-427b-8c67-27e8d0862815 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:29.017508 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baefccd-69f8-427b-8c67-27e8d0862815 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:29.024852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a4f14-7cab-49ae-832e-f32cedc91045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:29.025067 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a4f14-7cab-49ae-832e-f32cedc91045 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:29.025209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a4f14-7cab-49ae-832e-f32cedc91045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:29.025488 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70a4f14-7cab-49ae-832e-f32cedc91045 admin admin] PATH_INFO: `/v3/users/3a80e9b06ea64b0f81b36d03659e19ec` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:29.027521 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a4f14-7cab-49ae-832e-f32cedc91045 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a80e9b06ea64b0f81b36d03659e19ec)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:29.030605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70a4f14-7cab-49ae-832e-f32cedc91045 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:29.067988 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2089eccf-b74d-4b3e-97b8-04104cb49d1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23f698028aa0444491416ef43a14a5b2'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:29.069156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2089eccf-b74d-4b3e-97b8-04104cb49d1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23f698028aa0444491416ef43a14a5b2'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:29.088010 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2089eccf-b74d-4b3e-97b8-04104cb49d1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23f698028aa0444491416ef43a14a5b2'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:29.100460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1196/2400] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:39:28 2022] DELETE /identity/v3/users/23f698028aa0444491416ef43a14a5b2 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:29.413287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b70a4f14-7cab-49ae-832e-f32cedc91045 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a80e9b06ea64b0f81b36d03659e19ec'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:29.428650 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b70a4f14-7cab-49ae-832e-f32cedc91045 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a80e9b06ea64b0f81b36d03659e19ec'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:29.429777 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b70a4f14-7cab-49ae-832e-f32cedc91045 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a80e9b06ea64b0f81b36d03659e19ec'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:29.430633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b70a4f14-7cab-49ae-832e-f32cedc91045 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a80e9b06ea64b0f81b36d03659e19ec'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:29.439820 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b70a4f14-7cab-49ae-832e-f32cedc91045 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a80e9b06ea64b0f81b36d03659e19ec'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:29.554353 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1205/2401] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:39:29 2022] DELETE /identity/v3/users/3a80e9b06ea64b0f81b36d03659e19ec => generated 0 bytes in 547 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:29.554501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36d618-6dd2-436b-9d3e-2f996ca6414b None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:29.554501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36d618-6dd2-436b-9d3e-2f996ca6414b None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:29.554501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae36d618-6dd2-436b-9d3e-2f996ca6414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:29.580022 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-ae36d618-6dd2-436b-9d3e-2f996ca6414b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:29.582124 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ae36d618-6dd2-436b-9d3e-2f996ca6414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:29.652354 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1197/2402] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:29.662862 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a4f14-7cab-49ae-832e-f32cedc91045 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:29.664361 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b70a4f14-7cab-49ae-832e-f32cedc91045 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:29.694850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36d618-6dd2-436b-9d3e-2f996ca6414b None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:29.697119 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ae36d618-6dd2-436b-9d3e-2f996ca6414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:29.712820 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae36d618-6dd2-436b-9d3e-2f996ca6414b None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:29.718897 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a858325-dd47-4ca5-8382-62f43b262d98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:29.720109 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a858325-dd47-4ca5-8382-62f43b262d98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:29.720442 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a858325-dd47-4ca5-8382-62f43b262d98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:29.720999 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a858325-dd47-4ca5-8382-62f43b262d98 admin admin] PATH_INFO: `/v3/projects/0bdad1b212884b6e92fd446e019b9dde` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:29.722371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a858325-dd47-4ca5-8382-62f43b262d98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0bdad1b212884b6e92fd446e019b9dde)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:29.724749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a858325-dd47-4ca5-8382-62f43b262d98 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:29.745891 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70a4f14-7cab-49ae-832e-f32cedc91045 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:29.755362 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148223c-6f77-4c38-83b0-dd5bbafbf6c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:29.756145 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148223c-6f77-4c38-83b0-dd5bbafbf6c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:29.756454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148223c-6f77-4c38-83b0-dd5bbafbf6c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:29.756699 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5148223c-6f77-4c38-83b0-dd5bbafbf6c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:29.768275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148223c-6f77-4c38-83b0-dd5bbafbf6c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:29.769602 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5148223c-6f77-4c38-83b0-dd5bbafbf6c1 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:29.780124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1206/2403] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:29.879312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-1a858325-dd47-4ca5-8382-62f43b262d98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0bdad1b212884b6e92fd446e019b9dde', 'request_id': 'req-1a858325-dd47-4ca5-8382-62f43b262d98'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:30.001152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-1a858325-dd47-4ca5-8382-62f43b262d98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0bdad1b212884b6e92fd446e019b9dde', 'request_id': 'req-1a858325-dd47-4ca5-8382-62f43b262d98'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:30.015904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-1a858325-dd47-4ca5-8382-62f43b262d98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0bdad1b212884b6e92fd446e019b9dde', 'request_id': 'req-1a858325-dd47-4ca5-8382-62f43b262d98'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:30.028945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-1a858325-dd47-4ca5-8382-62f43b262d98 admin admin] The token cache is being invalidate because project 0bdad1b212884b6e92fd446e019b9dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:39:30.029839 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-1a858325-dd47-4ca5-8382-62f43b262d98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:30.031431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-1a858325-dd47-4ca5-8382-62f43b262d98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:30.050911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1198/2404] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:39:29 2022] DELETE /identity/v3/projects/0bdad1b212884b6e92fd446e019b9dde => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:39:30.361196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148223c-6f77-4c38-83b0-dd5bbafbf6c1 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:30.362847 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5148223c-6f77-4c38-83b0-dd5bbafbf6c1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:30.379780 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5148223c-6f77-4c38-83b0-dd5bbafbf6c1 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:30.457393 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819c402e-3d86-49ca-b3f0-744376d5b8de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:30.458356 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c402e-3d86-49ca-b3f0-744376d5b8de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:30.458648 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c402e-3d86-49ca-b3f0-744376d5b8de admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:30.458960 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819c402e-3d86-49ca-b3f0-744376d5b8de admin admin] PATH_INFO: `/v3/projects/4887b1af8f41437b8537ea96348f8858` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:30.460191 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c402e-3d86-49ca-b3f0-744376d5b8de admin admin] RBAC: Authorizing `identity:delete_project(project_id=4887b1af8f41437b8537ea96348f8858)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:30.462117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819c402e-3d86-49ca-b3f0-744376d5b8de admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:30.601451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-819c402e-3d86-49ca-b3f0-744376d5b8de admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4887b1af8f41437b8537ea96348f8858', 'request_id': 'req-819c402e-3d86-49ca-b3f0-744376d5b8de'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:30.607864 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-819c402e-3d86-49ca-b3f0-744376d5b8de admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4887b1af8f41437b8537ea96348f8858', 'request_id': 'req-819c402e-3d86-49ca-b3f0-744376d5b8de'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:30.614734 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-819c402e-3d86-49ca-b3f0-744376d5b8de admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4887b1af8f41437b8537ea96348f8858', 'request_id': 'req-819c402e-3d86-49ca-b3f0-744376d5b8de'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:30.719068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-819c402e-3d86-49ca-b3f0-744376d5b8de admin admin] The token cache is being invalidate because project 4887b1af8f41437b8537ea96348f8858 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:39:30.719373 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-819c402e-3d86-49ca-b3f0-744376d5b8de admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:30.720022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-819c402e-3d86-49ca-b3f0-744376d5b8de admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:39:30.721665 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1207/2405] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:39:30 2022] DELETE /identity/v3/projects/4887b1af8f41437b8537ea96348f8858 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:30.726636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e9cfe-17ca-42b0-8f30-46a4739875f6 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:30.727136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e9cfe-17ca-42b0-8f30-46a4739875f6 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:30.727230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e9cfe-17ca-42b0-8f30-46a4739875f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:30.747815 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-793e9cfe-17ca-42b0-8f30-46a4739875f6 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:30.749185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-793e9cfe-17ca-42b0-8f30-46a4739875f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:30.814714 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1199/2406] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:30.822505 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9a90b-9caf-4fc5-8090-1e4dab6c5d12 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:30.822823 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9a90b-9caf-4fc5-8090-1e4dab6c5d12 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:30.823104 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c9a90b-9caf-4fc5-8090-1e4dab6c5d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:30.841855 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f5c9a90b-9caf-4fc5-8090-1e4dab6c5d12 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:30.843948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f5c9a90b-9caf-4fc5-8090-1e4dab6c5d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:30.853233 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1208/2407] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:30.857782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e9cfe-17ca-42b0-8f30-46a4739875f6 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:30.868690 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e9cfe-17ca-42b0-8f30-46a4739875f6 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:30.873367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cefe48-e54b-4c43-955a-5f1be2675aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:30.874076 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cefe48-e54b-4c43-955a-5f1be2675aca admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:30.874441 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cefe48-e54b-4c43-955a-5f1be2675aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:30.874880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07cefe48-e54b-4c43-955a-5f1be2675aca admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:30.875626 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cefe48-e54b-4c43-955a-5f1be2675aca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:39:30.875941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cefe48-e54b-4c43-955a-5f1be2675aca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:30.877653 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07cefe48-e54b-4c43-955a-5f1be2675aca admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:30.891065 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1200/2408] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:39:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:39:30.895328 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9a90b-9caf-4fc5-8090-1e4dab6c5d12 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:30.907681 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c9a90b-9caf-4fc5-8090-1e4dab6c5d12 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:30.913015 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee079a2-04b9-4d48-bfbb-a68edbb04e77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:30.913670 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee079a2-04b9-4d48-bfbb-a68edbb04e77 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:30.913954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee079a2-04b9-4d48-bfbb-a68edbb04e77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:30.914232 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee079a2-04b9-4d48-bfbb-a68edbb04e77 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:30.914970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee079a2-04b9-4d48-bfbb-a68edbb04e77 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:30.916942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee079a2-04b9-4d48-bfbb-a68edbb04e77 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:30.923490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:31.060604 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1209/2409] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:39:30 2022] POST /identity/v3/projects => generated 383 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:31.065252 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cefe48-e54b-4c43-955a-5f1be2675aca admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:31.080581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07cefe48-e54b-4c43-955a-5f1be2675aca admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:31.148485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0cd9f-fdd7-4607-8813-6707377634c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:31.149139 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0cd9f-fdd7-4607-8813-6707377634c5 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:31.149427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0cd9f-fdd7-4607-8813-6707377634c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:31.149707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba0cd9f-fdd7-4607-8813-6707377634c5 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:31.150402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0cd9f-fdd7-4607-8813-6707377634c5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:31.152389 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba0cd9f-fdd7-4607-8813-6707377634c5 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:31.274463 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1201/2410] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:39:31 2022] POST /identity/v3/users => generated 292 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:31.278666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee079a2-04b9-4d48-bfbb-a68edbb04e77 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:31.289864 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee079a2-04b9-4d48-bfbb-a68edbb04e77 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:31.294383 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592f2c6-06f0-47c0-b691-df6721740357 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:31.295067 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592f2c6-06f0-47c0-b691-df6721740357 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:31.295352 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592f2c6-06f0-47c0-b691-df6721740357 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:31.295761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f592f2c6-06f0-47c0-b691-df6721740357 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:31.296649 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592f2c6-06f0-47c0-b691-df6721740357 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:31.298251 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f592f2c6-06f0-47c0-b691-df6721740357 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:31.309243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1210/2411] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:31.313454 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0cd9f-fdd7-4607-8813-6707377634c5 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:31.324294 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba0cd9f-fdd7-4607-8813-6707377634c5 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:31.329332 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e647be95-4bf6-44e5-8197-dfbb580d0b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:31.329996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647be95-4bf6-44e5-8197-dfbb580d0b96 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:31.330303 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647be95-4bf6-44e5-8197-dfbb580d0b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:31.330579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e647be95-4bf6-44e5-8197-dfbb580d0b96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:31.331342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647be95-4bf6-44e5-8197-dfbb580d0b96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:31.332926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e647be95-4bf6-44e5-8197-dfbb580d0b96 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:31.344005 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1202/2412] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:31.347867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592f2c6-06f0-47c0-b691-df6721740357 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:31.357977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f592f2c6-06f0-47c0-b691-df6721740357 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:31.362698 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03391801-ee3f-4cae-a6c4-b200083a7915 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:31.363619 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03391801-ee3f-4cae-a6c4-b200083a7915 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:31.363901 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03391801-ee3f-4cae-a6c4-b200083a7915 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:31.364176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03391801-ee3f-4cae-a6c4-b200083a7915 admin admin] PATH_INFO: `/v3/projects/12ac1563277b404da1335ea0804d9859/users/688899d9846f40b2b6f7fcb325d3c266/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:31.379699 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03391801-ee3f-4cae-a6c4-b200083a7915 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12ac1563277b404da1335ea0804d9859, user_id=688899d9846f40b2b6f7fcb325d3c266, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:31.383158 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03391801-ee3f-4cae-a6c4-b200083a7915 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:31.401949 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:31.471273 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1211/2413] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:31 2022] PUT /identity/v3/projects/12ac1563277b404da1335ea0804d9859/users/688899d9846f40b2b6f7fcb325d3c266/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:31.476474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04a701-f76e-4cc5-9f23-260a870db358 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:31.476766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04a701-f76e-4cc5-9f23-260a870db358 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:31.477047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c04a701-f76e-4cc5-9f23-260a870db358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:31.495811 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-4c04a701-f76e-4cc5-9f23-260a870db358 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:31.497015 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4c04a701-f76e-4cc5-9f23-260a870db358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:31.559203 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1203/2414] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:31.572004 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03391801-ee3f-4cae-a6c4-b200083a7915 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:31.573755 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-03391801-ee3f-4cae-a6c4-b200083a7915 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:31.637547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03391801-ee3f-4cae-a6c4-b200083a7915 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:31.641977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cd5271-39b9-4c77-945c-b4980bd045e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:31.642637 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd5271-39b9-4c77-945c-b4980bd045e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:31.642952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd5271-39b9-4c77-945c-b4980bd045e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:31.643232 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cd5271-39b9-4c77-945c-b4980bd045e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:31.653206 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd5271-39b9-4c77-945c-b4980bd045e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:31.654728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cd5271-39b9-4c77-945c-b4980bd045e6 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:31.664453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1212/2415] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:33.646595 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:34.086810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:35.368661 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:36.222706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:36.456817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:37.810164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04a701-f76e-4cc5-9f23-260a870db358 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:37.813455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4c04a701-f76e-4cc5-9f23-260a870db358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:37.916833 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c04a701-f76e-4cc5-9f23-260a870db358 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:37.923862 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f71cb-f369-4a60-82cc-d855440a1a8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:37.924808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f71cb-f369-4a60-82cc-d855440a1a8c service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:37.925169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f71cb-f369-4a60-82cc-d855440a1a8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:37.925562 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48f71cb-f369-4a60-82cc-d855440a1a8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:37.927691 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e48f71cb-f369-4a60-82cc-d855440a1a8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:38.023916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e9433-4fa4-43a1-8a04-6a2a61c8590b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:38.024781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e9433-4fa4-43a1-8a04-6a2a61c8590b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:38.025216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002e9433-4fa4-43a1-8a04-6a2a61c8590b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:38.031547 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f71cb-f369-4a60-82cc-d855440a1a8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:38.033444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48f71cb-f369-4a60-82cc-d855440a1a8c service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:38.046469 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1204/2416] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:37 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 237 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:39:38.069872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-002e9433-4fa4-43a1-8a04-6a2a61c8590b None None] MFA Rules not processed for user `688899d9846f40b2b6f7fcb325d3c266`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:38.072714 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-002e9433-4fa4-43a1-8a04-6a2a61c8590b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:38.164150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1213/2417] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:38 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:39:38.169182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f71cb-f369-4a60-82cc-d855440a1a8c service cinder] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:38.180455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48f71cb-f369-4a60-82cc-d855440a1a8c service cinder] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:38.185704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2cb8e-fac7-4380-9b3a-3fcdb9858461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:38.187164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2cb8e-fac7-4380-9b3a-3fcdb9858461 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:38.187446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2cb8e-fac7-4380-9b3a-3fcdb9858461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:38.187720 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c2cb8e-fac7-4380-9b3a-3fcdb9858461 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:38.188909 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2cb8e-fac7-4380-9b3a-3fcdb9858461 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:38.191783 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c2cb8e-fac7-4380-9b3a-3fcdb9858461 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:38.319748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1205/2418] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:39:38 2022] POST /identity/v3/projects => generated 385 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:39:38.324926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e9433-4fa4-43a1-8a04-6a2a61c8590b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:38.338017 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002e9433-4fa4-43a1-8a04-6a2a61c8590b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:38.408217 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ef4a3-acbb-4222-b004-37fb18bbd442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:38.408985 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef4a3-acbb-4222-b004-37fb18bbd442 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:38.409288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef4a3-acbb-4222-b004-37fb18bbd442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:38.409617 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953ef4a3-acbb-4222-b004-37fb18bbd442 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:38.410254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ef4a3-acbb-4222-b004-37fb18bbd442 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:38.412379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953ef4a3-acbb-4222-b004-37fb18bbd442 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:38.528967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1214/2419] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:39:38 2022] POST /identity/v3/users => generated 299 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:39:38.534480 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2cb8e-fac7-4380-9b3a-3fcdb9858461 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:38.546977 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c2cb8e-fac7-4380-9b3a-3fcdb9858461 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:38.550113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:38.554470 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898dc27-5c43-4222-bffa-3fe01f37facb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:38.555302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898dc27-5c43-4222-bffa-3fe01f37facb admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:38.555593 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898dc27-5c43-4222-bffa-3fe01f37facb admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:38.555863 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898dc27-5c43-4222-bffa-3fe01f37facb admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:38.556649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898dc27-5c43-4222-bffa-3fe01f37facb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:38.558393 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898dc27-5c43-4222-bffa-3fe01f37facb admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:38.573704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1206/2420] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:38.578063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ef4a3-acbb-4222-b004-37fb18bbd442 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:38.589506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953ef4a3-acbb-4222-b004-37fb18bbd442 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:38.595872 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcbf70-35ce-4db0-857e-9e5cf880f6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:38.597006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcbf70-35ce-4db0-857e-9e5cf880f6c6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:38.597279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcbf70-35ce-4db0-857e-9e5cf880f6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:38.597621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fcbf70-35ce-4db0-857e-9e5cf880f6c6 admin admin] PATH_INFO: `/v3/projects/33de8101cc3340c2aa18b87b7746d2a9/users/bc0c35c600014c5987c17667eaf58418/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:38.616915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcbf70-35ce-4db0-857e-9e5cf880f6c6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33de8101cc3340c2aa18b87b7746d2a9, user_id=bc0c35c600014c5987c17667eaf58418, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:38.619798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fcbf70-35ce-4db0-857e-9e5cf880f6c6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:38.706506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1215/2421] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:38 2022] PUT /identity/v3/projects/33de8101cc3340c2aa18b87b7746d2a9/users/bc0c35c600014c5987c17667eaf58418/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:38.711342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898dc27-5c43-4222-bffa-3fe01f37facb admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:38.722889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898dc27-5c43-4222-bffa-3fe01f37facb admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:38.745153 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:38.815341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d45a62-c631-4985-896c-8282efe7b104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:38.816156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d45a62-c631-4985-896c-8282efe7b104 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:38.816446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d45a62-c631-4985-896c-8282efe7b104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:38.816733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d45a62-c631-4985-896c-8282efe7b104 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:38.817557 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d45a62-c631-4985-896c-8282efe7b104 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:38.819523 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d45a62-c631-4985-896c-8282efe7b104 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:38.831513 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1207/2422] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:39:38 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:39:38.835646 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcbf70-35ce-4db0-857e-9e5cf880f6c6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:38.851175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fcbf70-35ce-4db0-857e-9e5cf880f6c6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:38.852437 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347cda3-9775-48f6-8f90-e4540296c774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:38.853349 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347cda3-9775-48f6-8f90-e4540296c774 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:38.853626 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347cda3-9775-48f6-8f90-e4540296c774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:38.854150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e347cda3-9775-48f6-8f90-e4540296c774 admin admin] PATH_INFO: `/v3/projects/33de8101cc3340c2aa18b87b7746d2a9/users/bc0c35c600014c5987c17667eaf58418/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:38.856206 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347cda3-9775-48f6-8f90-e4540296c774 admin admin] RBAC: Authorizing `identity:create_grant(project_id=33de8101cc3340c2aa18b87b7746d2a9, user_id=bc0c35c600014c5987c17667eaf58418, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:38.859860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e347cda3-9775-48f6-8f90-e4540296c774 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:38.875567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1216/2423] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:39:38 2022] PUT /identity/v3/projects/33de8101cc3340c2aa18b87b7746d2a9/users/bc0c35c600014c5987c17667eaf58418/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:39:40.526047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:40.777103 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:42.636600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:43.527665 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:45.901933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322da56c-bdc6-4c69-8774-8879b5a1baa8 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:45.902730 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322da56c-bdc6-4c69-8774-8879b5a1baa8 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:45.903306 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322da56c-bdc6-4c69-8774-8879b5a1baa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:45.957558 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-322da56c-bdc6-4c69-8774-8879b5a1baa8 None None] MFA Rules not processed for user `bc0c35c600014c5987c17667eaf58418`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:45.960355 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-322da56c-bdc6-4c69-8774-8879b5a1baa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:45.986970 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:46.091179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1208/2424] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:39:45 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:46.117659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347cda3-9775-48f6-8f90-e4540296c774 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:46.121037 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e347cda3-9775-48f6-8f90-e4540296c774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:46.204109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e347cda3-9775-48f6-8f90-e4540296c774 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:46.213616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c8cfb-98df-4249-bf56-d5494691eede service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2352b5c2aa664bf0a7e321ff3a5038fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:46.213616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c8cfb-98df-4249-bf56-d5494691eede service glance] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:46.213616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c8cfb-98df-4249-bf56-d5494691eede service glance] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:46.213616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a0c8cfb-98df-4249-bf56-d5494691eede service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:46.281409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:46.291302 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c8cfb-98df-4249-bf56-d5494691eede service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:46.293049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a0c8cfb-98df-4249-bf56-d5494691eede service glance] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:46.305671 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1217/2425] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:39:46 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:39:46.675684 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadb452-7687-4340-823c-aa23d553b6d5 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:46.676149 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadb452-7687-4340-823c-aa23d553b6d5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:46.676593 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aadb452-7687-4340-823c-aa23d553b6d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:46.706311 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-4aadb452-7687-4340-823c-aa23d553b6d5 None None] MFA Rules not processed for user `deed55901c264b8da58e57c21840c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:39:46.707595 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4aadb452-7687-4340-823c-aa23d553b6d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:46.803196 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1209/2426] 10.222.0.40 () {58 vars in 1009 bytes} [Fri Jul 15 19:39:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:39:46.823207 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c8cfb-98df-4249-bf56-d5494691eede service glance] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:39:46.827353 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9a0c8cfb-98df-4249-bf56-d5494691eede service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:39:46.972554 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a0c8cfb-98df-4249-bf56-d5494691eede service glance] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:39:46.978522 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7ac20-3852-4b68-8087-cffc6ec599e7 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0402e1bd20b042cdbdcb890616b22726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:39:46.979407 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7ac20-3852-4b68-8087-cffc6ec599e7 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:39:46.979733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7ac20-3852-4b68-8087-cffc6ec599e7 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:39:46.980050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c7ac20-3852-4b68-8087-cffc6ec599e7 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:39:46.989951 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7ac20-3852-4b68-8087-cffc6ec599e7 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:39:46.991662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c7ac20-3852-4b68-8087-cffc6ec599e7 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:39:47.002275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1218/2427] 10.222.0.40 () {60 vars in 1384 bytes} [Fri Jul 15 19:39:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:39:47.622409 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:48.950494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:50.622803 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:52.205324 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:53.503854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:53.608333 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:55.553686 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:55.650718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:39:59.099238 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:00.476005 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:01.572554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382397a3-2e97-4b05-ad10-dac3cbffbfc7 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:01.573151 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382397a3-2e97-4b05-ad10-dac3cbffbfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:01.573151 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382397a3-2e97-4b05-ad10-dac3cbffbfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:01.593713 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-382397a3-2e97-4b05-ad10-dac3cbffbfc7 None None] MFA Rules not processed for user `688899d9846f40b2b6f7fcb325d3c266`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:01.595147 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-382397a3-2e97-4b05-ad10-dac3cbffbfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:01.602731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1210/2428] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:40:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:01.833402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7ac20-3852-4b68-8087-cffc6ec599e7 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:01.835135 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d6c7ac20-3852-4b68-8087-cffc6ec599e7 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:01.873196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:01.975680 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c7ac20-3852-4b68-8087-cffc6ec599e7 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:01.981272 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc17d4e-f37f-4e63-bf64-133fa5fd396e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad68d871464f4b5588c22070205f159e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:01.981945 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc17d4e-f37f-4e63-bf64-133fa5fd396e service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:01.983823 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc17d4e-f37f-4e63-bf64-133fa5fd396e service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:01.983823 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc17d4e-f37f-4e63-bf64-133fa5fd396e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:01.985149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-abc17d4e-f37f-4e63-bf64-133fa5fd396e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:02.003186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc17d4e-f37f-4e63-bf64-133fa5fd396e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:02.005769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc17d4e-f37f-4e63-bf64-133fa5fd396e service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:02.018715 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1219/2429] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:01 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:02.487519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:02.694153 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382397a3-2e97-4b05-ad10-dac3cbffbfc7 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:02.695704 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-382397a3-2e97-4b05-ad10-dac3cbffbfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:02.770863 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382397a3-2e97-4b05-ad10-dac3cbffbfc7 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:02.775578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdf4d9-9a70-4e03-a49c-370f88cf8d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:02.776294 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdf4d9-9a70-4e03-a49c-370f88cf8d37 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:02.776568 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdf4d9-9a70-4e03-a49c-370f88cf8d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:02.777097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cdf4d9-9a70-4e03-a49c-370f88cf8d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:02.779202 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-15cdf4d9-9a70-4e03-a49c-370f88cf8d37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:02.850445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cdf4d9-9a70-4e03-a49c-370f88cf8d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:02.851959 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cdf4d9-9a70-4e03-a49c-370f88cf8d37 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:02.863055 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1211/2430] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:02 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 169 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:04.063099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:04.520269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:05.900285 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:06.780026 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:07.327691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880bf3f-e939-4a86-8736-15f7c487805c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:07.329063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880bf3f-e939-4a86-8736-15f7c487805c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:07.329513 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f880bf3f-e939-4a86-8736-15f7c487805c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:07.367519 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f880bf3f-e939-4a86-8736-15f7c487805c None None] MFA Rules not processed for user `deed55901c264b8da58e57c21840c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:07.368851 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f880bf3f-e939-4a86-8736-15f7c487805c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:07.379328 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1220/2431] 10.222.0.40 () {58 vars in 1009 bytes} [Fri Jul 15 19:40:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:40:07.400192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdf4d9-9a70-4e03-a49c-370f88cf8d37 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:07.424367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cdf4d9-9a70-4e03-a49c-370f88cf8d37 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:07.434909 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1035bf2-8bca-4f9f-b0de-8b0244dca7d5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0402e1bd20b042cdbdcb890616b22726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:07.436499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035bf2-8bca-4f9f-b0de-8b0244dca7d5 service swift] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:07.437183 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035bf2-8bca-4f9f-b0de-8b0244dca7d5 service swift] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:07.437869 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1035bf2-8bca-4f9f-b0de-8b0244dca7d5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:07.489709 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1035bf2-8bca-4f9f-b0de-8b0244dca7d5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:07.493417 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1035bf2-8bca-4f9f-b0de-8b0244dca7d5 service swift] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:07.547071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1212/2432] 10.222.0.40 () {60 vars in 1384 bytes} [Fri Jul 15 19:40:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:40:07.576626 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:07.821731 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741a4ea-8016-4176-80aa-a1ba633b1aa6 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:07.823257 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741a4ea-8016-4176-80aa-a1ba633b1aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:07.825712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5741a4ea-8016-4176-80aa-a1ba633b1aa6 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:07.828564 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1221/2433] 10.222.0.40 () {54 vars in 921 bytes} [Fri Jul 15 19:40:07 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:40:07.861041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190d71b-3691-429c-ade9-8302bbad43b9 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:07.861742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190d71b-3691-429c-ade9-8302bbad43b9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:07.862002 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c190d71b-3691-429c-ade9-8302bbad43b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:07.929814 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c190d71b-3691-429c-ade9-8302bbad43b9 None None] MFA Rules not processed for user `ad68d871464f4b5588c22070205f159e`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:07.947395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c190d71b-3691-429c-ade9-8302bbad43b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:07.991002 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1213/2434] 10.222.0.40 () {58 vars in 1018 bytes} [Fri Jul 15 19:40:07 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:08.100601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741a4ea-8016-4176-80aa-a1ba633b1aa6 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:08.107962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5741a4ea-8016-4176-80aa-a1ba633b1aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:08.191408 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5741a4ea-8016-4176-80aa-a1ba633b1aa6 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:08.209244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f9de7-358d-49b8-a806-af029277e94d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad68d871464f4b5588c22070205f159e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:08.210590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9de7-358d-49b8-a806-af029277e94d service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:08.213348 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9de7-358d-49b8-a806-af029277e94d service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:08.215150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f9de7-358d-49b8-a806-af029277e94d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:08.245467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f9de7-358d-49b8-a806-af029277e94d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:08.256576 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f9de7-358d-49b8-a806-af029277e94d service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:08.300434 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1222/2435] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:08.438744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:08.530279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:08.714899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5b401-7a81-4ef5-819e-af8143d709c4 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:08.715191 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5b401-7a81-4ef5-819e-af8143d709c4 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:08.715442 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf5b401-7a81-4ef5-819e-af8143d709c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:08.747799 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-daf5b401-7a81-4ef5-819e-af8143d709c4 None None] MFA Rules not processed for user `deed55901c264b8da58e57c21840c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:08.753123 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-daf5b401-7a81-4ef5-819e-af8143d709c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:08.787790 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1214/2436] 10.222.0.40 () {58 vars in 1009 bytes} [Fri Jul 15 19:40:08 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:08.807250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f9de7-358d-49b8-a806-af029277e94d service placement] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:08.869497 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f9de7-358d-49b8-a806-af029277e94d service placement] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:08.893826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5100762-ec19-487e-b546-529440649f70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0402e1bd20b042cdbdcb890616b22726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:08.896509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5100762-ec19-487e-b546-529440649f70 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:08.897514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5100762-ec19-487e-b546-529440649f70 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:08.900092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5100762-ec19-487e-b546-529440649f70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:08.970078 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5100762-ec19-487e-b546-529440649f70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:08.984308 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5100762-ec19-487e-b546-529440649f70 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:09.032117 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1223/2437] 10.222.0.40 () {60 vars in 1384 bytes} [Fri Jul 15 19:40:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 226 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 19:40:09.319358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:09.644796 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:10.600337 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5b401-7a81-4ef5-819e-af8143d709c4 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:10.601874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-daf5b401-7a81-4ef5-819e-af8143d709c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:10.885041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf5b401-7a81-4ef5-819e-af8143d709c4 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:10.909839 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fe30f-5646-466a-bb02-fe7bef931a8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:10.910792 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fe30f-5646-466a-bb02-fe7bef931a8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:10.911076 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fe30f-5646-466a-bb02-fe7bef931a8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:10.911357 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044fe30f-5646-466a-bb02-fe7bef931a8a admin admin] PATH_INFO: `/v3/users/8ad861e51bb64547a19907b1c246524f` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:10.914866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fe30f-5646-466a-bb02-fe7bef931a8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ad861e51bb64547a19907b1c246524f)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:10.919480 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044fe30f-5646-466a-bb02-fe7bef931a8a admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:11.379381 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-044fe30f-5646-466a-bb02-fe7bef931a8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ad861e51bb64547a19907b1c246524f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:11.382485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-044fe30f-5646-466a-bb02-fe7bef931a8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ad861e51bb64547a19907b1c246524f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:11.534916 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-044fe30f-5646-466a-bb02-fe7bef931a8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ad861e51bb64547a19907b1c246524f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:11.536461 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-044fe30f-5646-466a-bb02-fe7bef931a8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ad861e51bb64547a19907b1c246524f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:11.567187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-044fe30f-5646-466a-bb02-fe7bef931a8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ad861e51bb64547a19907b1c246524f'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:11.661632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1215/2438] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:40:10 2022] DELETE /identity/v3/users/8ad861e51bb64547a19907b1c246524f => generated 0 bytes in 1062 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:11.713931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:11.974099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:12.542805 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:12.758191 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5100762-ec19-487e-b546-529440649f70 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:12.777216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5100762-ec19-487e-b546-529440649f70 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:13.035720 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f79cc4-b198-4220-ba43-52964c39dfbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:13.040720 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f79cc4-b198-4220-ba43-52964c39dfbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:13.041504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f79cc4-b198-4220-ba43-52964c39dfbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:13.042506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f79cc4-b198-4220-ba43-52964c39dfbc admin admin] PATH_INFO: `/v3/projects/970c6dff999d47f386e6837c8c07c369` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:13.047476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f79cc4-b198-4220-ba43-52964c39dfbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=970c6dff999d47f386e6837c8c07c369)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:13.051533 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f79cc4-b198-4220-ba43-52964c39dfbc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:13.258173 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-76f79cc4-b198-4220-ba43-52964c39dfbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '970c6dff999d47f386e6837c8c07c369', 'request_id': 'req-76f79cc4-b198-4220-ba43-52964c39dfbc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:13.273807 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-76f79cc4-b198-4220-ba43-52964c39dfbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '970c6dff999d47f386e6837c8c07c369', 'request_id': 'req-76f79cc4-b198-4220-ba43-52964c39dfbc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:13.292261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-76f79cc4-b198-4220-ba43-52964c39dfbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '970c6dff999d47f386e6837c8c07c369', 'request_id': 'req-76f79cc4-b198-4220-ba43-52964c39dfbc'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:13.425539 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-76f79cc4-b198-4220-ba43-52964c39dfbc admin admin] The token cache is being invalidate because project 970c6dff999d47f386e6837c8c07c369 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:40:13.425826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-76f79cc4-b198-4220-ba43-52964c39dfbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:13.428012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-76f79cc4-b198-4220-ba43-52964c39dfbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:13.441962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1224/2439] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:40:12 2022] DELETE /identity/v3/projects/970c6dff999d47f386e6837c8c07c369 => generated 0 bytes in 681 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:13.446244 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fe30f-5646-466a-bb02-fe7bef931a8a admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:13.450021 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-044fe30f-5646-466a-bb02-fe7bef931a8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:13.517379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044fe30f-5646-466a-bb02-fe7bef931a8a admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:13.721462 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f6ba27-968b-4721-b104-505dff7a7210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:13.722371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ba27-968b-4721-b104-505dff7a7210 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:13.722658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ba27-968b-4721-b104-505dff7a7210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:13.722957 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f6ba27-968b-4721-b104-505dff7a7210 admin admin] PATH_INFO: `/v3/users/a05f7b5ae54a4607b0e9e5eb706de745` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:13.730573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6ba27-968b-4721-b104-505dff7a7210 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a05f7b5ae54a4607b0e9e5eb706de745)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:13.733403 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f6ba27-968b-4721-b104-505dff7a7210 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:14.069456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f1f6ba27-968b-4721-b104-505dff7a7210 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a05f7b5ae54a4607b0e9e5eb706de745'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:14.073768 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f1f6ba27-968b-4721-b104-505dff7a7210 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a05f7b5ae54a4607b0e9e5eb706de745'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:14.115979 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:14.181544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f1f6ba27-968b-4721-b104-505dff7a7210 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a05f7b5ae54a4607b0e9e5eb706de745'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:14.182199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f1f6ba27-968b-4721-b104-505dff7a7210 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a05f7b5ae54a4607b0e9e5eb706de745'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:14.206400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f1f6ba27-968b-4721-b104-505dff7a7210 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a05f7b5ae54a4607b0e9e5eb706de745'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:14.237843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1216/2440] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:40:13 2022] DELETE /identity/v3/users/a05f7b5ae54a4607b0e9e5eb706de745 => generated 0 bytes in 795 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:14.325207 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:14.727236 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f79cc4-b198-4220-ba43-52964c39dfbc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:14.729012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-76f79cc4-b198-4220-ba43-52964c39dfbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:14.757930 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f79cc4-b198-4220-ba43-52964c39dfbc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:14.893247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c762dbd-0d0b-4b7e-8f5b-f8018d0c2338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:14.896030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c762dbd-0d0b-4b7e-8f5b-f8018d0c2338 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:14.896030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c762dbd-0d0b-4b7e-8f5b-f8018d0c2338 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:14.896030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c762dbd-0d0b-4b7e-8f5b-f8018d0c2338 admin admin] PATH_INFO: `/v3/projects/42aa0d37003e49f99a2dc25a18801e65` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:14.896466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c762dbd-0d0b-4b7e-8f5b-f8018d0c2338 admin admin] RBAC: Authorizing `identity:delete_project(project_id=42aa0d37003e49f99a2dc25a18801e65)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:14.899167 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c762dbd-0d0b-4b7e-8f5b-f8018d0c2338 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:15.063997 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9c762dbd-0d0b-4b7e-8f5b-f8018d0c2338 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '42aa0d37003e49f99a2dc25a18801e65', 'request_id': 'req-9c762dbd-0d0b-4b7e-8f5b-f8018d0c2338'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:15.079694 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9c762dbd-0d0b-4b7e-8f5b-f8018d0c2338 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '42aa0d37003e49f99a2dc25a18801e65', 'request_id': 'req-9c762dbd-0d0b-4b7e-8f5b-f8018d0c2338'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:15.092516 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9c762dbd-0d0b-4b7e-8f5b-f8018d0c2338 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '42aa0d37003e49f99a2dc25a18801e65', 'request_id': 'req-9c762dbd-0d0b-4b7e-8f5b-f8018d0c2338'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:15.193362 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:15.204075 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9c762dbd-0d0b-4b7e-8f5b-f8018d0c2338 admin admin] The token cache is being invalidate because project 42aa0d37003e49f99a2dc25a18801e65 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:40:15.204680 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9c762dbd-0d0b-4b7e-8f5b-f8018d0c2338 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:15.206105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9c762dbd-0d0b-4b7e-8f5b-f8018d0c2338 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:15.214278 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494c49d-9490-436e-a94a-4b6af8894984 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:15.220827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494c49d-9490-436e-a94a-4b6af8894984 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:15.221324 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3494c49d-9490-436e-a94a-4b6af8894984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:15.236464 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1225/2441] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:40:14 2022] DELETE /identity/v3/projects/42aa0d37003e49f99a2dc25a18801e65 => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:15.248648 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-3494c49d-9490-436e-a94a-4b6af8894984 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:15.250404 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3494c49d-9490-436e-a94a-4b6af8894984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:15.355563 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1217/2442] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:15.358328 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52534b-ab26-44ea-b861-445d1eac2572 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:15.358942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52534b-ab26-44ea-b861-445d1eac2572 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:15.358942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a52534b-ab26-44ea-b861-445d1eac2572 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:15.383049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3a52534b-ab26-44ea-b861-445d1eac2572 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:15.384276 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3a52534b-ab26-44ea-b861-445d1eac2572 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:15.394385 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1226/2443] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:40:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:40:15.401567 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494c49d-9490-436e-a94a-4b6af8894984 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:15.412499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3494c49d-9490-436e-a94a-4b6af8894984 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:15.417183 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e305f54-eed0-4c1e-9db1-868cbe9f0877 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:15.417843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e305f54-eed0-4c1e-9db1-868cbe9f0877 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:15.418344 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e305f54-eed0-4c1e-9db1-868cbe9f0877 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:15.418464 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e305f54-eed0-4c1e-9db1-868cbe9f0877 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:15.419165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e305f54-eed0-4c1e-9db1-868cbe9f0877 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:40:15.419542 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e305f54-eed0-4c1e-9db1-868cbe9f0877 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:15.421314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e305f54-eed0-4c1e-9db1-868cbe9f0877 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:15.434098 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1218/2444] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:40:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:40:15.440146 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52534b-ab26-44ea-b861-445d1eac2572 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:15.449874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a52534b-ab26-44ea-b861-445d1eac2572 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:15.456128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809334aa-af55-4255-9afb-3bcd08679650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:15.456786 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809334aa-af55-4255-9afb-3bcd08679650 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:15.457070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809334aa-af55-4255-9afb-3bcd08679650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:15.457345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809334aa-af55-4255-9afb-3bcd08679650 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:15.458248 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809334aa-af55-4255-9afb-3bcd08679650 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:15.460367 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809334aa-af55-4255-9afb-3bcd08679650 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:15.886594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1227/2445] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:40:15 2022] POST /identity/v3/projects => generated 383 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:40:15.891395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e305f54-eed0-4c1e-9db1-868cbe9f0877 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:15.923485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e305f54-eed0-4c1e-9db1-868cbe9f0877 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:16.099372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb068291-0574-43bc-9632-a65b104dbd97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:16.101762 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb068291-0574-43bc-9632-a65b104dbd97 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:16.101762 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb068291-0574-43bc-9632-a65b104dbd97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:16.101762 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb068291-0574-43bc-9632-a65b104dbd97 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:16.103337 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb068291-0574-43bc-9632-a65b104dbd97 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:16.114575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb068291-0574-43bc-9632-a65b104dbd97 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:16.155791 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:16.304750 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1219/2446] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:40:15 2022] POST /identity/v3/users => generated 292 bytes in 414 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:40:16.309313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809334aa-af55-4255-9afb-3bcd08679650 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:16.338187 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809334aa-af55-4255-9afb-3bcd08679650 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:16.360837 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19a475-c184-4c6d-bdd4-3d774ab17a51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:16.362223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19a475-c184-4c6d-bdd4-3d774ab17a51 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:16.362907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19a475-c184-4c6d-bdd4-3d774ab17a51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:16.363577 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db19a475-c184-4c6d-bdd4-3d774ab17a51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:16.365028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19a475-c184-4c6d-bdd4-3d774ab17a51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:16.367244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db19a475-c184-4c6d-bdd4-3d774ab17a51 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:16.395305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1228/2447] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:40:16.397635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb068291-0574-43bc-9632-a65b104dbd97 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:16.424312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb068291-0574-43bc-9632-a65b104dbd97 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:16.440892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffa4bac-2eec-4de4-bf65-768f161e2ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:16.443019 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa4bac-2eec-4de4-bf65-768f161e2ba0 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:16.444096 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa4bac-2eec-4de4-bf65-768f161e2ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:16.444924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffa4bac-2eec-4de4-bf65-768f161e2ba0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:16.446884 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa4bac-2eec-4de4-bf65-768f161e2ba0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:16.451536 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ffa4bac-2eec-4de4-bf65-768f161e2ba0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:16.484566 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1220/2448] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:40:16 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:40:16.486055 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19a475-c184-4c6d-bdd4-3d774ab17a51 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:16.543329 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db19a475-c184-4c6d-bdd4-3d774ab17a51 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:16.558611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c78c7-74cd-498b-a3b0-7d0bfa78d480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:16.564351 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c78c7-74cd-498b-a3b0-7d0bfa78d480 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:16.565445 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c78c7-74cd-498b-a3b0-7d0bfa78d480 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:16.567607 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040c78c7-74cd-498b-a3b0-7d0bfa78d480 admin admin] PATH_INFO: `/v3/projects/39823d93f4fb47e19489d79393585076/users/a2d829e26dea4e96a49f392578f4e621/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:16.626567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c78c7-74cd-498b-a3b0-7d0bfa78d480 admin admin] RBAC: Authorizing `identity:create_grant(project_id=39823d93f4fb47e19489d79393585076, user_id=a2d829e26dea4e96a49f392578f4e621, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:16.639992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040c78c7-74cd-498b-a3b0-7d0bfa78d480 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:16.745388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1229/2449] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:40:16 2022] PUT /identity/v3/projects/39823d93f4fb47e19489d79393585076/users/a2d829e26dea4e96a49f392578f4e621/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:16.774379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004315-b422-4113-9675-12c9db4b7f33 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:16.775026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004315-b422-4113-9675-12c9db4b7f33 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:16.787579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe004315-b422-4113-9675-12c9db4b7f33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:16.871625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-fe004315-b422-4113-9675-12c9db4b7f33 None None] MFA Rules not processed for user `a2d829e26dea4e96a49f392578f4e621`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:16.873601 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-fe004315-b422-4113-9675-12c9db4b7f33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:16.999492 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:17.054397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1221/2450] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:40:16 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:17.074146 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c78c7-74cd-498b-a3b0-7d0bfa78d480 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:17.077449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-040c78c7-74cd-498b-a3b0-7d0bfa78d480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:17.205435 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040c78c7-74cd-498b-a3b0-7d0bfa78d480 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:17.210972 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e95ddf5d-093e-486d-a8e6-dfa1375141b1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:17.212001 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ddf5d-093e-486d-a8e6-dfa1375141b1 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:17.212526 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ddf5d-093e-486d-a8e6-dfa1375141b1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:17.213101 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e95ddf5d-093e-486d-a8e6-dfa1375141b1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:17.240044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ddf5d-093e-486d-a8e6-dfa1375141b1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:17.242080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:17.243304 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e95ddf5d-093e-486d-a8e6-dfa1375141b1 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:17.273762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1230/2451] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:17 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:17.293931 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe004315-b422-4113-9675-12c9db4b7f33 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:17.527737 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe004315-b422-4113-9675-12c9db4b7f33 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:17.536584 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ab8f8-e3f7-4465-8584-b908d307992d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:17.538379 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ab8f8-e3f7-4465-8584-b908d307992d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:17.538789 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ab8f8-e3f7-4465-8584-b908d307992d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:17.539301 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326ab8f8-e3f7-4465-8584-b908d307992d admin admin] PATH_INFO: `/v3/users/a2d829e26dea4e96a49f392578f4e621` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:17.541148 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ab8f8-e3f7-4465-8584-b908d307992d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2d829e26dea4e96a49f392578f4e621)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:17.543675 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326ab8f8-e3f7-4465-8584-b908d307992d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:17.573513 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:17.687862 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:17.788574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-326ab8f8-e3f7-4465-8584-b908d307992d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2d829e26dea4e96a49f392578f4e621'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:17.790546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-326ab8f8-e3f7-4465-8584-b908d307992d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2d829e26dea4e96a49f392578f4e621'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:18.915585 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-326ab8f8-e3f7-4465-8584-b908d307992d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2d829e26dea4e96a49f392578f4e621'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:18.916731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-326ab8f8-e3f7-4465-8584-b908d307992d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2d829e26dea4e96a49f392578f4e621'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:18.943981 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-326ab8f8-e3f7-4465-8584-b908d307992d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2d829e26dea4e96a49f392578f4e621'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:18.988837 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1222/2452] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:40:17 2022] DELETE /identity/v3/users/a2d829e26dea4e96a49f392578f4e621 => generated 0 bytes in 1691 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:18.989795 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c5e07-4715-4761-8886-fd85510d575a None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:18.990325 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c5e07-4715-4761-8886-fd85510d575a None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:18.990689 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c5e07-4715-4761-8886-fd85510d575a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:19.052835 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-409c5e07-4715-4761-8886-fd85510d575a None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:19.057545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-409c5e07-4715-4761-8886-fd85510d575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:19.179512 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1231/2453] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:40:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:19.189299 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ab8f8-e3f7-4465-8584-b908d307992d admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:19.191170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-326ab8f8-e3f7-4465-8584-b908d307992d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:19.256906 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:19.286459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326ab8f8-e3f7-4465-8584-b908d307992d admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:19.293259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516ab6cf-28a2-4aa9-9f8d-e80c02a575a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:19.294432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ab6cf-28a2-4aa9-9f8d-e80c02a575a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:19.295025 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ab6cf-28a2-4aa9-9f8d-e80c02a575a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:19.295695 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516ab6cf-28a2-4aa9-9f8d-e80c02a575a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:19.307912 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ab6cf-28a2-4aa9-9f8d-e80c02a575a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:19.315255 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516ab6cf-28a2-4aa9-9f8d-e80c02a575a6 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:19.331185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1223/2454] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:20.079548 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c5e07-4715-4761-8886-fd85510d575a None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:20.079548 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-409c5e07-4715-4761-8886-fd85510d575a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:20.084590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:20.099981 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409c5e07-4715-4761-8886-fd85510d575a None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:20.106546 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d31407-bed8-4162-a625-c3d7e967238b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:20.108337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d31407-bed8-4162-a625-c3d7e967238b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:20.108674 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d31407-bed8-4162-a625-c3d7e967238b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:20.113161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d31407-bed8-4162-a625-c3d7e967238b admin admin] PATH_INFO: `/v3/projects/39823d93f4fb47e19489d79393585076` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:20.113161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d31407-bed8-4162-a625-c3d7e967238b admin admin] RBAC: Authorizing `identity:delete_project(project_id=39823d93f4fb47e19489d79393585076)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:20.113161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d31407-bed8-4162-a625-c3d7e967238b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:20.276256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-52d31407-bed8-4162-a625-c3d7e967238b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39823d93f4fb47e19489d79393585076', 'request_id': 'req-52d31407-bed8-4162-a625-c3d7e967238b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:20.285010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-52d31407-bed8-4162-a625-c3d7e967238b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39823d93f4fb47e19489d79393585076', 'request_id': 'req-52d31407-bed8-4162-a625-c3d7e967238b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:20.297854 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-52d31407-bed8-4162-a625-c3d7e967238b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39823d93f4fb47e19489d79393585076', 'request_id': 'req-52d31407-bed8-4162-a625-c3d7e967238b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:20.389270 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-52d31407-bed8-4162-a625-c3d7e967238b admin admin] The token cache is being invalidate because project 39823d93f4fb47e19489d79393585076 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:40:20.389727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-52d31407-bed8-4162-a625-c3d7e967238b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:20.390849 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-52d31407-bed8-4162-a625-c3d7e967238b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:40:20.409808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1232/2455] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:40:20 2022] DELETE /identity/v3/projects/39823d93f4fb47e19489d79393585076 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:40:20.521363 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:20.586502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:20.868166 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:20.968954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:21.483787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:21.566083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:22.001163 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:22.088076 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:24.816770 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:25.090465 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:25.663802 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:25.702567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:26.050693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:26.132840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:26.336412 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:26.750252 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:26.959290 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:27.035448 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:27.393103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:27.458155 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:27.616608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:27.653103 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:27.770852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:27.802378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:28.109784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:28.189841 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:28.699544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:28.839535 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:29.576553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:29.605354 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:29.973003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:30.001890 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:30.235252 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:DELETE=9,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:30.373280 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:31.024127 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:31.132948 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:31.305199 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:31.613046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:31.641445 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:32.051657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:32.161664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:32.913690 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:33.203059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:33.333181 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:33.812325 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:33.817946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2bd5b-04ee-49d2-afd2-b655017ba3da None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:33.818242 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2bd5b-04ee-49d2-afd2-b655017ba3da None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:33.818547 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac2bd5b-04ee-49d2-afd2-b655017ba3da None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:33.820076 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1224/2456] 10.222.0.40 () {54 vars in 921 bytes} [Fri Jul 15 19:40:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:40:33.828999 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a750fde-0d16-4015-bfca-90b1b9cacbcb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:33.829432 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a750fde-0d16-4015-bfca-90b1b9cacbcb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:33.829789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a750fde-0d16-4015-bfca-90b1b9cacbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:33.851372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-7a750fde-0d16-4015-bfca-90b1b9cacbcb None None] MFA Rules not processed for user `850a32e590154968bfbbfc404450b70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:33.852731 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7a750fde-0d16-4015-bfca-90b1b9cacbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:33.916728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:33.970302 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1233/2457] 10.222.0.40 () {58 vars in 1018 bytes} [Fri Jul 15 19:40:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:33.985414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2bd5b-04ee-49d2-afd2-b655017ba3da None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:33.988093 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-bac2bd5b-04ee-49d2-afd2-b655017ba3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:34.035988 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:34.084613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac2bd5b-04ee-49d2-afd2-b655017ba3da None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:34.088969 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7857e8b-4fd7-4103-b235-e91ab3658621 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2352b5c2aa664bf0a7e321ff3a5038fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:34.089624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7857e8b-4fd7-4103-b235-e91ab3658621 service glance] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:34.089902 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7857e8b-4fd7-4103-b235-e91ab3658621 service glance] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:34.090221 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7857e8b-4fd7-4103-b235-e91ab3658621 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:34.101736 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7857e8b-4fd7-4103-b235-e91ab3658621 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:34.103339 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7857e8b-4fd7-4103-b235-e91ab3658621 service glance] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:34.115891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1225/2458] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:34.363394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:34.484820 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717dfb1-3ff2-4e9b-b618-7b0c701ee261 None None] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:34.485415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717dfb1-3ff2-4e9b-b618-7b0c701ee261 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:34.485415 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8717dfb1-3ff2-4e9b-b618-7b0c701ee261 None None] PATH_INFO: `/` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:34.487209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1234/2459] 10.222.0.40 () {54 vars in 921 bytes} [Fri Jul 15 19:40:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:40:34.492586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baada1-1d9a-4702-ad5c-ef45bcd78d3c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:34.492881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baada1-1d9a-4702-ad5c-ef45bcd78d3c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:34.493166 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baada1-1d9a-4702-ad5c-ef45bcd78d3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:34.512319 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-50baada1-1d9a-4702-ad5c-ef45bcd78d3c None None] MFA Rules not processed for user `c99418232a0848a1b7a1a73966928769`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:34.514081 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-50baada1-1d9a-4702-ad5c-ef45bcd78d3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:34.576485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1226/2460] 10.222.0.40 () {58 vars in 1018 bytes} [Fri Jul 15 19:40:34 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:34.589234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717dfb1-3ff2-4e9b-b618-7b0c701ee261 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:34.591916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8717dfb1-3ff2-4e9b-b618-7b0c701ee261 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:34.608409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8717dfb1-3ff2-4e9b-b618-7b0c701ee261 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:34.612389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-102a5ff0-0968-4163-9713-a257defa191e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:34.612977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a5ff0-0968-4163-9713-a257defa191e service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:34.613450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a5ff0-0968-4163-9713-a257defa191e service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:34.614565 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-102a5ff0-0968-4163-9713-a257defa191e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:34.623418 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a5ff0-0968-4163-9713-a257defa191e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:34.625709 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-102a5ff0-0968-4163-9713-a257defa191e service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:34.636305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1235/2461] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:34.741309 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be6be2-11d9-4c93-a7f4-691e80700267 None None] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:34.741604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be6be2-11d9-4c93-a7f4-691e80700267 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:34.742027 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92be6be2-11d9-4c93-a7f4-691e80700267 None None] PATH_INFO: `/` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:34.743730 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1227/2462] 10.222.0.40 () {54 vars in 921 bytes} [Fri Jul 15 19:40:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 15 19:40:34.750043 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bbeca-c1a1-43df-b207-76b19e554847 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:34.750332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bbeca-c1a1-43df-b207-76b19e554847 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:34.750611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078bbeca-c1a1-43df-b207-76b19e554847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:34.773345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-078bbeca-c1a1-43df-b207-76b19e554847 None None] MFA Rules not processed for user `850a32e590154968bfbbfc404450b70a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:34.774687 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-078bbeca-c1a1-43df-b207-76b19e554847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:34.786984 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1236/2463] 10.222.0.40 () {58 vars in 1018 bytes} [Fri Jul 15 19:40:34 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:34.799403 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be6be2-11d9-4c93-a7f4-691e80700267 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:34.811537 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92be6be2-11d9-4c93-a7f4-691e80700267 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:34.815434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1df480-d3ea-476b-9113-54840559a429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:34.816138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1df480-d3ea-476b-9113-54840559a429 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:34.817587 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1df480-d3ea-476b-9113-54840559a429 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:34.817587 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1df480-d3ea-476b-9113-54840559a429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:34.830356 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1df480-d3ea-476b-9113-54840559a429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:34.831859 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1df480-d3ea-476b-9113-54840559a429 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:34.835485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:34.851581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1228/2464] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:35.112491 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:35.943320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:36.984740 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:37.271323 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481a77b-45d0-4963-8747-1c34fb7120b7 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:37.271848 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481a77b-45d0-4963-8747-1c34fb7120b7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:37.271968 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481a77b-45d0-4963-8747-1c34fb7120b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:37.290105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-f481a77b-45d0-4963-8747-1c34fb7120b7 None None] MFA Rules not processed for user `efaba747710744f59d77350e6f78f18b`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:37.291421 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f481a77b-45d0-4963-8747-1c34fb7120b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:37.356555 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1237/2465] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:40:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:37.687761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:37.772572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:38.178560 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:38.650911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:38.812479 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:39.428872 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:39.831579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1df480-d3ea-476b-9113-54840559a429 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:39.840936 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1df480-d3ea-476b-9113-54840559a429 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:39.844853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cd13b-52b3-41b1-b62b-20e921ad6e7a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:39.845445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cd13b-52b3-41b1-b62b-20e921ad6e7a service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:39.845725 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cd13b-52b3-41b1-b62b-20e921ad6e7a service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:39.846023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974cd13b-52b3-41b1-b62b-20e921ad6e7a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:39.848019 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-974cd13b-52b3-41b1-b62b-20e921ad6e7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:39.919596 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974cd13b-52b3-41b1-b62b-20e921ad6e7a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:39.921135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974cd13b-52b3-41b1-b62b-20e921ad6e7a service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:39.931435 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1229/2466] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:40:39 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:40:40.009589 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565f9fd-087a-4768-84da-74a83210722e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:40.010109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565f9fd-087a-4768-84da-74a83210722e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:40.010213 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4565f9fd-087a-4768-84da-74a83210722e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:40.029384 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4565f9fd-087a-4768-84da-74a83210722e None None] MFA Rules not processed for user `deed55901c264b8da58e57c21840c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:40.031282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4565f9fd-087a-4768-84da-74a83210722e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:40.096102 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1238/2467] 10.222.0.40 () {58 vars in 1009 bytes} [Fri Jul 15 19:40:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:40.108837 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cd13b-52b3-41b1-b62b-20e921ad6e7a service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:40.110228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-974cd13b-52b3-41b1-b62b-20e921ad6e7a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:40.180990 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974cd13b-52b3-41b1-b62b-20e921ad6e7a service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:40.186177 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78caaa-22bc-40ce-8718-7bf52cb20c70 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0402e1bd20b042cdbdcb890616b22726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:40.193635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78caaa-22bc-40ce-8718-7bf52cb20c70 service swift] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:40.193635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78caaa-22bc-40ce-8718-7bf52cb20c70 service swift] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:40.193635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78caaa-22bc-40ce-8718-7bf52cb20c70 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:40.196462 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78caaa-22bc-40ce-8718-7bf52cb20c70 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:40.198066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78caaa-22bc-40ce-8718-7bf52cb20c70 service swift] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:40.213488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1230/2468] 10.222.0.40 () {60 vars in 1384 bytes} [Fri Jul 15 19:40:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:40:41.273801 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:41.773059 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:42.549932 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:42.612991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:44.801370 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:54.892461 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=40 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:55.179080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=9 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:40:56.145442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8dbe0-f769-4ff6-8b58-3bb52015ea14 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:56.146566 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8dbe0-f769-4ff6-8b58-3bb52015ea14 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:56.147031 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8dbe0-f769-4ff6-8b58-3bb52015ea14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:56.167498 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e7a8dbe0-f769-4ff6-8b58-3bb52015ea14 None None] MFA Rules not processed for user `4e504742dcd245e5bee9a4d68a748b92`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:56.168864 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e7a8dbe0-f769-4ff6-8b58-3bb52015ea14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:56.229943 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1239/2469] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:40:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:56.901578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d849cc-0996-4ae6-9c16-183ee75f46dd None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:56.902111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d849cc-0996-4ae6-9c16-183ee75f46dd None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:56.902206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d849cc-0996-4ae6-9c16-183ee75f46dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:56.922930 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-70d849cc-0996-4ae6-9c16-183ee75f46dd None None] MFA Rules not processed for user `deed55901c264b8da58e57c21840c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:40:56.924214 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-70d849cc-0996-4ae6-9c16-183ee75f46dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:40:56.931726 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1231/2470] 10.222.0.40 () {58 vars in 967 bytes} [Fri Jul 15 19:40:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:40:56.955522 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8dbe0-f769-4ff6-8b58-3bb52015ea14 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:40:56.968046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8dbe0-f769-4ff6-8b58-3bb52015ea14 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:40:56.973168 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817b07f-745d-4fd1-abfb-7ef251146af8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0402e1bd20b042cdbdcb890616b22726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:40:56.973879 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817b07f-745d-4fd1-abfb-7ef251146af8 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:40:56.974231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817b07f-745d-4fd1-abfb-7ef251146af8 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:40:56.974578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5817b07f-745d-4fd1-abfb-7ef251146af8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:40:56.985170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817b07f-745d-4fd1-abfb-7ef251146af8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:40:56.986803 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5817b07f-745d-4fd1-abfb-7ef251146af8 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:40:57.004719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1240/2471] 10.222.0.40 () {60 vars in 1384 bytes} [Fri Jul 15 19:40:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:41:06.916936 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:06.992509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=31 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:41:51.824222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b6f8b-d241-46a5-8b04-604e25299771 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:51.824780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b6f8b-d241-46a5-8b04-604e25299771 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:51.824780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b6f8b-d241-46a5-8b04-604e25299771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:51.843373 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-bd2b6f8b-d241-46a5-8b04-604e25299771 None None] MFA Rules not processed for user `9a1371db30294725bead27951b6cdb25`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:41:51.844637 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-bd2b6f8b-d241-46a5-8b04-604e25299771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:51.901030 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1232/2472] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:41:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:41:59.258068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817b07f-745d-4fd1-abfb-7ef251146af8 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:59.259627 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5817b07f-745d-4fd1-abfb-7ef251146af8 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:59.271761 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5817b07f-745d-4fd1-abfb-7ef251146af8 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:59.275530 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c08eeb-5214-4217-960f-41f8bc58e93a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:59.276171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08eeb-5214-4217-960f-41f8bc58e93a service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:59.276451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08eeb-5214-4217-960f-41f8bc58e93a service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:59.276719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c08eeb-5214-4217-960f-41f8bc58e93a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:59.278730 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-40c08eeb-5214-4217-960f-41f8bc58e93a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:59.293354 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c08eeb-5214-4217-960f-41f8bc58e93a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:59.294828 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c08eeb-5214-4217-960f-41f8bc58e93a service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:59.307458 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1241/2473] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:41:59.498162 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b6f8b-d241-46a5-8b04-604e25299771 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:41:59.508824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b6f8b-d241-46a5-8b04-604e25299771 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:41:59.512626 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a595875-8744-44a3-8fbd-04f0f5897308 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:41:59.513221 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a595875-8744-44a3-8fbd-04f0f5897308 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:41:59.513856 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a595875-8744-44a3-8fbd-04f0f5897308 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:41:59.514303 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a595875-8744-44a3-8fbd-04f0f5897308 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:41:59.516158 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2a595875-8744-44a3-8fbd-04f0f5897308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:41:59.531192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a595875-8744-44a3-8fbd-04f0f5897308 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:41:59.532625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a595875-8744-44a3-8fbd-04f0f5897308 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:41:59.545836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1233/2474] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:41:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:42:07.116182 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c08eeb-5214-4217-960f-41f8bc58e93a service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:07.125147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c08eeb-5214-4217-960f-41f8bc58e93a service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:07.129115 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86d6471a-b2b5-4f19-8f20-fa40d08a5fc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:07.129799 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6471a-b2b5-4f19-8f20-fa40d08a5fc8 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:07.130118 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6471a-b2b5-4f19-8f20-fa40d08a5fc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:07.130394 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86d6471a-b2b5-4f19-8f20-fa40d08a5fc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:07.133204 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-86d6471a-b2b5-4f19-8f20-fa40d08a5fc8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:07.202709 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6471a-b2b5-4f19-8f20-fa40d08a5fc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:07.204304 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86d6471a-b2b5-4f19-8f20-fa40d08a5fc8 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:07.214531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1242/2475] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:42:09.540333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=31 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:13.853969 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a595875-8744-44a3-8fbd-04f0f5897308 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:13.855437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2a595875-8744-44a3-8fbd-04f0f5897308 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:13.870300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a595875-8744-44a3-8fbd-04f0f5897308 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:13.874887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02fdb0-2614-449c-a396-86daab9b224b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:13.875762 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02fdb0-2614-449c-a396-86daab9b224b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:13.876063 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02fdb0-2614-449c-a396-86daab9b224b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:13.876341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d02fdb0-2614-449c-a396-86daab9b224b admin admin] PATH_INFO: `/v3/users/4e504742dcd245e5bee9a4d68a748b92` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:13.877554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02fdb0-2614-449c-a396-86daab9b224b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e504742dcd245e5bee9a4d68a748b92)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:13.879784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d02fdb0-2614-449c-a396-86daab9b224b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:14.133822 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7d02fdb0-2614-449c-a396-86daab9b224b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e504742dcd245e5bee9a4d68a748b92'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:14.134613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7d02fdb0-2614-449c-a396-86daab9b224b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e504742dcd245e5bee9a4d68a748b92'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:14.274532 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7d02fdb0-2614-449c-a396-86daab9b224b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e504742dcd245e5bee9a4d68a748b92'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:14.275395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7d02fdb0-2614-449c-a396-86daab9b224b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e504742dcd245e5bee9a4d68a748b92'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:14.305508 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7d02fdb0-2614-449c-a396-86daab9b224b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e504742dcd245e5bee9a4d68a748b92'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:14.320455 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1234/2476] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:42:13 2022] DELETE /identity/v3/users/4e504742dcd245e5bee9a4d68a748b92 => generated 0 bytes in 467 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:14.516941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbe022-3742-4d1b-9e46-4291d99b649b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:14.517510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbe022-3742-4d1b-9e46-4291d99b649b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:14.517510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fbe022-3742-4d1b-9e46-4291d99b649b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:14.536551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a3fbe022-3742-4d1b-9e46-4291d99b649b None None] MFA Rules not processed for user `efaba747710744f59d77350e6f78f18b`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:14.538559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a3fbe022-3742-4d1b-9e46-4291d99b649b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:14.589025 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02fdb0-2614-449c-a396-86daab9b224b admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:14.596637 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-7d02fdb0-2614-449c-a396-86daab9b224b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:14.608019 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1243/2477] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:42:14 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:14.713605 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d02fdb0-2614-449c-a396-86daab9b224b admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:14.718260 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df5108-d030-4177-a764-716e4a62676b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:14.719193 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df5108-d030-4177-a764-716e4a62676b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:14.719431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df5108-d030-4177-a764-716e4a62676b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:14.719912 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df5108-d030-4177-a764-716e4a62676b admin admin] PATH_INFO: `/v3/projects/37634b7d5cda4eec8d1d7a72fff05e45` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:14.721101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df5108-d030-4177-a764-716e4a62676b admin admin] RBAC: Authorizing `identity:delete_project(project_id=37634b7d5cda4eec8d1d7a72fff05e45)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:14.723222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13df5108-d030-4177-a764-716e4a62676b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:14.859687 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-13df5108-d030-4177-a764-716e4a62676b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '37634b7d5cda4eec8d1d7a72fff05e45', 'request_id': 'req-13df5108-d030-4177-a764-716e4a62676b'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:14.964585 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-13df5108-d030-4177-a764-716e4a62676b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '37634b7d5cda4eec8d1d7a72fff05e45', 'request_id': 'req-13df5108-d030-4177-a764-716e4a62676b'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:14.973013 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-13df5108-d030-4177-a764-716e4a62676b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '37634b7d5cda4eec8d1d7a72fff05e45', 'request_id': 'req-13df5108-d030-4177-a764-716e4a62676b'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:14.985496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-13df5108-d030-4177-a764-716e4a62676b admin admin] The token cache is being invalidate because project 37634b7d5cda4eec8d1d7a72fff05e45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:42:14.986057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-13df5108-d030-4177-a764-716e4a62676b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:14.986718 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-13df5108-d030-4177-a764-716e4a62676b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:14.988314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1235/2478] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:42:14 2022] DELETE /identity/v3/projects/37634b7d5cda4eec8d1d7a72fff05e45 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:14.995603 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4491b3a-8586-407b-a00c-4fa9b9d19392 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:15.001805 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4491b3a-8586-407b-a00c-4fa9b9d19392 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:15.001805 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4491b3a-8586-407b-a00c-4fa9b9d19392 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:15.015836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d4491b3a-8586-407b-a00c-4fa9b9d19392 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:15.017494 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d4491b3a-8586-407b-a00c-4fa9b9d19392 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:15.084195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1244/2479] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:42:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:15.092082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a34f4f-917d-445d-a6c2-1c1c121f8829 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:15.092374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a34f4f-917d-445d-a6c2-1c1c121f8829 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:15.092659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a34f4f-917d-445d-a6c2-1c1c121f8829 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:15.099067 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:15.113196 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-38a34f4f-917d-445d-a6c2-1c1c121f8829 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:15.114428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-38a34f4f-917d-445d-a6c2-1c1c121f8829 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:15.123775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1236/2480] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:15.128406 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4491b3a-8586-407b-a00c-4fa9b9d19392 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:15.139254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4491b3a-8586-407b-a00c-4fa9b9d19392 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:15.143848 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc075f-e243-4b3d-8128-9a0f83236e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:15.144536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc075f-e243-4b3d-8128-9a0f83236e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:15.144819 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc075f-e243-4b3d-8128-9a0f83236e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:15.145095 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebc075f-e243-4b3d-8128-9a0f83236e7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:15.145857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc075f-e243-4b3d-8128-9a0f83236e7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:42:15.146162 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc075f-e243-4b3d-8128-9a0f83236e7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:15.148309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebc075f-e243-4b3d-8128-9a0f83236e7c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:15.165300 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1245/2481] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:42:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:42:15.169589 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a34f4f-917d-445d-a6c2-1c1c121f8829 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:15.175790 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a34f4f-917d-445d-a6c2-1c1c121f8829 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:15.180609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fad1ce-e2bc-4f5e-83ee-3b297ef41f75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:15.181262 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fad1ce-e2bc-4f5e-83ee-3b297ef41f75 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:15.181540 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fad1ce-e2bc-4f5e-83ee-3b297ef41f75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:15.181810 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fad1ce-e2bc-4f5e-83ee-3b297ef41f75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:15.182525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fad1ce-e2bc-4f5e-83ee-3b297ef41f75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:15.184486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fad1ce-e2bc-4f5e-83ee-3b297ef41f75 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:15.333805 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1237/2482] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:42:15 2022] POST /identity/v3/projects => generated 375 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:42:15.338979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc075f-e243-4b3d-8128-9a0f83236e7c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:15.350715 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebc075f-e243-4b3d-8128-9a0f83236e7c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:15.361460 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:15.415000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56198b6-d70b-47d6-af53-597673f6f535 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:15.415670 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56198b6-d70b-47d6-af53-597673f6f535 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:15.415947 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56198b6-d70b-47d6-af53-597673f6f535 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:15.416216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a56198b6-d70b-47d6-af53-597673f6f535 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:15.416900 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56198b6-d70b-47d6-af53-597673f6f535 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:15.418845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a56198b6-d70b-47d6-af53-597673f6f535 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:15.492567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1246/2483] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:42:15 2022] POST /identity/v3/users => generated 288 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:42:15.497153 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fad1ce-e2bc-4f5e-83ee-3b297ef41f75 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:15.510350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fad1ce-e2bc-4f5e-83ee-3b297ef41f75 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:15.515569 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e700058-7c4f-4e3c-b178-c7a30ac27064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:15.516229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e700058-7c4f-4e3c-b178-c7a30ac27064 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:15.516511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e700058-7c4f-4e3c-b178-c7a30ac27064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:15.516785 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e700058-7c4f-4e3c-b178-c7a30ac27064 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:15.517515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e700058-7c4f-4e3c-b178-c7a30ac27064 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:15.519170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e700058-7c4f-4e3c-b178-c7a30ac27064 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:15.531394 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1238/2484] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:42:15.535704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56198b6-d70b-47d6-af53-597673f6f535 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:15.546397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a56198b6-d70b-47d6-af53-597673f6f535 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:15.551495 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235abfaf-47af-4105-a78a-ddb56659d51f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:15.552252 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235abfaf-47af-4105-a78a-ddb56659d51f admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:15.552536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235abfaf-47af-4105-a78a-ddb56659d51f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:15.552819 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235abfaf-47af-4105-a78a-ddb56659d51f admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:15.553559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235abfaf-47af-4105-a78a-ddb56659d51f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:15.555341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235abfaf-47af-4105-a78a-ddb56659d51f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:15.566530 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1247/2485] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:42:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:42:15.570891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e700058-7c4f-4e3c-b178-c7a30ac27064 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:15.582000 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e700058-7c4f-4e3c-b178-c7a30ac27064 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:15.589500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c88574-cace-4d05-ad45-c6ad68b05cf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:15.590367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c88574-cace-4d05-ad45-c6ad68b05cf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:15.590710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c88574-cace-4d05-ad45-c6ad68b05cf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:15.591245 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c88574-cace-4d05-ad45-c6ad68b05cf2 admin admin] PATH_INFO: `/v3/projects/e9a7d6626a134407b0928aac985d9aa0/users/5503d249dd3a448fb94b9b3aed87de7a/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:15.628742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c88574-cace-4d05-ad45-c6ad68b05cf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9a7d6626a134407b0928aac985d9aa0, user_id=5503d249dd3a448fb94b9b3aed87de7a, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:15.634074 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3c88574-cace-4d05-ad45-c6ad68b05cf2 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:15.726221 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1239/2486] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:42:15 2022] PUT /identity/v3/projects/e9a7d6626a134407b0928aac985d9aa0/users/5503d249dd3a448fb94b9b3aed87de7a/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:15.731631 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40105641-a7ed-48c9-a383-0d094a0d0266 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:15.732092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40105641-a7ed-48c9-a383-0d094a0d0266 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:15.732441 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40105641-a7ed-48c9-a383-0d094a0d0266 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:15.752936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-40105641-a7ed-48c9-a383-0d094a0d0266 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:15.754471 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-40105641-a7ed-48c9-a383-0d094a0d0266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:15.810527 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c88574-cace-4d05-ad45-c6ad68b05cf2 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:15.813132 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c3c88574-cace-4d05-ad45-c6ad68b05cf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:15.866802 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1248/2487] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:42:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:42:15.879480 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40105641-a7ed-48c9-a383-0d094a0d0266 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:15.882255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-40105641-a7ed-48c9-a383-0d094a0d0266 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:15.909280 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3c88574-cace-4d05-ad45-c6ad68b05cf2 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:15.917501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e4dd9-f679-4366-afaa-007ef3e88ab2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad68d871464f4b5588c22070205f159e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:15.918727 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e4dd9-f679-4366-afaa-007ef3e88ab2 service placement] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:15.919302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e4dd9-f679-4366-afaa-007ef3e88ab2 service placement] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:15.919742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872e4dd9-f679-4366-afaa-007ef3e88ab2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:15.922418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-872e4dd9-f679-4366-afaa-007ef3e88ab2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:15.945198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e4dd9-f679-4366-afaa-007ef3e88ab2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:15.946992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-872e4dd9-f679-4366-afaa-007ef3e88ab2 service placement] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:15.971972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1240/2488] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:15 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:42:16.016193 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40105641-a7ed-48c9-a383-0d094a0d0266 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:16.024056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95c5622-123b-4d10-a1db-9ce4f65df7e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:16.024863 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c5622-123b-4d10-a1db-9ce4f65df7e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:16.025744 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c5622-123b-4d10-a1db-9ce4f65df7e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:16.026185 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95c5622-123b-4d10-a1db-9ce4f65df7e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:16.039264 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c5622-123b-4d10-a1db-9ce4f65df7e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:16.040903 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95c5622-123b-4d10-a1db-9ce4f65df7e6 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:16.055583 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1249/2489] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:42:16.875511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e4dd9-f679-4366-afaa-007ef3e88ab2 service placement] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:16.877114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-872e4dd9-f679-4366-afaa-007ef3e88ab2 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:16.971572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872e4dd9-f679-4366-afaa-007ef3e88ab2 service placement] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:16.978422 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df977ec-93a7-4991-803f-175fbe771c59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:16.979232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df977ec-93a7-4991-803f-175fbe771c59 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:16.979587 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df977ec-93a7-4991-803f-175fbe771c59 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:16.979939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df977ec-93a7-4991-803f-175fbe771c59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:16.981960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1df977ec-93a7-4991-803f-175fbe771c59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:17.014135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:17.065272 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df977ec-93a7-4991-803f-175fbe771c59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:17.066948 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df977ec-93a7-4991-803f-175fbe771c59 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:17.087006 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1241/2490] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:16 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:42:21.448119 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa29542-91e1-4714-a273-19f4fdc291af None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:21.451085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa29542-91e1-4714-a273-19f4fdc291af None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:21.451085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa29542-91e1-4714-a273-19f4fdc291af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:21.475094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ffa29542-91e1-4714-a273-19f4fdc291af None None] MFA Rules not processed for user `deed55901c264b8da58e57c21840c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:21.477454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ffa29542-91e1-4714-a273-19f4fdc291af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:21.523396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:21.557358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1250/2491] 10.222.0.40 () {58 vars in 967 bytes} [Fri Jul 15 19:42:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:21.781449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df977ec-93a7-4991-803f-175fbe771c59 service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:21.783763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1df977ec-93a7-4991-803f-175fbe771c59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:21.877425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df977ec-93a7-4991-803f-175fbe771c59 service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:21.883720 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ace450-3d9b-4917-b111-f0ea42960624 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0402e1bd20b042cdbdcb890616b22726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:21.884360 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ace450-3d9b-4917-b111-f0ea42960624 service swift] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:21.884821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ace450-3d9b-4917-b111-f0ea42960624 service swift] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:21.885254 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64ace450-3d9b-4917-b111-f0ea42960624 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:21.924476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ace450-3d9b-4917-b111-f0ea42960624 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:21.926400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64ace450-3d9b-4917-b111-f0ea42960624 service swift] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:21.937391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1242/2492] 10.222.0.40 () {60 vars in 1384 bytes} [Fri Jul 15 19:42:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:42:24.389159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4a1bc-cf9f-4fd3-99ad-4527b12ae090 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:24.390066 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4a1bc-cf9f-4fd3-99ad-4527b12ae090 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:24.390350 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85d4a1bc-cf9f-4fd3-99ad-4527b12ae090 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:24.421431 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-85d4a1bc-cf9f-4fd3-99ad-4527b12ae090 None None] MFA Rules not processed for user `5503d249dd3a448fb94b9b3aed87de7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:24.423198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-85d4a1bc-cf9f-4fd3-99ad-4527b12ae090 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:24.445314 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ace450-3d9b-4917-b111-f0ea42960624 service swift] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:24.456002 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64ace450-3d9b-4917-b111-f0ea42960624 service swift] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:24.466261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df16406-830e-4836-b1e8-32c0933d0e6f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:24.468090 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df16406-830e-4836-b1e8-32c0933d0e6f service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:24.468790 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df16406-830e-4836-b1e8-32c0933d0e6f service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:24.471618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df16406-830e-4836-b1e8-32c0933d0e6f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:24.476650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3df16406-830e-4836-b1e8-32c0933d0e6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:24.497356 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df16406-830e-4836-b1e8-32c0933d0e6f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:24.501421 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df16406-830e-4836-b1e8-32c0933d0e6f service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:24.523295 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1243/2493] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:24 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:42:24.530235 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1251/2494] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:42:24 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:24.558386 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df16406-830e-4836-b1e8-32c0933d0e6f service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:24.560920 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3df16406-830e-4836-b1e8-32c0933d0e6f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:24.580480 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df16406-830e-4836-b1e8-32c0933d0e6f service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:24.586834 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3105b-2f5a-450c-9138-9cdedff80eee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:24.587578 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3105b-2f5a-450c-9138-9cdedff80eee service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:24.588032 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3105b-2f5a-450c-9138-9cdedff80eee service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:24.588185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc3105b-2f5a-450c-9138-9cdedff80eee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:24.596992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3105b-2f5a-450c-9138-9cdedff80eee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:24.598817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc3105b-2f5a-450c-9138-9cdedff80eee service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:24.623836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1244/2495] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:24 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:42:28.905398 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c9fe7-ac5b-45d6-81ec-a48fe6d3cb73 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:28.905398 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c9fe7-ac5b-45d6-81ec-a48fe6d3cb73 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:28.905974 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36c9fe7-ac5b-45d6-81ec-a48fe6d3cb73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:28.924790 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c36c9fe7-ac5b-45d6-81ec-a48fe6d3cb73 None None] MFA Rules not processed for user `5503d249dd3a448fb94b9b3aed87de7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:42:28.926348 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c36c9fe7-ac5b-45d6-81ec-a48fe6d3cb73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:28.936177 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1252/2496] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:42:28 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:42:29.495741 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3105b-2f5a-450c-9138-9cdedff80eee service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:29.497825 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-dfc3105b-2f5a-450c-9138-9cdedff80eee service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:29.521431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc3105b-2f5a-450c-9138-9cdedff80eee service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:29.528797 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e9f72-c66f-405c-b650-4103ba917687 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:29.529766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e9f72-c66f-405c-b650-4103ba917687 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:29.530107 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e9f72-c66f-405c-b650-4103ba917687 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:29.530483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-808e9f72-c66f-405c-b650-4103ba917687 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:29.532717 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-808e9f72-c66f-405c-b650-4103ba917687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:29.554916 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e9f72-c66f-405c-b650-4103ba917687 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:29.556645 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-808e9f72-c66f-405c-b650-4103ba917687 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:29.567519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1245/2497] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:29 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:42:33.703068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c9fe7-ac5b-45d6-81ec-a48fe6d3cb73 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:33.721383 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36c9fe7-ac5b-45d6-81ec-a48fe6d3cb73 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:33.733890 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d8e84-6973-4d84-9c62-9eafbc81f624 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:33.756968 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d8e84-6973-4d84-9c62-9eafbc81f624 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:33.757325 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d8e84-6973-4d84-9c62-9eafbc81f624 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:33.759065 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d8e84-6973-4d84-9c62-9eafbc81f624 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:33.776293 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-795d8e84-6973-4d84-9c62-9eafbc81f624 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:33.792182 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d8e84-6973-4d84-9c62-9eafbc81f624 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:33.793938 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d8e84-6973-4d84-9c62-9eafbc81f624 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:33.806303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1253/2498] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:42:33.980294 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e9f72-c66f-405c-b650-4103ba917687 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:33.981794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-808e9f72-c66f-405c-b650-4103ba917687 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:34.019164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-808e9f72-c66f-405c-b650-4103ba917687 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:34.031331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08c96a-6b8c-4dd2-96ba-fe85927fe5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:34.032800 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08c96a-6b8c-4dd2-96ba-fe85927fe5ea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:34.033257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08c96a-6b8c-4dd2-96ba-fe85927fe5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:34.033699 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b08c96a-6b8c-4dd2-96ba-fe85927fe5ea admin admin] PATH_INFO: `/v3/users/688899d9846f40b2b6f7fcb325d3c266` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:34.040348 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08c96a-6b8c-4dd2-96ba-fe85927fe5ea admin admin] RBAC: Authorizing `identity:delete_user(user_id=688899d9846f40b2b6f7fcb325d3c266)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:34.043933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b08c96a-6b8c-4dd2-96ba-fe85927fe5ea admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:34.429230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0b08c96a-6b8c-4dd2-96ba-fe85927fe5ea admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '688899d9846f40b2b6f7fcb325d3c266'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:34.429965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0b08c96a-6b8c-4dd2-96ba-fe85927fe5ea admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '688899d9846f40b2b6f7fcb325d3c266'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:34.507779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0b08c96a-6b8c-4dd2-96ba-fe85927fe5ea admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '688899d9846f40b2b6f7fcb325d3c266'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:34.508488 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0b08c96a-6b8c-4dd2-96ba-fe85927fe5ea admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '688899d9846f40b2b6f7fcb325d3c266'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:34.540797 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:34.540797 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0b08c96a-6b8c-4dd2-96ba-fe85927fe5ea admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '688899d9846f40b2b6f7fcb325d3c266'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:34.548804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1246/2499] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:42:33 2022] DELETE /identity/v3/users/688899d9846f40b2b6f7fcb325d3c266 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:35.016262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d8e84-6973-4d84-9c62-9eafbc81f624 service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:35.028316 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d8e84-6973-4d84-9c62-9eafbc81f624 service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:35.102501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d3d3-95bf-4ba2-9f84-9356c133baab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:35.103435 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d3d3-95bf-4ba2-9f84-9356c133baab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:35.103719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d3d3-95bf-4ba2-9f84-9356c133baab admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:35.104002 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b38d3d3-95bf-4ba2-9f84-9356c133baab admin admin] PATH_INFO: `/v3/projects/12ac1563277b404da1335ea0804d9859` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:35.105339 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d3d3-95bf-4ba2-9f84-9356c133baab admin admin] RBAC: Authorizing `identity:delete_project(project_id=12ac1563277b404da1335ea0804d9859)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:35.107541 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b38d3d3-95bf-4ba2-9f84-9356c133baab admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:35.237907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3b38d3d3-95bf-4ba2-9f84-9356c133baab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12ac1563277b404da1335ea0804d9859', 'request_id': 'req-3b38d3d3-95bf-4ba2-9f84-9356c133baab'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:35.241157 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:35.246132 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3b38d3d3-95bf-4ba2-9f84-9356c133baab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12ac1563277b404da1335ea0804d9859', 'request_id': 'req-3b38d3d3-95bf-4ba2-9f84-9356c133baab'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:35.252567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3b38d3d3-95bf-4ba2-9f84-9356c133baab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12ac1563277b404da1335ea0804d9859', 'request_id': 'req-3b38d3d3-95bf-4ba2-9f84-9356c133baab'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:35.366213 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3b38d3d3-95bf-4ba2-9f84-9356c133baab admin admin] The token cache is being invalidate because project 12ac1563277b404da1335ea0804d9859 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:42:35.366509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3b38d3d3-95bf-4ba2-9f84-9356c133baab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:35.367511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3b38d3d3-95bf-4ba2-9f84-9356c133baab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:35.369234 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1254/2500] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:42:35 2022] DELETE /identity/v3/projects/12ac1563277b404da1335ea0804d9859 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:35.375252 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08c96a-6b8c-4dd2-96ba-fe85927fe5ea admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:35.376684 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0b08c96a-6b8c-4dd2-96ba-fe85927fe5ea admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:35.402794 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b08c96a-6b8c-4dd2-96ba-fe85927fe5ea admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:35.468206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de76622-b489-4e61-8e9f-22d2f49fadbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:35.469133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de76622-b489-4e61-8e9f-22d2f49fadbb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:35.469633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de76622-b489-4e61-8e9f-22d2f49fadbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:35.469919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de76622-b489-4e61-8e9f-22d2f49fadbb admin admin] PATH_INFO: `/v3/users/bc0c35c600014c5987c17667eaf58418` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:35.471179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de76622-b489-4e61-8e9f-22d2f49fadbb admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0c35c600014c5987c17667eaf58418)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:35.473222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de76622-b489-4e61-8e9f-22d2f49fadbb admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:35.777958 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8de76622-b489-4e61-8e9f-22d2f49fadbb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0c35c600014c5987c17667eaf58418'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:35.779120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8de76622-b489-4e61-8e9f-22d2f49fadbb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0c35c600014c5987c17667eaf58418'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:35.896895 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8de76622-b489-4e61-8e9f-22d2f49fadbb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0c35c600014c5987c17667eaf58418'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:35.896895 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8de76622-b489-4e61-8e9f-22d2f49fadbb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0c35c600014c5987c17667eaf58418'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:35.911254 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8de76622-b489-4e61-8e9f-22d2f49fadbb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0c35c600014c5987c17667eaf58418'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:35.927570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1247/2501] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:42:35 2022] DELETE /identity/v3/users/bc0c35c600014c5987c17667eaf58418 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:42:36.216747 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d3d3-95bf-4ba2-9f84-9356c133baab admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:36.222093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3b38d3d3-95bf-4ba2-9f84-9356c133baab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:36.240897 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de76622-b489-4e61-8e9f-22d2f49fadbb admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:42:36.243344 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8de76622-b489-4e61-8e9f-22d2f49fadbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:36.387035 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b38d3d3-95bf-4ba2-9f84-9356c133baab admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:36.396451 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de76622-b489-4e61-8e9f-22d2f49fadbb admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:42:36.404945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099c732f-1fc6-49fb-bd65-0ee383b1430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:36.407253 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c732f-1fc6-49fb-bd65-0ee383b1430a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:36.407954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c732f-1fc6-49fb-bd65-0ee383b1430a admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:36.408864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099c732f-1fc6-49fb-bd65-0ee383b1430a admin admin] PATH_INFO: `/v3/projects/33de8101cc3340c2aa18b87b7746d2a9` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:36.411135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c732f-1fc6-49fb-bd65-0ee383b1430a admin admin] RBAC: Authorizing `identity:delete_project(project_id=33de8101cc3340c2aa18b87b7746d2a9)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:36.413714 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099c732f-1fc6-49fb-bd65-0ee383b1430a admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:36.429749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:36.479729 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a70d1-da43-4799-b842-194056a2b1dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:42:36.480945 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a70d1-da43-4799-b842-194056a2b1dc service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:42:36.481576 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a70d1-da43-4799-b842-194056a2b1dc service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:42:36.482120 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9a70d1-da43-4799-b842-194056a2b1dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:42:36.485623 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0f9a70d1-da43-4799-b842-194056a2b1dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:42:36.511367 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a70d1-da43-4799-b842-194056a2b1dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:42:36.513499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9a70d1-da43-4799-b842-194056a2b1dc service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:42:36.529857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1255/2502] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:42:36 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:42:36.564780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-099c732f-1fc6-49fb-bd65-0ee383b1430a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33de8101cc3340c2aa18b87b7746d2a9', 'request_id': 'req-099c732f-1fc6-49fb-bd65-0ee383b1430a'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:36.649803 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-099c732f-1fc6-49fb-bd65-0ee383b1430a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33de8101cc3340c2aa18b87b7746d2a9', 'request_id': 'req-099c732f-1fc6-49fb-bd65-0ee383b1430a'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:36.658905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-099c732f-1fc6-49fb-bd65-0ee383b1430a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33de8101cc3340c2aa18b87b7746d2a9', 'request_id': 'req-099c732f-1fc6-49fb-bd65-0ee383b1430a'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:36.671210 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-099c732f-1fc6-49fb-bd65-0ee383b1430a admin admin] The token cache is being invalidate because project 33de8101cc3340c2aa18b87b7746d2a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:42:36.671493 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-099c732f-1fc6-49fb-bd65-0ee383b1430a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:36.672152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-099c732f-1fc6-49fb-bd65-0ee383b1430a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:42:36.673857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1248/2503] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:42:36 2022] DELETE /identity/v3/projects/33de8101cc3340c2aa18b87b7746d2a9 => generated 0 bytes in 435 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:42:46.521521 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=67,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:42:46.688541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=21,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:19.153789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a70d1-da43-4799-b842-194056a2b1dc service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:19.155398 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0f9a70d1-da43-4799-b842-194056a2b1dc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:19.169573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9a70d1-da43-4799-b842-194056a2b1dc service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:19.237561 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f972dd-7f90-4ff5-a728-f46baf2db56b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:19.238211 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f972dd-7f90-4ff5-a728-f46baf2db56b service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:19.238501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f972dd-7f90-4ff5-a728-f46baf2db56b service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:19.238943 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f972dd-7f90-4ff5-a728-f46baf2db56b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:19.240769 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e1f972dd-7f90-4ff5-a728-f46baf2db56b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:19.253962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f972dd-7f90-4ff5-a728-f46baf2db56b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:19.255682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f972dd-7f90-4ff5-a728-f46baf2db56b service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:19.267226 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1256/2504] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:19 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:43:19.547813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06226c-842e-4e53-8423-221a75ef50d0 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:19.548297 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06226c-842e-4e53-8423-221a75ef50d0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:19.548402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06226c-842e-4e53-8423-221a75ef50d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:19.567937 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-6e06226c-842e-4e53-8423-221a75ef50d0 None None] MFA Rules not processed for user `deed55901c264b8da58e57c21840c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:19.569233 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6e06226c-842e-4e53-8423-221a75ef50d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:19.627497 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1249/2505] 10.222.0.40 () {58 vars in 1009 bytes} [Fri Jul 15 19:43:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:19.640131 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f972dd-7f90-4ff5-a728-f46baf2db56b service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:19.641547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e1f972dd-7f90-4ff5-a728-f46baf2db56b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:19.721111 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f972dd-7f90-4ff5-a728-f46baf2db56b service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:19.727633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f69996-713b-4447-b1bf-95f46f97d851 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0402e1bd20b042cdbdcb890616b22726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:19.728285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f69996-713b-4447-b1bf-95f46f97d851 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:19.728572 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f69996-713b-4447-b1bf-95f46f97d851 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:19.729493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f69996-713b-4447-b1bf-95f46f97d851 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:19.739739 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f69996-713b-4447-b1bf-95f46f97d851 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:19.746382 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f69996-713b-4447-b1bf-95f46f97d851 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:19.750826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1257/2506] 10.222.0.40 () {60 vars in 1384 bytes} [Fri Jul 15 19:43:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:43:29.185185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06226c-842e-4e53-8423-221a75ef50d0 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:29.186699 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6e06226c-842e-4e53-8423-221a75ef50d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:29.207135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06226c-842e-4e53-8423-221a75ef50d0 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:29.215721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97877ecd-32a4-48d6-ade2-b3be063d3671 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:29.216703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97877ecd-32a4-48d6-ade2-b3be063d3671 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:29.216989 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97877ecd-32a4-48d6-ade2-b3be063d3671 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:29.217259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97877ecd-32a4-48d6-ade2-b3be063d3671 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:29.219258 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-97877ecd-32a4-48d6-ade2-b3be063d3671 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:29.309865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97877ecd-32a4-48d6-ade2-b3be063d3671 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:29.312034 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97877ecd-32a4-48d6-ade2-b3be063d3671 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:29.323328 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1250/2507] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:29 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:43:29.750801 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=66 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:35.747333 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f69996-713b-4447-b1bf-95f46f97d851 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:35.748862 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e5f69996-713b-4447-b1bf-95f46f97d851 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:35.808879 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f69996-713b-4447-b1bf-95f46f97d851 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:35.812591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d35df7-5de6-4994-8c8c-3f4bd874cf5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:35.813239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d35df7-5de6-4994-8c8c-3f4bd874cf5c service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:35.813553 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d35df7-5de6-4994-8c8c-3f4bd874cf5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:35.813834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d35df7-5de6-4994-8c8c-3f4bd874cf5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:35.815706 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-14d35df7-5de6-4994-8c8c-3f4bd874cf5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:35.899825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d35df7-5de6-4994-8c8c-3f4bd874cf5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:35.901463 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14d35df7-5de6-4994-8c8c-3f4bd874cf5c service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:35.911880 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1258/2508] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:43:39.318468 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=53 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:40.059370 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97877ecd-32a4-48d6-ade2-b3be063d3671 service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:40.061418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-97877ecd-32a4-48d6-ade2-b3be063d3671 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:40.144927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97877ecd-32a4-48d6-ade2-b3be063d3671 service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:40.150222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c821e72a-1523-4c66-9b0c-cc80bf863574 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad68d871464f4b5588c22070205f159e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:40.150968 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821e72a-1523-4c66-9b0c-cc80bf863574 service placement] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:40.151465 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821e72a-1523-4c66-9b0c-cc80bf863574 service placement] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:40.151709 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c821e72a-1523-4c66-9b0c-cc80bf863574 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:40.153743 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c821e72a-1523-4c66-9b0c-cc80bf863574 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:40.167698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821e72a-1523-4c66-9b0c-cc80bf863574 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:40.169364 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c821e72a-1523-4c66-9b0c-cc80bf863574 service placement] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:40.179757 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d35df7-5de6-4994-8c8c-3f4bd874cf5c service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:40.183292 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-14d35df7-5de6-4994-8c8c-3f4bd874cf5c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:40.188390 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1251/2509] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:43:40.208481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d35df7-5de6-4994-8c8c-3f4bd874cf5c service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:40.212961 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b46d2-94cd-48b3-aea2-1ac803b98542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:40.224653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b46d2-94cd-48b3-aea2-1ac803b98542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:40.224653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b46d2-94cd-48b3-aea2-1ac803b98542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:40.224653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93b46d2-94cd-48b3-aea2-1ac803b98542 admin admin] PATH_INFO: `/v3/users/efaba747710744f59d77350e6f78f18b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:40.224653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b46d2-94cd-48b3-aea2-1ac803b98542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=efaba747710744f59d77350e6f78f18b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:40.224653 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93b46d2-94cd-48b3-aea2-1ac803b98542 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:40.412369 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f93b46d2-94cd-48b3-aea2-1ac803b98542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'efaba747710744f59d77350e6f78f18b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:40.426025 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f93b46d2-94cd-48b3-aea2-1ac803b98542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'efaba747710744f59d77350e6f78f18b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:40.426893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f93b46d2-94cd-48b3-aea2-1ac803b98542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'efaba747710744f59d77350e6f78f18b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:40.427570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f93b46d2-94cd-48b3-aea2-1ac803b98542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'efaba747710744f59d77350e6f78f18b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:40.435376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f93b46d2-94cd-48b3-aea2-1ac803b98542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'efaba747710744f59d77350e6f78f18b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:40.530639 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1259/2510] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:43:40 2022] DELETE /identity/v3/users/efaba747710744f59d77350e6f78f18b => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:43:40.742697 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4895f1-77bf-4df6-acf1-13eb9591686a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:40.743211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4895f1-77bf-4df6-acf1-13eb9591686a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:40.743383 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e4895f1-77bf-4df6-acf1-13eb9591686a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:40.761157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-8e4895f1-77bf-4df6-acf1-13eb9591686a None None] MFA Rules not processed for user `deed55901c264b8da58e57c21840c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:40.764852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8e4895f1-77bf-4df6-acf1-13eb9591686a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:40.796821 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b46d2-94cd-48b3-aea2-1ac803b98542 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:40.802063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-f93b46d2-94cd-48b3-aea2-1ac803b98542 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:40.829361 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1252/2511] 10.222.0.40 () {58 vars in 1009 bytes} [Fri Jul 15 19:43:40 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:40.844716 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4895f1-77bf-4df6-acf1-13eb9591686a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:40.846235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8e4895f1-77bf-4df6-acf1-13eb9591686a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:40.874301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:40.925153 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93b46d2-94cd-48b3-aea2-1ac803b98542 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:40.931651 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67052fe-d01c-4888-99d8-d166c8d2ddfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:40.933553 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67052fe-d01c-4888-99d8-d166c8d2ddfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:40.933967 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67052fe-d01c-4888-99d8-d166c8d2ddfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:40.934332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67052fe-d01c-4888-99d8-d166c8d2ddfb admin admin] PATH_INFO: `/v3/projects/2cd8c41c1c514dd3befc4ffff1ad52e5` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:40.936204 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67052fe-d01c-4888-99d8-d166c8d2ddfb admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cd8c41c1c514dd3befc4ffff1ad52e5)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:40.938336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b67052fe-d01c-4888-99d8-d166c8d2ddfb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:40.951895 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e4895f1-77bf-4df6-acf1-13eb9591686a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:40.957679 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1ce27c-c8be-40b5-a481-e6ab710ca850 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0402e1bd20b042cdbdcb890616b22726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:40.958471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ce27c-c8be-40b5-a481-e6ab710ca850 service swift] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:40.958778 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ce27c-c8be-40b5-a481-e6ab710ca850 service swift] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:40.959092 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1ce27c-c8be-40b5-a481-e6ab710ca850 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:40.968757 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ce27c-c8be-40b5-a481-e6ab710ca850 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:40.971169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1ce27c-c8be-40b5-a481-e6ab710ca850 service swift] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:40.981080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1253/2512] 10.222.0.40 () {60 vars in 1384 bytes} [Fri Jul 15 19:43:40 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:43:41.125422 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b67052fe-d01c-4888-99d8-d166c8d2ddfb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd8c41c1c514dd3befc4ffff1ad52e5', 'request_id': 'req-b67052fe-d01c-4888-99d8-d166c8d2ddfb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:41.132034 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b67052fe-d01c-4888-99d8-d166c8d2ddfb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd8c41c1c514dd3befc4ffff1ad52e5', 'request_id': 'req-b67052fe-d01c-4888-99d8-d166c8d2ddfb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:41.137859 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b67052fe-d01c-4888-99d8-d166c8d2ddfb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd8c41c1c514dd3befc4ffff1ad52e5', 'request_id': 'req-b67052fe-d01c-4888-99d8-d166c8d2ddfb'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:41.219155 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b67052fe-d01c-4888-99d8-d166c8d2ddfb admin admin] The token cache is being invalidate because project 2cd8c41c1c514dd3befc4ffff1ad52e5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:43:41.219871 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b67052fe-d01c-4888-99d8-d166c8d2ddfb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:41.220424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-b67052fe-d01c-4888-99d8-d166c8d2ddfb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:41.222504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1260/2513] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:43:40 2022] DELETE /identity/v3/projects/2cd8c41c1c514dd3befc4ffff1ad52e5 => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:43:41.227796 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36fd9f-9b5d-4d57-ae48-ebb46e52d5b0 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:41.228919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36fd9f-9b5d-4d57-ae48-ebb46e52d5b0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:41.230246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b36fd9f-9b5d-4d57-ae48-ebb46e52d5b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:41.249846 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-9b36fd9f-9b5d-4d57-ae48-ebb46e52d5b0 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:41.251709 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-9b36fd9f-9b5d-4d57-ae48-ebb46e52d5b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:41.275552 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:41.326122 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1254/2514] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:41.335386 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e05c2-5daf-4fd3-8351-62f2864f8624 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:41.335932 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e05c2-5daf-4fd3-8351-62f2864f8624 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:41.336505 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3e05c2-5daf-4fd3-8351-62f2864f8624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:41.399879 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1b3e05c2-5daf-4fd3-8351-62f2864f8624 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:41.401323 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1b3e05c2-5daf-4fd3-8351-62f2864f8624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:41.419973 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1261/2515] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:41.424358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36fd9f-9b5d-4d57-ae48-ebb46e52d5b0 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:41.436735 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b36fd9f-9b5d-4d57-ae48-ebb46e52d5b0 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:41.448450 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec60c5-8ba7-4cd8-b4bc-9f403635e593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:41.449571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec60c5-8ba7-4cd8-b4bc-9f403635e593 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:41.450047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec60c5-8ba7-4cd8-b4bc-9f403635e593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:41.450475 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ec60c5-8ba7-4cd8-b4bc-9f403635e593 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:41.456809 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec60c5-8ba7-4cd8-b4bc-9f403635e593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:43:41.457391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec60c5-8ba7-4cd8-b4bc-9f403635e593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:41.459827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ec60c5-8ba7-4cd8-b4bc-9f403635e593 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:41.488326 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e05c2-5daf-4fd3-8351-62f2864f8624 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:41.492964 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1255/2516] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:43:41.506241 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3e05c2-5daf-4fd3-8351-62f2864f8624 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:41.513757 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8b1d0-17cb-41f4-8015-1213106140e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:41.514432 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8b1d0-17cb-41f4-8015-1213106140e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:41.514708 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8b1d0-17cb-41f4-8015-1213106140e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:41.515011 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9e8b1d0-17cb-41f4-8015-1213106140e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:41.516962 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8b1d0-17cb-41f4-8015-1213106140e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:41.520488 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9e8b1d0-17cb-41f4-8015-1213106140e1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:41.640898 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1262/2517] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:43:41 2022] POST /identity/v3/projects => generated 385 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:43:41.641800 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec60c5-8ba7-4cd8-b4bc-9f403635e593 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:41.654792 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ec60c5-8ba7-4cd8-b4bc-9f403635e593 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:41.730203 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a205e-ce00-43ab-a5e4-bb9b4ea1c882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:41.730915 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a205e-ce00-43ab-a5e4-bb9b4ea1c882 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:41.735216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a205e-ce00-43ab-a5e4-bb9b4ea1c882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:41.735838 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730a205e-ce00-43ab-a5e4-bb9b4ea1c882 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:41.737531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a205e-ce00-43ab-a5e4-bb9b4ea1c882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:41.740786 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730a205e-ce00-43ab-a5e4-bb9b4ea1c882 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:41.844945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1256/2518] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:43:41 2022] POST /identity/v3/users => generated 293 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:43:41.849553 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8b1d0-17cb-41f4-8015-1213106140e1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:41.860936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9e8b1d0-17cb-41f4-8015-1213106140e1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:41.866170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e332f-4c5c-4be8-bde1-db50656a2424 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:41.871107 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e332f-4c5c-4be8-bde1-db50656a2424 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:41.871490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e332f-4c5c-4be8-bde1-db50656a2424 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:41.871797 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4e332f-4c5c-4be8-bde1-db50656a2424 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:41.872605 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e332f-4c5c-4be8-bde1-db50656a2424 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:41.874275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4e332f-4c5c-4be8-bde1-db50656a2424 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:41.886700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1263/2519] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:43:41.890840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a205e-ce00-43ab-a5e4-bb9b4ea1c882 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:41.901901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730a205e-ce00-43ab-a5e4-bb9b4ea1c882 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:41.906551 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a0d6fd-72e9-43bf-aa12-13030101a83c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:41.907335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0d6fd-72e9-43bf-aa12-13030101a83c admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:41.907691 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0d6fd-72e9-43bf-aa12-13030101a83c admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:41.908056 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a0d6fd-72e9-43bf-aa12-13030101a83c admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:41.909156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0d6fd-72e9-43bf-aa12-13030101a83c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:41.913110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a0d6fd-72e9-43bf-aa12-13030101a83c admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:41.926847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1257/2520] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:43:41 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:43:41.928004 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e332f-4c5c-4be8-bde1-db50656a2424 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:41.939849 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4e332f-4c5c-4be8-bde1-db50656a2424 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:41.944386 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937d925-9a7b-43ba-be1a-cc1bd7fd4ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:41.945320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937d925-9a7b-43ba-be1a-cc1bd7fd4ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:41.945602 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937d925-9a7b-43ba-be1a-cc1bd7fd4ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:41.945878 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3937d925-9a7b-43ba-be1a-cc1bd7fd4ebd admin admin] PATH_INFO: `/v3/projects/404dd87648804b1c83fefa76e0c55e40/users/7b60c6b2169c4232a3e6a89f1d3264c0/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:41.965396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937d925-9a7b-43ba-be1a-cc1bd7fd4ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=404dd87648804b1c83fefa76e0c55e40, user_id=7b60c6b2169c4232a3e6a89f1d3264c0, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:41.968171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3937d925-9a7b-43ba-be1a-cc1bd7fd4ebd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:42.042300 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1264/2521] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:43:41 2022] PUT /identity/v3/projects/404dd87648804b1c83fefa76e0c55e40/users/7b60c6b2169c4232a3e6a89f1d3264c0/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:43:42.053657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789663b-ffb8-4915-a455-ab3ea6ba7589 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:42.054004 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789663b-ffb8-4915-a455-ab3ea6ba7589 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:42.054812 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6789663b-ffb8-4915-a455-ab3ea6ba7589 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:42.113600 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-6789663b-ffb8-4915-a455-ab3ea6ba7589 None None] MFA Rules not processed for user `7b60c6b2169c4232a3e6a89f1d3264c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:42.114958 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6789663b-ffb8-4915-a455-ab3ea6ba7589 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:42.230232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1258/2522] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:43:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:42.382331 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937d925-9a7b-43ba-be1a-cc1bd7fd4ebd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:42.393425 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3937d925-9a7b-43ba-be1a-cc1bd7fd4ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:42.454346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:42.485355 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3937d925-9a7b-43ba-be1a-cc1bd7fd4ebd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:42.491923 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec932b2c-01ca-4ab0-8682-3b4cd4560009 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:42.492616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec932b2c-01ca-4ab0-8682-3b4cd4560009 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:42.492909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec932b2c-01ca-4ab0-8682-3b4cd4560009 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:42.493337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec932b2c-01ca-4ab0-8682-3b4cd4560009 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:42.503568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec932b2c-01ca-4ab0-8682-3b4cd4560009 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:42.505379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec932b2c-01ca-4ab0-8682-3b4cd4560009 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:42.516128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1265/2523] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:42 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:43:49.269095 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789663b-ffb8-4915-a455-ab3ea6ba7589 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:49.290615 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:49.333663 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6789663b-ffb8-4915-a455-ab3ea6ba7589 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:49.339159 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99019387-2767-4eb9-b0af-a9dc4bbf4ecd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:49.340059 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99019387-2767-4eb9-b0af-a9dc4bbf4ecd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:49.340340 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99019387-2767-4eb9-b0af-a9dc4bbf4ecd admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:49.340612 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99019387-2767-4eb9-b0af-a9dc4bbf4ecd admin admin] PATH_INFO: `/v3/users/7b60c6b2169c4232a3e6a89f1d3264c0` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:49.341919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99019387-2767-4eb9-b0af-a9dc4bbf4ecd admin admin] RBAC: Authorizing `identity:delete_user(user_id=7b60c6b2169c4232a3e6a89f1d3264c0)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:49.344142 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99019387-2767-4eb9-b0af-a9dc4bbf4ecd admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:49.565259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-99019387-2767-4eb9-b0af-a9dc4bbf4ecd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7b60c6b2169c4232a3e6a89f1d3264c0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:49.565840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-99019387-2767-4eb9-b0af-a9dc4bbf4ecd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7b60c6b2169c4232a3e6a89f1d3264c0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:49.649556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-99019387-2767-4eb9-b0af-a9dc4bbf4ecd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7b60c6b2169c4232a3e6a89f1d3264c0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:49.650203 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-99019387-2767-4eb9-b0af-a9dc4bbf4ecd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7b60c6b2169c4232a3e6a89f1d3264c0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:49.663577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-99019387-2767-4eb9-b0af-a9dc4bbf4ecd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7b60c6b2169c4232a3e6a89f1d3264c0'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:49.676711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1259/2524] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:43:49 2022] DELETE /identity/v3/users/7b60c6b2169c4232a3e6a89f1d3264c0 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:43:49.681203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27fada-7712-46ae-a144-44ed8a5e3996 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:49.681692 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27fada-7712-46ae-a144-44ed8a5e3996 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:49.681808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf27fada-7712-46ae-a144-44ed8a5e3996 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:49.702058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-cf27fada-7712-46ae-a144-44ed8a5e3996 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:49.703305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cf27fada-7712-46ae-a144-44ed8a5e3996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:49.774603 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1266/2525] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:43:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:49.784519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99019387-2767-4eb9-b0af-a9dc4bbf4ecd admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:49.786013 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-99019387-2767-4eb9-b0af-a9dc4bbf4ecd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:49.849319 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99019387-2767-4eb9-b0af-a9dc4bbf4ecd admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:49.852880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66022b72-70a6-4a80-b154-1cf6e11a848e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:49.854699 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66022b72-70a6-4a80-b154-1cf6e11a848e service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:49.854699 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66022b72-70a6-4a80-b154-1cf6e11a848e service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:49.854699 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66022b72-70a6-4a80-b154-1cf6e11a848e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:49.864216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66022b72-70a6-4a80-b154-1cf6e11a848e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:49.865649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66022b72-70a6-4a80-b154-1cf6e11a848e service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:49.876373 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1260/2526] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:43:50.350690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27fada-7712-46ae-a144-44ed8a5e3996 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:50.350690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cf27fada-7712-46ae-a144-44ed8a5e3996 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:50.363433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf27fada-7712-46ae-a144-44ed8a5e3996 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:50.371900 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fbf66c-684e-4c6c-8452-39e0188172b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:50.378379 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbf66c-684e-4c6c-8452-39e0188172b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:50.386633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbf66c-684e-4c6c-8452-39e0188172b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:50.386633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fbf66c-684e-4c6c-8452-39e0188172b8 admin admin] PATH_INFO: `/v3/projects/404dd87648804b1c83fefa76e0c55e40` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:50.386633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbf66c-684e-4c6c-8452-39e0188172b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=404dd87648804b1c83fefa76e0c55e40)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:50.388924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fbf66c-684e-4c6c-8452-39e0188172b8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:50.537405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f0fbf66c-684e-4c6c-8452-39e0188172b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '404dd87648804b1c83fefa76e0c55e40', 'request_id': 'req-f0fbf66c-684e-4c6c-8452-39e0188172b8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:50.543794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f0fbf66c-684e-4c6c-8452-39e0188172b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '404dd87648804b1c83fefa76e0c55e40', 'request_id': 'req-f0fbf66c-684e-4c6c-8452-39e0188172b8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:50.549325 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f0fbf66c-684e-4c6c-8452-39e0188172b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '404dd87648804b1c83fefa76e0c55e40', 'request_id': 'req-f0fbf66c-684e-4c6c-8452-39e0188172b8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:50.667431 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f0fbf66c-684e-4c6c-8452-39e0188172b8 admin admin] The token cache is being invalidate because project 404dd87648804b1c83fefa76e0c55e40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:43:50.667431 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f0fbf66c-684e-4c6c-8452-39e0188172b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:50.667431 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f0fbf66c-684e-4c6c-8452-39e0188172b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:43:50.669202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1267/2527] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:43:50 2022] DELETE /identity/v3/projects/404dd87648804b1c83fefa76e0c55e40 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:43:50.674083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3e2ba-531f-4228-a9f2-26c571bc3805 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:50.674625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3e2ba-531f-4228-a9f2-26c571bc3805 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:50.674766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe3e2ba-531f-4228-a9f2-26c571bc3805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:50.693526 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-cbe3e2ba-531f-4228-a9f2-26c571bc3805 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:50.694802 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-cbe3e2ba-531f-4228-a9f2-26c571bc3805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:50.736675 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:50.758522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1261/2528] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:50.766846 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88afd42-c969-4c61-91ec-0392058969df None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:50.767360 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88afd42-c969-4c61-91ec-0392058969df None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:50.767850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88afd42-c969-4c61-91ec-0392058969df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:50.788433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c88afd42-c969-4c61-91ec-0392058969df None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:50.789652 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c88afd42-c969-4c61-91ec-0392058969df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:50.802351 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1268/2529] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:43:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:50.803854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3e2ba-531f-4228-a9f2-26c571bc3805 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:50.816493 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe3e2ba-531f-4228-a9f2-26c571bc3805 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:50.822643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327267fa-7a18-4292-8e21-321fbeb372e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:50.823485 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327267fa-7a18-4292-8e21-321fbeb372e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:50.823863 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327267fa-7a18-4292-8e21-321fbeb372e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:50.824342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327267fa-7a18-4292-8e21-321fbeb372e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:50.825199 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327267fa-7a18-4292-8e21-321fbeb372e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:43:50.825830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327267fa-7a18-4292-8e21-321fbeb372e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:50.827583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-327267fa-7a18-4292-8e21-321fbeb372e8 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:50.848576 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1262/2530] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:43:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:43:50.848690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88afd42-c969-4c61-91ec-0392058969df None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:50.857176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88afd42-c969-4c61-91ec-0392058969df None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:50.862706 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90856763-15ed-44d4-81bf-be2e0f677b7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:50.863490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90856763-15ed-44d4-81bf-be2e0f677b7d admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:50.863770 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90856763-15ed-44d4-81bf-be2e0f677b7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:50.864041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90856763-15ed-44d4-81bf-be2e0f677b7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:50.864753 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90856763-15ed-44d4-81bf-be2e0f677b7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:50.866875 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90856763-15ed-44d4-81bf-be2e0f677b7d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:51.025287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1269/2531] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:43:50 2022] POST /identity/v3/projects => generated 371 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:43:51.027003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327267fa-7a18-4292-8e21-321fbeb372e8 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:51.037498 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327267fa-7a18-4292-8e21-321fbeb372e8 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:51.097321 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc34af9-6a31-4509-8a91-4021e3eec86a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:51.097992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc34af9-6a31-4509-8a91-4021e3eec86a admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:51.098272 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc34af9-6a31-4509-8a91-4021e3eec86a admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:51.098544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc34af9-6a31-4509-8a91-4021e3eec86a admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:51.099270 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc34af9-6a31-4509-8a91-4021e3eec86a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:51.101205 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc34af9-6a31-4509-8a91-4021e3eec86a admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:51.216148 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1263/2532] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:43:51 2022] POST /identity/v3/users => generated 286 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:43:51.220812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90856763-15ed-44d4-81bf-be2e0f677b7d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:51.238550 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90856763-15ed-44d4-81bf-be2e0f677b7d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:51.246163 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1baa3-a914-46db-a64d-2ee1564cbb06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:51.248001 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1baa3-a914-46db-a64d-2ee1564cbb06 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:51.248001 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1baa3-a914-46db-a64d-2ee1564cbb06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:51.248359 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad1baa3-a914-46db-a64d-2ee1564cbb06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:51.249269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1baa3-a914-46db-a64d-2ee1564cbb06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:51.251161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad1baa3-a914-46db-a64d-2ee1564cbb06 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:51.264066 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1270/2533] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:43:51.269112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc34af9-6a31-4509-8a91-4021e3eec86a admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:51.280535 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc34af9-6a31-4509-8a91-4021e3eec86a admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:51.285553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed10fed3-5b1c-4ba4-9a76-bd93dc34d4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:51.286237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10fed3-5b1c-4ba4-9a76-bd93dc34d4d0 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:51.286522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10fed3-5b1c-4ba4-9a76-bd93dc34d4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:51.286833 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed10fed3-5b1c-4ba4-9a76-bd93dc34d4d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:51.287573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10fed3-5b1c-4ba4-9a76-bd93dc34d4d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:51.289203 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed10fed3-5b1c-4ba4-9a76-bd93dc34d4d0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:51.304042 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1264/2534] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:43:51.305400 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1baa3-a914-46db-a64d-2ee1564cbb06 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:51.316851 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad1baa3-a914-46db-a64d-2ee1564cbb06 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:51.323084 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc02e55-32e7-4f4f-99c1-64720fa56e4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:51.324056 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc02e55-32e7-4f4f-99c1-64720fa56e4f admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:51.324742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc02e55-32e7-4f4f-99c1-64720fa56e4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:51.324742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc02e55-32e7-4f4f-99c1-64720fa56e4f admin admin] PATH_INFO: `/v3/projects/9f8dbedbea33466991c9fb6462ced9f2/users/99400220253d4a23b61291a55300b044/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:51.342034 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc02e55-32e7-4f4f-99c1-64720fa56e4f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9f8dbedbea33466991c9fb6462ced9f2, user_id=99400220253d4a23b61291a55300b044, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:51.344846 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc02e55-32e7-4f4f-99c1-64720fa56e4f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:51.347655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:51.473632 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1271/2535] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:43:51 2022] PUT /identity/v3/projects/9f8dbedbea33466991c9fb6462ced9f2/users/99400220253d4a23b61291a55300b044/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:43:51.484372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c0b12-3f4a-46f7-a62f-0607a2242069 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:51.484664 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c0b12-3f4a-46f7-a62f-0607a2242069 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:51.484948 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5c0b12-3f4a-46f7-a62f-0607a2242069 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:51.519269 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5a5c0b12-3f4a-46f7-a62f-0607a2242069 None None] MFA Rules not processed for user `99400220253d4a23b61291a55300b044`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:51.520416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5a5c0b12-3f4a-46f7-a62f-0607a2242069 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:51.589082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1265/2536] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:43:51 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:51.593548 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc02e55-32e7-4f4f-99c1-64720fa56e4f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:51.656638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc02e55-32e7-4f4f-99c1-64720fa56e4f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:51.661527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cbf71-bbcf-4e41-891e-44394a3d7136 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:51.662180 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cbf71-bbcf-4e41-891e-44394a3d7136 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:51.662464 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cbf71-bbcf-4e41-891e-44394a3d7136 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:51.662739 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7cbf71-bbcf-4e41-891e-44394a3d7136 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:51.663454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cbf71-bbcf-4e41-891e-44394a3d7136 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:51.665460 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7cbf71-bbcf-4e41-891e-44394a3d7136 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:51.769225 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1272/2537] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:43:51 2022] POST /identity/v3/projects => generated 373 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:43:51.770420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c0b12-3f4a-46f7-a62f-0607a2242069 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:51.782519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5c0b12-3f4a-46f7-a62f-0607a2242069 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:51.831275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:51.860046 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42786e8-46ea-4302-90e0-dca77f4dab1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:51.860738 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42786e8-46ea-4302-90e0-dca77f4dab1f admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:51.861026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42786e8-46ea-4302-90e0-dca77f4dab1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:51.861306 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42786e8-46ea-4302-90e0-dca77f4dab1f admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:51.862018 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42786e8-46ea-4302-90e0-dca77f4dab1f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:51.864073 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42786e8-46ea-4302-90e0-dca77f4dab1f admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:51.981816 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1266/2538] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:43:51 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:43:51.985705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cbf71-bbcf-4e41-891e-44394a3d7136 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:51.996588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7cbf71-bbcf-4e41-891e-44394a3d7136 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:52.001177 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5411c3-461e-4493-a1e4-d1d0c9bfddda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:52.002104 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5411c3-461e-4493-a1e4-d1d0c9bfddda admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:52.002386 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5411c3-461e-4493-a1e4-d1d0c9bfddda admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:52.002716 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5411c3-461e-4493-a1e4-d1d0c9bfddda admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:52.003421 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5411c3-461e-4493-a1e4-d1d0c9bfddda admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:52.005034 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5411c3-461e-4493-a1e4-d1d0c9bfddda admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:52.018799 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1273/2539] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:43:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:43:52.021204 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42786e8-46ea-4302-90e0-dca77f4dab1f admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:52.033608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42786e8-46ea-4302-90e0-dca77f4dab1f admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:52.038546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf960dc-0aaf-4c99-9bc5-e315bc199b1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:52.039501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf960dc-0aaf-4c99-9bc5-e315bc199b1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:52.039782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf960dc-0aaf-4c99-9bc5-e315bc199b1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:52.040088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf960dc-0aaf-4c99-9bc5-e315bc199b1c admin admin] PATH_INFO: `/v3/projects/b0cf4f4fb576488ba00bd9fa47023e6d/users/eb4af2104b0d4c8abc8b711ddfb1936e/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:52.056130 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf960dc-0aaf-4c99-9bc5-e315bc199b1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0cf4f4fb576488ba00bd9fa47023e6d, user_id=eb4af2104b0d4c8abc8b711ddfb1936e, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:52.058916 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf960dc-0aaf-4c99-9bc5-e315bc199b1c admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:52.131858 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1267/2540] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:43:52 2022] PUT /identity/v3/projects/b0cf4f4fb576488ba00bd9fa47023e6d/users/eb4af2104b0d4c8abc8b711ddfb1936e/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:43:52.136306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5411c3-461e-4493-a1e4-d1d0c9bfddda admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:52.146417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5411c3-461e-4493-a1e4-d1d0c9bfddda admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:52.202800 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac20ea11-3423-481f-8949-7e4e145f08dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:52.203473 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ea11-3423-481f-8949-7e4e145f08dd admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:52.203753 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ea11-3423-481f-8949-7e4e145f08dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:52.204051 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac20ea11-3423-481f-8949-7e4e145f08dd admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:52.204802 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20ea11-3423-481f-8949-7e4e145f08dd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:52.206389 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac20ea11-3423-481f-8949-7e4e145f08dd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:52.217236 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1274/2541] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:43:52 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:43:52.221407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf960dc-0aaf-4c99-9bc5-e315bc199b1c admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:52.231832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf960dc-0aaf-4c99-9bc5-e315bc199b1c admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:52.236493 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864d9bb-e564-40ce-a5f8-1deeeced96e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:52.237367 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d9bb-e564-40ce-a5f8-1deeeced96e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:52.237647 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d9bb-e564-40ce-a5f8-1deeeced96e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:52.237923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4864d9bb-e564-40ce-a5f8-1deeeced96e7 admin admin] PATH_INFO: `/v3/projects/b0cf4f4fb576488ba00bd9fa47023e6d/users/eb4af2104b0d4c8abc8b711ddfb1936e/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:52.239919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864d9bb-e564-40ce-a5f8-1deeeced96e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b0cf4f4fb576488ba00bd9fa47023e6d, user_id=eb4af2104b0d4c8abc8b711ddfb1936e, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:52.242590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4864d9bb-e564-40ce-a5f8-1deeeced96e7 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:52.253826 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1268/2542] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:43:52 2022] PUT /identity/v3/projects/b0cf4f4fb576488ba00bd9fa47023e6d/users/eb4af2104b0d4c8abc8b711ddfb1936e/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:43:52.265913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fda79-0137-4bf5-b438-59792e1ee224 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:52.266207 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fda79-0137-4bf5-b438-59792e1ee224 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:52.266489 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fda79-0137-4bf5-b438-59792e1ee224 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:52.295151 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-b33fda79-0137-4bf5-b438-59792e1ee224 None None] MFA Rules not processed for user `eb4af2104b0d4c8abc8b711ddfb1936e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:52.296283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-b33fda79-0137-4bf5-b438-59792e1ee224 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:52.348718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:43:52.367625 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1275/2543] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:43:52 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:52.380083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864d9bb-e564-40ce-a5f8-1deeeced96e7 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:52.382371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4864d9bb-e564-40ce-a5f8-1deeeced96e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:52.440114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4864d9bb-e564-40ce-a5f8-1deeeced96e7 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:52.443852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2808b8df-97cf-4468-af6f-60928526f73d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:52.444498 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b8df-97cf-4468-af6f-60928526f73d service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:52.444812 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b8df-97cf-4468-af6f-60928526f73d service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:52.445091 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2808b8df-97cf-4468-af6f-60928526f73d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:52.454970 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808b8df-97cf-4468-af6f-60928526f73d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:52.456401 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2808b8df-97cf-4468-af6f-60928526f73d service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:52.466134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1269/2544] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:52 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:43:52.721588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fda79-0137-4bf5-b438-59792e1ee224 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:52.732765 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fda79-0137-4bf5-b438-59792e1ee224 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:52.736549 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1277f9-dd62-465b-8878-eec83a5d6fcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:52.737040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1277f9-dd62-465b-8878-eec83a5d6fcb service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:52.737324 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1277f9-dd62-465b-8878-eec83a5d6fcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:52.737599 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1277f9-dd62-465b-8878-eec83a5d6fcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:52.795305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1277f9-dd62-465b-8878-eec83a5d6fcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:52.796743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1277f9-dd62-465b-8878-eec83a5d6fcb service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:52.805844 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1276/2545] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:43:52 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:43:56.058031 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcfd13-2658-437d-83dd-29b9373ad66c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:56.058548 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcfd13-2658-437d-83dd-29b9373ad66c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:56.058784 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1bcfd13-2658-437d-83dd-29b9373ad66c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:56.078172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-b1bcfd13-2658-437d-83dd-29b9373ad66c None None] MFA Rules not processed for user `deed55901c264b8da58e57c21840c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:43:56.079419 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b1bcfd13-2658-437d-83dd-29b9373ad66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:56.138608 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1270/2546] 10.222.0.40 () {58 vars in 967 bytes} [Fri Jul 15 19:43:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:43:56.150719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1277f9-dd62-465b-8878-eec83a5d6fcb service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:43:56.154787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9d1277f9-dd62-465b-8878-eec83a5d6fcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:43:56.239158 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1277f9-dd62-465b-8878-eec83a5d6fcb service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:43:56.254168 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e83e2-728c-43cc-aff8-0cc60d7142f4 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0402e1bd20b042cdbdcb890616b22726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:43:56.254168 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e83e2-728c-43cc-aff8-0cc60d7142f4 service swift] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:43:56.254168 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e83e2-728c-43cc-aff8-0cc60d7142f4 service swift] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:43:56.254168 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff7e83e2-728c-43cc-aff8-0cc60d7142f4 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:43:56.259718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e83e2-728c-43cc-aff8-0cc60d7142f4 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:43:56.263705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff7e83e2-728c-43cc-aff8-0cc60d7142f4 service swift] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:43:56.277594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1277/2547] 10.222.0.40 () {60 vars in 1384 bytes} [Fri Jul 15 19:43:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:44:01.714565 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcfd13-2658-437d-83dd-29b9373ad66c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:01.716033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-b1bcfd13-2658-437d-83dd-29b9373ad66c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:01.758237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:01.774545 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1bcfd13-2658-437d-83dd-29b9373ad66c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:01.779032 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e738b9-b9a9-40e7-8c21-86e1a5a27e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:01.779679 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e738b9-b9a9-40e7-8c21-86e1a5a27e32 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:01.779963 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e738b9-b9a9-40e7-8c21-86e1a5a27e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:01.780239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e738b9-b9a9-40e7-8c21-86e1a5a27e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:01.782116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-50e738b9-b9a9-40e7-8c21-86e1a5a27e32 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:01.845775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e738b9-b9a9-40e7-8c21-86e1a5a27e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:01.847155 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50e738b9-b9a9-40e7-8c21-86e1a5a27e32 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:01.857748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1271/2548] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:44:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:44:06.271946 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=65 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:09.189284 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e83e2-728c-43cc-aff8-0cc60d7142f4 service swift] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:09.190813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ff7e83e2-728c-43cc-aff8-0cc60d7142f4 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:09.210332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff7e83e2-728c-43cc-aff8-0cc60d7142f4 service swift] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:09.212532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc120784-0461-4849-9f7d-1580c1c62c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:09.214346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc120784-0461-4849-9f7d-1580c1c62c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:09.214346 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc120784-0461-4849-9f7d-1580c1c62c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:09.214633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc120784-0461-4849-9f7d-1580c1c62c5f admin admin] PATH_INFO: `/v3/users/006ea7f9977c442aa8ed8979c89a592b` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:09.215861 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc120784-0461-4849-9f7d-1580c1c62c5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=006ea7f9977c442aa8ed8979c89a592b)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:09.217810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc120784-0461-4849-9f7d-1580c1c62c5f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:09.452687 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dc120784-0461-4849-9f7d-1580c1c62c5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '006ea7f9977c442aa8ed8979c89a592b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:09.466126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dc120784-0461-4849-9f7d-1580c1c62c5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '006ea7f9977c442aa8ed8979c89a592b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:09.466929 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dc120784-0461-4849-9f7d-1580c1c62c5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '006ea7f9977c442aa8ed8979c89a592b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:09.467545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dc120784-0461-4849-9f7d-1580c1c62c5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '006ea7f9977c442aa8ed8979c89a592b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:09.475768 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dc120784-0461-4849-9f7d-1580c1c62c5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '006ea7f9977c442aa8ed8979c89a592b'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:09.558258 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1278/2549] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:44:09 2022] DELETE /identity/v3/users/006ea7f9977c442aa8ed8979c89a592b => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:09.887110 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e738b9-b9a9-40e7-8c21-86e1a5a27e32 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:09.899023 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e738b9-b9a9-40e7-8c21-86e1a5a27e32 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:09.967438 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:09.968852 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:09.969141 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:09.969422 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6 admin admin] PATH_INFO: `/v3/projects/9b10d15caef145b79d057687cf936285` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:09.970682 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b10d15caef145b79d057687cf936285)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:09.972626 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:10.109851 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b10d15caef145b79d057687cf936285', 'request_id': 'req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:10.186298 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b10d15caef145b79d057687cf936285', 'request_id': 'req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:10.193210 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b10d15caef145b79d057687cf936285', 'request_id': 'req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:10.204814 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6 admin admin] The token cache is being invalidate because project 9b10d15caef145b79d057687cf936285 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:44:10.210689 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:10.210689 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:10.210689 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1272/2550] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:44:09 2022] DELETE /identity/v3/projects/9b10d15caef145b79d057687cf936285 => generated 0 bytes in 322 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:10.211936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc120784-0461-4849-9f7d-1580c1c62c5f admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:10.214214 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dc120784-0461-4849-9f7d-1580c1c62c5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:10.228456 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc120784-0461-4849-9f7d-1580c1c62c5f admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:10.291394 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afc17c-f414-4408-b37d-80275d2dacf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:10.292430 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afc17c-f414-4408-b37d-80275d2dacf6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:10.292860 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afc17c-f414-4408-b37d-80275d2dacf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:10.293341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85afc17c-f414-4408-b37d-80275d2dacf6 admin admin] PATH_INFO: `/v3/users/8ba85170cb6e42ebb45cf12383aedc7e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:10.294873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afc17c-f414-4408-b37d-80275d2dacf6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8ba85170cb6e42ebb45cf12383aedc7e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:10.296861 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85afc17c-f414-4408-b37d-80275d2dacf6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:10.523946 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-85afc17c-f414-4408-b37d-80275d2dacf6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8ba85170cb6e42ebb45cf12383aedc7e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:10.537060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-85afc17c-f414-4408-b37d-80275d2dacf6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8ba85170cb6e42ebb45cf12383aedc7e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:10.537768 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-85afc17c-f414-4408-b37d-80275d2dacf6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8ba85170cb6e42ebb45cf12383aedc7e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:10.538364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-85afc17c-f414-4408-b37d-80275d2dacf6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8ba85170cb6e42ebb45cf12383aedc7e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:10.546224 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-85afc17c-f414-4408-b37d-80275d2dacf6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8ba85170cb6e42ebb45cf12383aedc7e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:10.547947 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:10.627729 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1279/2551] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:44:10 2022] DELETE /identity/v3/users/8ba85170cb6e42ebb45cf12383aedc7e => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:11.000128 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:11.002007 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:11.016419 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa0794-d17c-4a10-a4e9-e4dea69bbfc6 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:11.034191 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:11.084869 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276e7387-f5c2-4090-9a65-a9841a296d8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:11.085735 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e7387-f5c2-4090-9a65-a9841a296d8e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:11.086019 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e7387-f5c2-4090-9a65-a9841a296d8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:11.086300 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276e7387-f5c2-4090-9a65-a9841a296d8e admin admin] PATH_INFO: `/v3/projects/edeea1dc01d0441eae1fbfbf4a5feb92` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:11.087531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e7387-f5c2-4090-9a65-a9841a296d8e admin admin] RBAC: Authorizing `identity:delete_project(project_id=edeea1dc01d0441eae1fbfbf4a5feb92)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:11.090283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276e7387-f5c2-4090-9a65-a9841a296d8e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:11.233224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-276e7387-f5c2-4090-9a65-a9841a296d8e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edeea1dc01d0441eae1fbfbf4a5feb92', 'request_id': 'req-276e7387-f5c2-4090-9a65-a9841a296d8e'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:11.301440 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-276e7387-f5c2-4090-9a65-a9841a296d8e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edeea1dc01d0441eae1fbfbf4a5feb92', 'request_id': 'req-276e7387-f5c2-4090-9a65-a9841a296d8e'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:11.309093 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-276e7387-f5c2-4090-9a65-a9841a296d8e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edeea1dc01d0441eae1fbfbf4a5feb92', 'request_id': 'req-276e7387-f5c2-4090-9a65-a9841a296d8e'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:11.319447 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-276e7387-f5c2-4090-9a65-a9841a296d8e admin admin] The token cache is being invalidate because project edeea1dc01d0441eae1fbfbf4a5feb92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:44:11.319736 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-276e7387-f5c2-4090-9a65-a9841a296d8e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:11.320378 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-276e7387-f5c2-4090-9a65-a9841a296d8e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:11.323431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1273/2552] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:44:10 2022] DELETE /identity/v3/projects/edeea1dc01d0441eae1fbfbf4a5feb92 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:20.711813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:INSERT=1,keystone:DELETE=1,keystone:SELECT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:21.370979 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=43,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:29.983641 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afc17c-f414-4408-b37d-80275d2dacf6 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:29.986048 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-85afc17c-f414-4408-b37d-80275d2dacf6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:29.998823 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85afc17c-f414-4408-b37d-80275d2dacf6 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:30.056330 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3d6b8-de30-465e-945a-691759536c44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:30.057194 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3d6b8-de30-465e-945a-691759536c44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:30.057476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3d6b8-de30-465e-945a-691759536c44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:30.057747 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b3d6b8-de30-465e-945a-691759536c44 admin admin] PATH_INFO: `/v3/users/99400220253d4a23b61291a55300b044` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:30.058942 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3d6b8-de30-465e-945a-691759536c44 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99400220253d4a23b61291a55300b044)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:30.060857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b3d6b8-de30-465e-945a-691759536c44 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:30.309271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-72b3d6b8-de30-465e-945a-691759536c44 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99400220253d4a23b61291a55300b044'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:30.321662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-72b3d6b8-de30-465e-945a-691759536c44 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99400220253d4a23b61291a55300b044'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:30.322350 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-72b3d6b8-de30-465e-945a-691759536c44 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99400220253d4a23b61291a55300b044'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:30.323018 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-72b3d6b8-de30-465e-945a-691759536c44 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99400220253d4a23b61291a55300b044'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:30.330254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-72b3d6b8-de30-465e-945a-691759536c44 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99400220253d4a23b61291a55300b044'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:30.409630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1280/2553] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:44:29 2022] DELETE /identity/v3/users/99400220253d4a23b61291a55300b044 => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:30.415080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1072b3-49db-46e8-86e9-b5f41f55562c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:30.419480 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1072b3-49db-46e8-86e9-b5f41f55562c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:30.419480 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1072b3-49db-46e8-86e9-b5f41f55562c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:30.434028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-6f1072b3-49db-46e8-86e9-b5f41f55562c None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:30.435335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6f1072b3-49db-46e8-86e9-b5f41f55562c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:30.494988 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1274/2554] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:30.505388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3d6b8-de30-465e-945a-691759536c44 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:30.507738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-72b3d6b8-de30-465e-945a-691759536c44 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:30.566098 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b3d6b8-de30-465e-945a-691759536c44 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:30.569941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a18090-95cf-4c6a-a817-0675b722a28e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:30.570589 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a18090-95cf-4c6a-a817-0675b722a28e service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:30.570922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a18090-95cf-4c6a-a817-0675b722a28e service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:30.571204 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a18090-95cf-4c6a-a817-0675b722a28e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:30.581444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a18090-95cf-4c6a-a817-0675b722a28e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:30.582931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a18090-95cf-4c6a-a817-0675b722a28e service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:30.592793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1281/2555] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:44:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:44:31.045730 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1072b3-49db-46e8-86e9-b5f41f55562c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:31.047376 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6f1072b3-49db-46e8-86e9-b5f41f55562c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:31.060930 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1072b3-49db-46e8-86e9-b5f41f55562c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:31.066842 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d060e4-7aae-4d63-bf11-a0775388cd61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:31.067721 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d060e4-7aae-4d63-bf11-a0775388cd61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:31.068005 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d060e4-7aae-4d63-bf11-a0775388cd61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:31.068285 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d060e4-7aae-4d63-bf11-a0775388cd61 admin admin] PATH_INFO: `/v3/projects/9f8dbedbea33466991c9fb6462ced9f2` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:31.074606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d060e4-7aae-4d63-bf11-a0775388cd61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9f8dbedbea33466991c9fb6462ced9f2)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:31.076762 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d060e4-7aae-4d63-bf11-a0775388cd61 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:31.232623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-59d060e4-7aae-4d63-bf11-a0775388cd61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9f8dbedbea33466991c9fb6462ced9f2', 'request_id': 'req-59d060e4-7aae-4d63-bf11-a0775388cd61'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:31.311321 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-59d060e4-7aae-4d63-bf11-a0775388cd61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9f8dbedbea33466991c9fb6462ced9f2', 'request_id': 'req-59d060e4-7aae-4d63-bf11-a0775388cd61'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:31.318957 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-59d060e4-7aae-4d63-bf11-a0775388cd61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9f8dbedbea33466991c9fb6462ced9f2', 'request_id': 'req-59d060e4-7aae-4d63-bf11-a0775388cd61'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:31.330229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-59d060e4-7aae-4d63-bf11-a0775388cd61 admin admin] The token cache is being invalidate because project 9f8dbedbea33466991c9fb6462ced9f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:44:31.330551 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-59d060e4-7aae-4d63-bf11-a0775388cd61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:31.331242 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-59d060e4-7aae-4d63-bf11-a0775388cd61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:31.332841 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1275/2556] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:44:31 2022] DELETE /identity/v3/projects/9f8dbedbea33466991c9fb6462ced9f2 => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:31.338986 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a18090-95cf-4c6a-a817-0675b722a28e service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:31.349142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a18090-95cf-4c6a-a817-0675b722a28e service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:31.367900 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:31.409757 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852429ec-5737-4a21-bc07-2b20d755d67b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:31.410636 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852429ec-5737-4a21-bc07-2b20d755d67b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:31.410985 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852429ec-5737-4a21-bc07-2b20d755d67b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:31.411270 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852429ec-5737-4a21-bc07-2b20d755d67b admin admin] PATH_INFO: `/v3/users/eb4af2104b0d4c8abc8b711ddfb1936e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:31.412452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852429ec-5737-4a21-bc07-2b20d755d67b admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb4af2104b0d4c8abc8b711ddfb1936e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:31.414370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-852429ec-5737-4a21-bc07-2b20d755d67b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:31.641401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-852429ec-5737-4a21-bc07-2b20d755d67b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb4af2104b0d4c8abc8b711ddfb1936e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:31.657559 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-852429ec-5737-4a21-bc07-2b20d755d67b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb4af2104b0d4c8abc8b711ddfb1936e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:31.661725 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-852429ec-5737-4a21-bc07-2b20d755d67b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb4af2104b0d4c8abc8b711ddfb1936e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:31.662369 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-852429ec-5737-4a21-bc07-2b20d755d67b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb4af2104b0d4c8abc8b711ddfb1936e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:31.670512 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-852429ec-5737-4a21-bc07-2b20d755d67b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb4af2104b0d4c8abc8b711ddfb1936e'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:31.768964 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1282/2557] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:44:31 2022] DELETE /identity/v3/users/eb4af2104b0d4c8abc8b711ddfb1936e => generated 0 bytes in 427 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:32.250817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d060e4-7aae-4d63-bf11-a0775388cd61 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:32.253490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-59d060e4-7aae-4d63-bf11-a0775388cd61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:32.279150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d060e4-7aae-4d63-bf11-a0775388cd61 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:32.341577 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6c99b1-b017-427b-988c-d0bf00d66651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:32.342452 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c99b1-b017-427b-988c-d0bf00d66651 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:32.342738 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c99b1-b017-427b-988c-d0bf00d66651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:32.343035 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6c99b1-b017-427b-988c-d0bf00d66651 admin admin] PATH_INFO: `/v3/projects/b0cf4f4fb576488ba00bd9fa47023e6d` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:32.344238 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c99b1-b017-427b-988c-d0bf00d66651 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b0cf4f4fb576488ba00bd9fa47023e6d)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:32.346239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6c99b1-b017-427b-988c-d0bf00d66651 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:32.422541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:32.440715 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0d6c99b1-b017-427b-988c-d0bf00d66651 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b0cf4f4fb576488ba00bd9fa47023e6d', 'request_id': 'req-0d6c99b1-b017-427b-988c-d0bf00d66651'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:32.517532 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0d6c99b1-b017-427b-988c-d0bf00d66651 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b0cf4f4fb576488ba00bd9fa47023e6d', 'request_id': 'req-0d6c99b1-b017-427b-988c-d0bf00d66651'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:32.524474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0d6c99b1-b017-427b-988c-d0bf00d66651 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b0cf4f4fb576488ba00bd9fa47023e6d', 'request_id': 'req-0d6c99b1-b017-427b-988c-d0bf00d66651'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:32.535712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0d6c99b1-b017-427b-988c-d0bf00d66651 admin admin] The token cache is being invalidate because project b0cf4f4fb576488ba00bd9fa47023e6d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:44:32.535992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0d6c99b1-b017-427b-988c-d0bf00d66651 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:32.536724 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0d6c99b1-b017-427b-988c-d0bf00d66651 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:32.538261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1276/2558] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:44:32 2022] DELETE /identity/v3/projects/b0cf4f4fb576488ba00bd9fa47023e6d => generated 0 bytes in 288 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:32.543303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb47563-6887-4c7b-93fd-a8ae8defa7a8 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:32.543807 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb47563-6887-4c7b-93fd-a8ae8defa7a8 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:32.543911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb47563-6887-4c7b-93fd-a8ae8defa7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:32.563509 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1bb47563-6887-4c7b-93fd-a8ae8defa7a8 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:32.564753 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1bb47563-6887-4c7b-93fd-a8ae8defa7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:32.628635 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1283/2559] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:32.636500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5319fc-e501-4e7d-ab6e-246af1ac960a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:32.639761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5319fc-e501-4e7d-ab6e-246af1ac960a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:32.639761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5319fc-e501-4e7d-ab6e-246af1ac960a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:32.655830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-6d5319fc-e501-4e7d-ab6e-246af1ac960a None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:32.657038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6d5319fc-e501-4e7d-ab6e-246af1ac960a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:32.665401 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1277/2560] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:32.669677 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb47563-6887-4c7b-93fd-a8ae8defa7a8 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:32.681012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb47563-6887-4c7b-93fd-a8ae8defa7a8 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:32.685607 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b8d84-be3a-4c17-89d0-42add4a6075d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:32.686331 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b8d84-be3a-4c17-89d0-42add4a6075d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:32.686614 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b8d84-be3a-4c17-89d0-42add4a6075d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:32.686915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-897b8d84-be3a-4c17-89d0-42add4a6075d admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:32.687643 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b8d84-be3a-4c17-89d0-42add4a6075d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:44:32.687948 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b8d84-be3a-4c17-89d0-42add4a6075d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:32.689573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-897b8d84-be3a-4c17-89d0-42add4a6075d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:32.702042 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1284/2561] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:44:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:44:32.715827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5319fc-e501-4e7d-ab6e-246af1ac960a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:32.726035 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5319fc-e501-4e7d-ab6e-246af1ac960a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:32.730960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b4f44-1963-48c0-b548-85c0ace335c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:32.731612 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b4f44-1963-48c0-b548-85c0ace335c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:32.731908 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b4f44-1963-48c0-b548-85c0ace335c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:32.732179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130b4f44-1963-48c0-b548-85c0ace335c2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:32.732914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b4f44-1963-48c0-b548-85c0ace335c2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:32.734970 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130b4f44-1963-48c0-b548-85c0ace335c2 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:32.873382 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1278/2562] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:44:32 2022] POST /identity/v3/projects => generated 367 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:44:32.878094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b8d84-be3a-4c17-89d0-42add4a6075d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:32.889028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-897b8d84-be3a-4c17-89d0-42add4a6075d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:32.915809 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:32.957315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca09706-3afe-4825-b3a5-0ff1bd86bc2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:32.957982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca09706-3afe-4825-b3a5-0ff1bd86bc2a admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:32.958264 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca09706-3afe-4825-b3a5-0ff1bd86bc2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:32.958537 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca09706-3afe-4825-b3a5-0ff1bd86bc2a admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:32.959271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca09706-3afe-4825-b3a5-0ff1bd86bc2a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:32.961203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ca09706-3afe-4825-b3a5-0ff1bd86bc2a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:33.066824 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1285/2563] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:44:32 2022] POST /identity/v3/users => generated 284 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:44:33.071083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b4f44-1963-48c0-b548-85c0ace335c2 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:33.082571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130b4f44-1963-48c0-b548-85c0ace335c2 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:33.087301 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af760688-24ab-4ecc-a6c8-f919ea716e16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:33.087961 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af760688-24ab-4ecc-a6c8-f919ea716e16 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:33.088253 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af760688-24ab-4ecc-a6c8-f919ea716e16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:33.088531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af760688-24ab-4ecc-a6c8-f919ea716e16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:33.089256 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af760688-24ab-4ecc-a6c8-f919ea716e16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:33.090867 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af760688-24ab-4ecc-a6c8-f919ea716e16 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:33.102204 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1279/2564] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:44:33.106238 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca09706-3afe-4825-b3a5-0ff1bd86bc2a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:33.116324 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca09706-3afe-4825-b3a5-0ff1bd86bc2a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:33.120998 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64915d13-48ac-497d-925e-1b6d7771d8c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:33.121630 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64915d13-48ac-497d-925e-1b6d7771d8c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:33.121909 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64915d13-48ac-497d-925e-1b6d7771d8c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:33.122181 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64915d13-48ac-497d-925e-1b6d7771d8c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:33.122931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64915d13-48ac-497d-925e-1b6d7771d8c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:33.124508 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64915d13-48ac-497d-925e-1b6d7771d8c8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:33.134907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1286/2565] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:44:33.139136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af760688-24ab-4ecc-a6c8-f919ea716e16 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:33.149936 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af760688-24ab-4ecc-a6c8-f919ea716e16 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:33.154512 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845a84a-8658-4a6c-93f1-8c3ecb8fae15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:33.155492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845a84a-8658-4a6c-93f1-8c3ecb8fae15 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:33.155832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845a84a-8658-4a6c-93f1-8c3ecb8fae15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:33.156108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b845a84a-8658-4a6c-93f1-8c3ecb8fae15 admin admin] PATH_INFO: `/v3/projects/c333bd2e79a6464fb5331232032a217a/users/3adde228b9464b68826b6257e5cabbd8/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:33.171524 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845a84a-8658-4a6c-93f1-8c3ecb8fae15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c333bd2e79a6464fb5331232032a217a, user_id=3adde228b9464b68826b6257e5cabbd8, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:33.174449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b845a84a-8658-4a6c-93f1-8c3ecb8fae15 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:33.256749 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1280/2566] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:44:33 2022] PUT /identity/v3/projects/c333bd2e79a6464fb5331232032a217a/users/3adde228b9464b68826b6257e5cabbd8/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:44:33.268373 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfed7cc-59d5-4a60-92f7-44db98d5625c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:33.268632 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfed7cc-59d5-4a60-92f7-44db98d5625c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:33.268934 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfed7cc-59d5-4a60-92f7-44db98d5625c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:33.302333 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5dfed7cc-59d5-4a60-92f7-44db98d5625c None None] MFA Rules not processed for user `3adde228b9464b68826b6257e5cabbd8`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:33.302333 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5dfed7cc-59d5-4a60-92f7-44db98d5625c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:33.370845 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1287/2567] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:33 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:44:33.375291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845a84a-8658-4a6c-93f1-8c3ecb8fae15 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:33.441378 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b845a84a-8658-4a6c-93f1-8c3ecb8fae15 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:33.446032 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d29704-2e8a-4374-93ea-126c69fa846e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:33.446715 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d29704-2e8a-4374-93ea-126c69fa846e admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:33.447029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d29704-2e8a-4374-93ea-126c69fa846e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:33.447307 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d29704-2e8a-4374-93ea-126c69fa846e admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:33.448108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d29704-2e8a-4374-93ea-126c69fa846e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:33.450036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d29704-2e8a-4374-93ea-126c69fa846e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:33.522868 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1281/2568] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:44:33 2022] POST /identity/v3/projects => generated 367 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:44:33.524015 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfed7cc-59d5-4a60-92f7-44db98d5625c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:33.535709 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfed7cc-59d5-4a60-92f7-44db98d5625c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:33.597253 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809fb40-a7da-468b-acfe-4ac76f4ae4b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:33.597972 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809fb40-a7da-468b-acfe-4ac76f4ae4b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:33.598183 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809fb40-a7da-468b-acfe-4ac76f4ae4b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:33.598453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d809fb40-a7da-468b-acfe-4ac76f4ae4b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:33.599167 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809fb40-a7da-468b-acfe-4ac76f4ae4b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:33.601076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d809fb40-a7da-468b-acfe-4ac76f4ae4b1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:33.683482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1288/2569] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:44:33 2022] POST /identity/v3/users => generated 290 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:44:33.687418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d29704-2e8a-4374-93ea-126c69fa846e admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:33.699318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d29704-2e8a-4374-93ea-126c69fa846e admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:33.704267 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34350076-2511-404b-8195-6baf656d11cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:33.705241 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34350076-2511-404b-8195-6baf656d11cd admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:33.705532 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34350076-2511-404b-8195-6baf656d11cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:33.705815 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34350076-2511-404b-8195-6baf656d11cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:33.706550 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34350076-2511-404b-8195-6baf656d11cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:33.709044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34350076-2511-404b-8195-6baf656d11cd admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:33.721155 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1282/2570] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:44:33.725863 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809fb40-a7da-468b-acfe-4ac76f4ae4b1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:33.737193 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d809fb40-a7da-468b-acfe-4ac76f4ae4b1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:33.742299 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e5b05-ae4a-4e2b-bada-ff2bc2fd70d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:33.743311 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e5b05-ae4a-4e2b-bada-ff2bc2fd70d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:33.743598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e5b05-ae4a-4e2b-bada-ff2bc2fd70d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:33.743907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437e5b05-ae4a-4e2b-bada-ff2bc2fd70d8 admin admin] PATH_INFO: `/v3/projects/9d493ca3ad2b4dd7b5f5104c4e2327c0/users/0d8c1fbf8bda465892f2cb34955954e5/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:33.761108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e5b05-ae4a-4e2b-bada-ff2bc2fd70d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d493ca3ad2b4dd7b5f5104c4e2327c0, user_id=0d8c1fbf8bda465892f2cb34955954e5, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:33.763852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-437e5b05-ae4a-4e2b-bada-ff2bc2fd70d8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:33.924608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1289/2571] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:44:33 2022] PUT /identity/v3/projects/9d493ca3ad2b4dd7b5f5104c4e2327c0/users/0d8c1fbf8bda465892f2cb34955954e5/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:44:33.928783 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34350076-2511-404b-8195-6baf656d11cd admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:33.940471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34350076-2511-404b-8195-6baf656d11cd admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:33.962609 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:34.001581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b475035c-7631-4966-a65e-48e3f3589c4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:34.002303 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475035c-7631-4966-a65e-48e3f3589c4d admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:34.002588 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475035c-7631-4966-a65e-48e3f3589c4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:34.002901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b475035c-7631-4966-a65e-48e3f3589c4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:34.003631 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475035c-7631-4966-a65e-48e3f3589c4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:34.005244 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b475035c-7631-4966-a65e-48e3f3589c4d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:34.019589 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1283/2572] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:44:34.020781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e5b05-ae4a-4e2b-bada-ff2bc2fd70d8 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:34.030720 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:34.032018 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437e5b05-ae4a-4e2b-bada-ff2bc2fd70d8 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:34.037427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72f858-7e2e-491d-97df-5deab556f3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:34.038348 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72f858-7e2e-491d-97df-5deab556f3db admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:34.038640 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72f858-7e2e-491d-97df-5deab556f3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:34.038954 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df72f858-7e2e-491d-97df-5deab556f3db admin admin] PATH_INFO: `/v3/projects/9d493ca3ad2b4dd7b5f5104c4e2327c0/users/0d8c1fbf8bda465892f2cb34955954e5/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:34.041089 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72f858-7e2e-491d-97df-5deab556f3db admin admin] RBAC: Authorizing `identity:create_grant(project_id=9d493ca3ad2b4dd7b5f5104c4e2327c0, user_id=0d8c1fbf8bda465892f2cb34955954e5, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:34.043915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df72f858-7e2e-491d-97df-5deab556f3db admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:34.054960 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1290/2573] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:44:34 2022] PUT /identity/v3/projects/9d493ca3ad2b4dd7b5f5104c4e2327c0/users/0d8c1fbf8bda465892f2cb34955954e5/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:34.069732 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee66450-ebd4-418f-9933-827c37390e5f None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:34.071044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee66450-ebd4-418f-9933-827c37390e5f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:34.071929 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee66450-ebd4-418f-9933-827c37390e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:34.108503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-0ee66450-ebd4-418f-9933-827c37390e5f None None] MFA Rules not processed for user `0d8c1fbf8bda465892f2cb34955954e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:34.109832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0ee66450-ebd4-418f-9933-827c37390e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:34.180427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1284/2574] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:34 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:34.192991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72f858-7e2e-491d-97df-5deab556f3db admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:34.194813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-df72f858-7e2e-491d-97df-5deab556f3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:34.270261 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df72f858-7e2e-491d-97df-5deab556f3db admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:34.274806 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2c356-8927-49b0-bb00-f33da236059b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:34.275915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2c356-8927-49b0-bb00-f33da236059b service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:34.276205 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2c356-8927-49b0-bb00-f33da236059b service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:34.276495 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb2c356-8927-49b0-bb00-f33da236059b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:34.290003 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2c356-8927-49b0-bb00-f33da236059b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:34.291621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eb2c356-8927-49b0-bb00-f33da236059b service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:34.302305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1291/2575] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:44:34 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:44:34.532078 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee66450-ebd4-418f-9933-827c37390e5f None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:34.541943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee66450-ebd4-418f-9933-827c37390e5f None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:34.546067 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5f552-5b51-4a3c-a19c-1c3f43bfb00a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:34.546870 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f552-5b51-4a3c-a19c-1c3f43bfb00a service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:34.547335 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f552-5b51-4a3c-a19c-1c3f43bfb00a service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:34.547613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d5f552-5b51-4a3c-a19c-1c3f43bfb00a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:34.611830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5f552-5b51-4a3c-a19c-1c3f43bfb00a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:34.613428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d5f552-5b51-4a3c-a19c-1c3f43bfb00a service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:34.625175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1285/2576] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:44:34 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:44:41.400123 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2c356-8927-49b0-bb00-f33da236059b service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:41.464069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb2c356-8927-49b0-bb00-f33da236059b service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:41.468570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1c651-2dd2-44bf-b841-301e47c24695 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:41.469550 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1c651-2dd2-44bf-b841-301e47c24695 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:41.469836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1c651-2dd2-44bf-b841-301e47c24695 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:41.470783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda1c651-2dd2-44bf-b841-301e47c24695 admin admin] PATH_INFO: `/v3/users/3adde228b9464b68826b6257e5cabbd8` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:41.472004 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1c651-2dd2-44bf-b841-301e47c24695 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3adde228b9464b68826b6257e5cabbd8)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:41.473920 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda1c651-2dd2-44bf-b841-301e47c24695 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:41.531993 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5f552-5b51-4a3c-a19c-1c3f43bfb00a service cinder] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:41.534078 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-81d5f552-5b51-4a3c-a19c-1c3f43bfb00a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:41.582038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:41.593258 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d5f552-5b51-4a3c-a19c-1c3f43bfb00a service cinder] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:41.597121 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389c63d8-fb55-4ac7-a816-16c084e8a698 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:41.597757 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c63d8-fb55-4ac7-a816-16c084e8a698 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:41.598063 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c63d8-fb55-4ac7-a816-16c084e8a698 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:41.598337 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389c63d8-fb55-4ac7-a816-16c084e8a698 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:41.600108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-389c63d8-fb55-4ac7-a816-16c084e8a698 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:41.612533 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c63d8-fb55-4ac7-a816-16c084e8a698 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:41.613944 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389c63d8-fb55-4ac7-a816-16c084e8a698 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:41.623539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1286/2577] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:44:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:44:41.691121 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dda1c651-2dd2-44bf-b841-301e47c24695 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3adde228b9464b68826b6257e5cabbd8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:41.703387 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dda1c651-2dd2-44bf-b841-301e47c24695 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3adde228b9464b68826b6257e5cabbd8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:41.704151 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dda1c651-2dd2-44bf-b841-301e47c24695 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3adde228b9464b68826b6257e5cabbd8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:41.705390 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dda1c651-2dd2-44bf-b841-301e47c24695 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3adde228b9464b68826b6257e5cabbd8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:41.713277 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dda1c651-2dd2-44bf-b841-301e47c24695 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3adde228b9464b68826b6257e5cabbd8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:41.819568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1292/2578] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:44:41 2022] DELETE /identity/v3/users/3adde228b9464b68826b6257e5cabbd8 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:41.821277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a9de7-8973-47f5-a467-512749bdb335 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:41.821551 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a9de7-8973-47f5-a467-512749bdb335 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:41.821826 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63a9de7-8973-47f5-a467-512749bdb335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:41.839847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d63a9de7-8973-47f5-a467-512749bdb335 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:41.841088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d63a9de7-8973-47f5-a467-512749bdb335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:41.903187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1287/2579] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:44:41.915466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1c651-2dd2-44bf-b841-301e47c24695 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:41.916856 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dda1c651-2dd2-44bf-b841-301e47c24695 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:41.931707 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:41.979977 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda1c651-2dd2-44bf-b841-301e47c24695 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:41.984323 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff34abc-636c-4332-ae4b-45393a070a43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:41.985041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff34abc-636c-4332-ae4b-45393a070a43 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:41.985388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff34abc-636c-4332-ae4b-45393a070a43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:41.985722 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff34abc-636c-4332-ae4b-45393a070a43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:42.001722 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff34abc-636c-4332-ae4b-45393a070a43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:42.003296 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff34abc-636c-4332-ae4b-45393a070a43 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:42.013641 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1293/2580] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:44:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:44:42.444882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a9de7-8973-47f5-a467-512749bdb335 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:42.447136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d63a9de7-8973-47f5-a467-512749bdb335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:42.476462 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63a9de7-8973-47f5-a467-512749bdb335 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:42.482707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75227034-689c-49fb-8d42-66e7d60cfca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:42.483711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75227034-689c-49fb-8d42-66e7d60cfca4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:42.484087 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75227034-689c-49fb-8d42-66e7d60cfca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:42.484459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75227034-689c-49fb-8d42-66e7d60cfca4 admin admin] PATH_INFO: `/v3/projects/c333bd2e79a6464fb5331232032a217a` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:42.486466 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75227034-689c-49fb-8d42-66e7d60cfca4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c333bd2e79a6464fb5331232032a217a)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:42.488706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75227034-689c-49fb-8d42-66e7d60cfca4 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:42.621462 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-75227034-689c-49fb-8d42-66e7d60cfca4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c333bd2e79a6464fb5331232032a217a', 'request_id': 'req-75227034-689c-49fb-8d42-66e7d60cfca4'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:42.740480 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-75227034-689c-49fb-8d42-66e7d60cfca4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c333bd2e79a6464fb5331232032a217a', 'request_id': 'req-75227034-689c-49fb-8d42-66e7d60cfca4'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:42.749719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-75227034-689c-49fb-8d42-66e7d60cfca4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c333bd2e79a6464fb5331232032a217a', 'request_id': 'req-75227034-689c-49fb-8d42-66e7d60cfca4'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:42.764453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-75227034-689c-49fb-8d42-66e7d60cfca4 admin admin] The token cache is being invalidate because project c333bd2e79a6464fb5331232032a217a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:44:42.764846 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-75227034-689c-49fb-8d42-66e7d60cfca4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:42.765639 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-75227034-689c-49fb-8d42-66e7d60cfca4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:42.770882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1288/2581] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:44:42 2022] DELETE /identity/v3/projects/c333bd2e79a6464fb5331232032a217a => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:42.772153 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff34abc-636c-4332-ae4b-45393a070a43 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:42.786172 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff34abc-636c-4332-ae4b-45393a070a43 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:42.857644 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9538761-ec5c-48d2-b85e-57b9b10f8f99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:42.858787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9538761-ec5c-48d2-b85e-57b9b10f8f99 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:42.859190 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9538761-ec5c-48d2-b85e-57b9b10f8f99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:42.859604 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9538761-ec5c-48d2-b85e-57b9b10f8f99 admin admin] PATH_INFO: `/v3/users/0d8c1fbf8bda465892f2cb34955954e5` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:42.861221 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9538761-ec5c-48d2-b85e-57b9b10f8f99 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d8c1fbf8bda465892f2cb34955954e5)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:42.863578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9538761-ec5c-48d2-b85e-57b9b10f8f99 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:43.088721 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c9538761-ec5c-48d2-b85e-57b9b10f8f99 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d8c1fbf8bda465892f2cb34955954e5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:43.102248 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c9538761-ec5c-48d2-b85e-57b9b10f8f99 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d8c1fbf8bda465892f2cb34955954e5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:43.103028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c9538761-ec5c-48d2-b85e-57b9b10f8f99 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d8c1fbf8bda465892f2cb34955954e5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:43.103650 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c9538761-ec5c-48d2-b85e-57b9b10f8f99 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d8c1fbf8bda465892f2cb34955954e5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:43.111791 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c9538761-ec5c-48d2-b85e-57b9b10f8f99 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d8c1fbf8bda465892f2cb34955954e5'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:43.216287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1294/2582] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:44:42 2022] DELETE /identity/v3/users/0d8c1fbf8bda465892f2cb34955954e5 => generated 0 bytes in 445 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:43.722344 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75227034-689c-49fb-8d42-66e7d60cfca4 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:43.722344 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-75227034-689c-49fb-8d42-66e7d60cfca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:43.743549 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75227034-689c-49fb-8d42-66e7d60cfca4 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:43.816940 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bc5aa5-ab89-4e8a-b210-cb673e057599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:43.817810 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc5aa5-ab89-4e8a-b210-cb673e057599 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:43.819810 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc5aa5-ab89-4e8a-b210-cb673e057599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:43.819810 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bc5aa5-ab89-4e8a-b210-cb673e057599 admin admin] PATH_INFO: `/v3/projects/9d493ca3ad2b4dd7b5f5104c4e2327c0` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:43.819810 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc5aa5-ab89-4e8a-b210-cb673e057599 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9d493ca3ad2b4dd7b5f5104c4e2327c0)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:43.821761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bc5aa5-ab89-4e8a-b210-cb673e057599 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:43.834598 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:43.965523 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-80bc5aa5-ab89-4e8a-b210-cb673e057599 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9d493ca3ad2b4dd7b5f5104c4e2327c0', 'request_id': 'req-80bc5aa5-ab89-4e8a-b210-cb673e057599'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:44.088898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-80bc5aa5-ab89-4e8a-b210-cb673e057599 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9d493ca3ad2b4dd7b5f5104c4e2327c0', 'request_id': 'req-80bc5aa5-ab89-4e8a-b210-cb673e057599'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:44.096750 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-80bc5aa5-ab89-4e8a-b210-cb673e057599 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9d493ca3ad2b4dd7b5f5104c4e2327c0', 'request_id': 'req-80bc5aa5-ab89-4e8a-b210-cb673e057599'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:44.108799 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-80bc5aa5-ab89-4e8a-b210-cb673e057599 admin admin] The token cache is being invalidate because project 9d493ca3ad2b4dd7b5f5104c4e2327c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:44:44.109103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-80bc5aa5-ab89-4e8a-b210-cb673e057599 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:44.109795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-80bc5aa5-ab89-4e8a-b210-cb673e057599 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:44.112365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1289/2583] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:44:43 2022] DELETE /identity/v3/projects/9d493ca3ad2b4dd7b5f5104c4e2327c0 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:44.117314 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90be43-7a74-4f91-81fc-da4864ad5ff9 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:44.117890 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90be43-7a74-4f91-81fc-da4864ad5ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:44.117890 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe90be43-7a74-4f91-81fc-da4864ad5ff9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:44.140216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-fe90be43-7a74-4f91-81fc-da4864ad5ff9 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:44.144055 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fe90be43-7a74-4f91-81fc-da4864ad5ff9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:44.183073 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:44.217882 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1295/2584] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:44.229858 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe9535-eb56-4565-a3e2-8e78321df558 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:44.229858 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe9535-eb56-4565-a3e2-8e78321df558 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:44.229858 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffe9535-eb56-4565-a3e2-8e78321df558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:44.247709 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-4ffe9535-eb56-4565-a3e2-8e78321df558 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:44.248939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4ffe9535-eb56-4565-a3e2-8e78321df558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:44.259547 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1290/2585] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:44.266044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90be43-7a74-4f91-81fc-da4864ad5ff9 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:44.274193 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe90be43-7a74-4f91-81fc-da4864ad5ff9 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:44.278983 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe2a27-17fe-49f5-a2d5-b615ba11dcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:44.279631 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe2a27-17fe-49f5-a2d5-b615ba11dcfa admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:44.279907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe2a27-17fe-49f5-a2d5-b615ba11dcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:44.280177 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04fe2a27-17fe-49f5-a2d5-b615ba11dcfa admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:44.280901 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe2a27-17fe-49f5-a2d5-b615ba11dcfa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:44:44.281205 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe2a27-17fe-49f5-a2d5-b615ba11dcfa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:44.283463 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04fe2a27-17fe-49f5-a2d5-b615ba11dcfa admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:44.295804 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1296/2586] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:44:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:44:44.301519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe9535-eb56-4565-a3e2-8e78321df558 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:44.310876 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffe9535-eb56-4565-a3e2-8e78321df558 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:44.315732 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170935c-b6e0-4884-8d76-b262299000a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:44.316376 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170935c-b6e0-4884-8d76-b262299000a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:44.316658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170935c-b6e0-4884-8d76-b262299000a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:44.316929 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1170935c-b6e0-4884-8d76-b262299000a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:44.318253 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170935c-b6e0-4884-8d76-b262299000a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:44.319550 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1170935c-b6e0-4884-8d76-b262299000a0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:44.387583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1291/2587] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:44:44 2022] POST /identity/v3/projects => generated 359 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:44:44.392444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe2a27-17fe-49f5-a2d5-b615ba11dcfa admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:44.404918 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04fe2a27-17fe-49f5-a2d5-b615ba11dcfa admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:44.470906 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cee0a-2fbc-40ae-9145-1ec1eb7af1d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:44.471697 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cee0a-2fbc-40ae-9145-1ec1eb7af1d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:44.472065 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cee0a-2fbc-40ae-9145-1ec1eb7af1d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:44.472411 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23cee0a-2fbc-40ae-9145-1ec1eb7af1d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:44.473179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cee0a-2fbc-40ae-9145-1ec1eb7af1d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:44.475289 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23cee0a-2fbc-40ae-9145-1ec1eb7af1d2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:44.558979 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1297/2588] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:44:44 2022] POST /identity/v3/users => generated 280 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:44:44.563067 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170935c-b6e0-4884-8d76-b262299000a0 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:44.574293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1170935c-b6e0-4884-8d76-b262299000a0 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:44.579878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808681c-948d-409d-a9a0-74922ec157f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:44.580526 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808681c-948d-409d-a9a0-74922ec157f8 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:44.580812 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808681c-948d-409d-a9a0-74922ec157f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:44.581684 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7808681c-948d-409d-a9a0-74922ec157f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:44.582449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808681c-948d-409d-a9a0-74922ec157f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:44.584138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7808681c-948d-409d-a9a0-74922ec157f8 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:44.600293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1292/2589] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:44:44.604728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cee0a-2fbc-40ae-9145-1ec1eb7af1d2 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:44.615265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23cee0a-2fbc-40ae-9145-1ec1eb7af1d2 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:44.622052 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c96fdf3-f0e2-44f1-a366-aac9bb496c6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:44.622991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96fdf3-f0e2-44f1-a366-aac9bb496c6e admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:44.623377 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96fdf3-f0e2-44f1-a366-aac9bb496c6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:44.624266 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c96fdf3-f0e2-44f1-a366-aac9bb496c6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:44.624588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96fdf3-f0e2-44f1-a366-aac9bb496c6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:44.627597 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c96fdf3-f0e2-44f1-a366-aac9bb496c6e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:44.639879 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1298/2590] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:44 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:44:44.644674 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808681c-948d-409d-a9a0-74922ec157f8 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:44.655555 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7808681c-948d-409d-a9a0-74922ec157f8 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:44.670345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a61d9c-019c-4b28-9b44-4fae545d5518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:44.670345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a61d9c-019c-4b28-9b44-4fae545d5518 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:44.670345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a61d9c-019c-4b28-9b44-4fae545d5518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:44.670345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a61d9c-019c-4b28-9b44-4fae545d5518 admin admin] PATH_INFO: `/v3/projects/cbf41be8c44d43378cb9c3e8ef1758e7/users/18c8afbc87fc4e839b26a7ea132a952f/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:44.680273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a61d9c-019c-4b28-9b44-4fae545d5518 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cbf41be8c44d43378cb9c3e8ef1758e7, user_id=18c8afbc87fc4e839b26a7ea132a952f, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:44.683358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a61d9c-019c-4b28-9b44-4fae545d5518 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:44.759951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1293/2591] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:44:44 2022] PUT /identity/v3/projects/cbf41be8c44d43378cb9c3e8ef1758e7/users/18c8afbc87fc4e839b26a7ea132a952f/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:44.771542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787aca0a-89a9-4f37-8b1b-3a43753db137 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:44.771832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787aca0a-89a9-4f37-8b1b-3a43753db137 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:44.772109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787aca0a-89a9-4f37-8b1b-3a43753db137 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:44.803070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-787aca0a-89a9-4f37-8b1b-3a43753db137 None None] MFA Rules not processed for user `18c8afbc87fc4e839b26a7ea132a952f`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:44.804796 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-787aca0a-89a9-4f37-8b1b-3a43753db137 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:44.883409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1299/2592] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:44 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:44.922349 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a61d9c-019c-4b28-9b44-4fae545d5518 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:44.924859 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-41a61d9c-019c-4b28-9b44-4fae545d5518 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:44.993843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a61d9c-019c-4b28-9b44-4fae545d5518 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:44.997564 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0217d-4b5d-436b-8cfc-93e52c65f0ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:44.998213 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0217d-4b5d-436b-8cfc-93e52c65f0ac service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:44.998500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0217d-4b5d-436b-8cfc-93e52c65f0ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:44.998826 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0217d-4b5d-436b-8cfc-93e52c65f0ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:45.008381 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0217d-4b5d-436b-8cfc-93e52c65f0ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:45.010049 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c0217d-4b5d-436b-8cfc-93e52c65f0ac service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:45.020277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1294/2593] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:44:44 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:44:45.035087 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787aca0a-89a9-4f37-8b1b-3a43753db137 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:45.074336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:45.119080 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787aca0a-89a9-4f37-8b1b-3a43753db137 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:45.126243 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b838e-6b49-487f-955d-6cf26da1c532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:45.127788 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b838e-6b49-487f-955d-6cf26da1c532 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:45.128076 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b838e-6b49-487f-955d-6cf26da1c532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:45.128351 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7b838e-6b49-487f-955d-6cf26da1c532 admin admin] PATH_INFO: `/v3/users/18c8afbc87fc4e839b26a7ea132a952f` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:45.129636 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b838e-6b49-487f-955d-6cf26da1c532 admin admin] RBAC: Authorizing `identity:delete_user(user_id=18c8afbc87fc4e839b26a7ea132a952f)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:45.131620 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7b838e-6b49-487f-955d-6cf26da1c532 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:45.363296 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9a7b838e-6b49-487f-955d-6cf26da1c532 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '18c8afbc87fc4e839b26a7ea132a952f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:45.383595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9a7b838e-6b49-487f-955d-6cf26da1c532 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '18c8afbc87fc4e839b26a7ea132a952f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:45.385320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9a7b838e-6b49-487f-955d-6cf26da1c532 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '18c8afbc87fc4e839b26a7ea132a952f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:45.386955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9a7b838e-6b49-487f-955d-6cf26da1c532 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '18c8afbc87fc4e839b26a7ea132a952f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:45.398068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-9a7b838e-6b49-487f-955d-6cf26da1c532 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '18c8afbc87fc4e839b26a7ea132a952f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:45.554164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1300/2594] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:44:45 2022] DELETE /identity/v3/users/18c8afbc87fc4e839b26a7ea132a952f => generated 0 bytes in 517 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:45.555943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b570b1d-3507-4536-9a6a-6c85fdfbd4de None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:45.556350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b570b1d-3507-4536-9a6a-6c85fdfbd4de None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:45.556832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b570b1d-3507-4536-9a6a-6c85fdfbd4de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:45.578793 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-4b570b1d-3507-4536-9a6a-6c85fdfbd4de None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:45.580785 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4b570b1d-3507-4536-9a6a-6c85fdfbd4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:45.624790 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:45.666945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1295/2595] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:45.672119 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b838e-6b49-487f-955d-6cf26da1c532 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:45.673939 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9a7b838e-6b49-487f-955d-6cf26da1c532 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:45.753547 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7b838e-6b49-487f-955d-6cf26da1c532 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:45.759396 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30639797-0c0d-444b-8706-60c4d556ca94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:45.760352 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30639797-0c0d-444b-8706-60c4d556ca94 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:45.760634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30639797-0c0d-444b-8706-60c4d556ca94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:45.761064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30639797-0c0d-444b-8706-60c4d556ca94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:45.773673 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30639797-0c0d-444b-8706-60c4d556ca94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:45.775484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30639797-0c0d-444b-8706-60c4d556ca94 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:45.792317 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1301/2596] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:44:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:44:46.162839 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b570b1d-3507-4536-9a6a-6c85fdfbd4de None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:46.166282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4b570b1d-3507-4536-9a6a-6c85fdfbd4de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:46.197707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b570b1d-3507-4536-9a6a-6c85fdfbd4de None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:46.203478 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c0a8ad-a6bb-4fe7-a089-1a4194198984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:46.204844 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0a8ad-a6bb-4fe7-a089-1a4194198984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:46.205311 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0a8ad-a6bb-4fe7-a089-1a4194198984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:46.205741 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c0a8ad-a6bb-4fe7-a089-1a4194198984 admin admin] PATH_INFO: `/v3/users/9a1371db30294725bead27951b6cdb25` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:46.207998 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0a8ad-a6bb-4fe7-a089-1a4194198984 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a1371db30294725bead27951b6cdb25)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:46.210850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c0a8ad-a6bb-4fe7-a089-1a4194198984 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:46.367580 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30639797-0c0d-444b-8706-60c4d556ca94 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:46.367580 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-30639797-0c0d-444b-8706-60c4d556ca94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:46.385732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30639797-0c0d-444b-8706-60c4d556ca94 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:46.400574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef40952-2774-4a63-83c5-b6aed0462fc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:46.401485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef40952-2774-4a63-83c5-b6aed0462fc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:46.401759 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef40952-2774-4a63-83c5-b6aed0462fc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:46.402204 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef40952-2774-4a63-83c5-b6aed0462fc8 admin admin] PATH_INFO: `/v3/projects/cbf41be8c44d43378cb9c3e8ef1758e7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:46.403776 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef40952-2774-4a63-83c5-b6aed0462fc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cbf41be8c44d43378cb9c3e8ef1758e7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:46.406019 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef40952-2774-4a63-83c5-b6aed0462fc8 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:46.407115 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c2c0a8ad-a6bb-4fe7-a089-1a4194198984 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a1371db30294725bead27951b6cdb25'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:46.408397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c2c0a8ad-a6bb-4fe7-a089-1a4194198984 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a1371db30294725bead27951b6cdb25'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:46.494373 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c2c0a8ad-a6bb-4fe7-a089-1a4194198984 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a1371db30294725bead27951b6cdb25'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:46.495058 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c2c0a8ad-a6bb-4fe7-a089-1a4194198984 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a1371db30294725bead27951b6cdb25'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:46.509105 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-c2c0a8ad-a6bb-4fe7-a089-1a4194198984 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a1371db30294725bead27951b6cdb25'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:46.526025 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1296/2597] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:44:46 2022] DELETE /identity/v3/users/9a1371db30294725bead27951b6cdb25 => generated 0 bytes in 363 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:46.540857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:46.543955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3ef40952-2774-4a63-83c5-b6aed0462fc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cbf41be8c44d43378cb9c3e8ef1758e7', 'request_id': 'req-3ef40952-2774-4a63-83c5-b6aed0462fc8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:46.552208 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3ef40952-2774-4a63-83c5-b6aed0462fc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cbf41be8c44d43378cb9c3e8ef1758e7', 'request_id': 'req-3ef40952-2774-4a63-83c5-b6aed0462fc8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:46.558910 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3ef40952-2774-4a63-83c5-b6aed0462fc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cbf41be8c44d43378cb9c3e8ef1758e7', 'request_id': 'req-3ef40952-2774-4a63-83c5-b6aed0462fc8'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:46.654736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3ef40952-2774-4a63-83c5-b6aed0462fc8 admin admin] The token cache is being invalidate because project cbf41be8c44d43378cb9c3e8ef1758e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:44:46.655064 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3ef40952-2774-4a63-83c5-b6aed0462fc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:46.655748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3ef40952-2774-4a63-83c5-b6aed0462fc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:46.658337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1302/2598] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:44:46 2022] DELETE /identity/v3/projects/cbf41be8c44d43378cb9c3e8ef1758e7 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:44:46.668225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b6b1d-2949-428b-bec3-967d1282310f None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:46.668549 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b6b1d-2949-428b-bec3-967d1282310f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:46.668888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2b6b1d-2949-428b-bec3-967d1282310f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:46.691104 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-0c2b6b1d-2949-428b-bec3-967d1282310f None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:46.692269 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0c2b6b1d-2949-428b-bec3-967d1282310f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:46.777339 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1297/2599] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:46.786009 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd635b3-8ef5-46fa-9ec9-d3df627c98a3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:46.786304 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd635b3-8ef5-46fa-9ec9-d3df627c98a3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:46.786616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd635b3-8ef5-46fa-9ec9-d3df627c98a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:46.806135 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9bd635b3-8ef5-46fa-9ec9-d3df627c98a3 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:46.807416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9bd635b3-8ef5-46fa-9ec9-d3df627c98a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:46.816399 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1303/2600] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:46.820878 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b6b1d-2949-428b-bec3-967d1282310f None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:46.832143 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2b6b1d-2949-428b-bec3-967d1282310f None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:46.837168 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcbf27-7352-4e71-b893-c49887bd3a89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:46.838162 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcbf27-7352-4e71-b893-c49887bd3a89 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:46.838451 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcbf27-7352-4e71-b893-c49887bd3a89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:46.838735 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bcbf27-7352-4e71-b893-c49887bd3a89 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:46.839516 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcbf27-7352-4e71-b893-c49887bd3a89 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:44:46.839830 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcbf27-7352-4e71-b893-c49887bd3a89 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:46.841507 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bcbf27-7352-4e71-b893-c49887bd3a89 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:46.856929 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd635b3-8ef5-46fa-9ec9-d3df627c98a3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:46.858386 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9bd635b3-8ef5-46fa-9ec9-d3df627c98a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:46.860257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1298/2601] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:44:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:44:46.867782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcbf27-7352-4e71-b893-c49887bd3a89 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:46.878583 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd635b3-8ef5-46fa-9ec9-d3df627c98a3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:46.886621 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da70127b-1d0c-415a-912d-8123ea17a0cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:46.886883 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bcbf27-7352-4e71-b893-c49887bd3a89 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:46.887723 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70127b-1d0c-415a-912d-8123ea17a0cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:46.888102 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70127b-1d0c-415a-912d-8123ea17a0cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:46.888385 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da70127b-1d0c-415a-912d-8123ea17a0cf admin admin] PATH_INFO: `/v3/projects/8e2fbe6daaf24041a865c0bd68e1e0f3` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:46.889625 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70127b-1d0c-415a-912d-8123ea17a0cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e2fbe6daaf24041a865c0bd68e1e0f3)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:46.913228 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da70127b-1d0c-415a-912d-8123ea17a0cf admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:46.913888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eabb76-aea0-4416-80e9-4456866d8d0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:46.913888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eabb76-aea0-4416-80e9-4456866d8d0b admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:46.913888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eabb76-aea0-4416-80e9-4456866d8d0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:46.913888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70eabb76-aea0-4416-80e9-4456866d8d0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:46.914627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eabb76-aea0-4416-80e9-4456866d8d0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:46.914627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70eabb76-aea0-4416-80e9-4456866d8d0b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:47.027590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1299/2602] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:44:46 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:44:47.031684 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eabb76-aea0-4416-80e9-4456866d8d0b admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:47.051402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-da70127b-1d0c-415a-912d-8123ea17a0cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e2fbe6daaf24041a865c0bd68e1e0f3', 'request_id': 'req-da70127b-1d0c-415a-912d-8123ea17a0cf'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:47.053445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:47.058288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-da70127b-1d0c-415a-912d-8123ea17a0cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e2fbe6daaf24041a865c0bd68e1e0f3', 'request_id': 'req-da70127b-1d0c-415a-912d-8123ea17a0cf'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:47.070217 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-da70127b-1d0c-415a-912d-8123ea17a0cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e2fbe6daaf24041a865c0bd68e1e0f3', 'request_id': 'req-da70127b-1d0c-415a-912d-8123ea17a0cf'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:47.104728 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70eabb76-aea0-4416-80e9-4456866d8d0b admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:47.146069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-da70127b-1d0c-415a-912d-8123ea17a0cf admin admin] The token cache is being invalidate because project 8e2fbe6daaf24041a865c0bd68e1e0f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:44:47.146367 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-da70127b-1d0c-415a-912d-8123ea17a0cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:47.147149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-da70127b-1d0c-415a-912d-8123ea17a0cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:47.148871 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1304/2603] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:44:46 2022] DELETE /identity/v3/projects/8e2fbe6daaf24041a865c0bd68e1e0f3 => generated 0 bytes in 292 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:44:47.153965 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7c455-d327-4249-a316-d633233861a0 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:47.154263 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7c455-d327-4249-a316-d633233861a0 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:47.154669 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daa7c455-d327-4249-a316-d633233861a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:47.167272 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455ec12-79db-4ca6-ba48-5131c0400232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:47.167855 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455ec12-79db-4ca6-ba48-5131c0400232 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:47.168140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455ec12-79db-4ca6-ba48-5131c0400232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:47.168416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8455ec12-79db-4ca6-ba48-5131c0400232 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:47.169103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455ec12-79db-4ca6-ba48-5131c0400232 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:47.171077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8455ec12-79db-4ca6-ba48-5131c0400232 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:47.176704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-daa7c455-d327-4249-a316-d633233861a0 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:47.177963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-daa7c455-d327-4249-a316-d633233861a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:47.186110 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1305/2604] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:44:47.194907 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee8701-d857-4a45-b92c-8b82c507c6e4 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:47.195203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee8701-d857-4a45-b92c-8b82c507c6e4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:47.195525 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ee8701-d857-4a45-b92c-8b82c507c6e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:47.214510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-81ee8701-d857-4a45-b92c-8b82c507c6e4 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:47.217185 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-81ee8701-d857-4a45-b92c-8b82c507c6e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:47.224158 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1306/2605] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:44:47.228517 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee8701-d857-4a45-b92c-8b82c507c6e4 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:47.238730 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ee8701-d857-4a45-b92c-8b82c507c6e4 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:47.244880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1300/2606] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:44:47 2022] POST /identity/v3/users => generated 293 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:44:47.248598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84142ad5-3ebb-4395-a790-474eb7ee02d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:47.248598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84142ad5-3ebb-4395-a790-474eb7ee02d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:47.248598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84142ad5-3ebb-4395-a790-474eb7ee02d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:47.248598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84142ad5-3ebb-4395-a790-474eb7ee02d7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:47.248923 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84142ad5-3ebb-4395-a790-474eb7ee02d7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:44:47.248923 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84142ad5-3ebb-4395-a790-474eb7ee02d7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:47.248923 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84142ad5-3ebb-4395-a790-474eb7ee02d7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:47.252787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455ec12-79db-4ca6-ba48-5131c0400232 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:47.254391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8455ec12-79db-4ca6-ba48-5131c0400232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:47.262416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1307/2607] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:44:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 15 19:44:47.267548 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8455ec12-79db-4ca6-ba48-5131c0400232 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:47.268514 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84142ad5-3ebb-4395-a790-474eb7ee02d7 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:47.272853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763b077-281d-4ed9-93a4-e218b01f8860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:47.273554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b077-281d-4ed9-93a4-e218b01f8860 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:47.273840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b077-281d-4ed9-93a4-e218b01f8860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:47.274236 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b763b077-281d-4ed9-93a4-e218b01f8860 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:47.275207 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763b077-281d-4ed9-93a4-e218b01f8860 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:47.277339 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b763b077-281d-4ed9-93a4-e218b01f8860 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:47.281599 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84142ad5-3ebb-4395-a790-474eb7ee02d7 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:47.287931 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56eb316-7d5a-4dfd-83a2-6f0dc9fd2e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:47.288875 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1301/2608] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:44:47.289029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56eb316-7d5a-4dfd-83a2-6f0dc9fd2e36 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:47.289167 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56eb316-7d5a-4dfd-83a2-6f0dc9fd2e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:47.289424 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56eb316-7d5a-4dfd-83a2-6f0dc9fd2e36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:47.290205 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56eb316-7d5a-4dfd-83a2-6f0dc9fd2e36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:47.292436 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56eb316-7d5a-4dfd-83a2-6f0dc9fd2e36 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:47.292955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763b077-281d-4ed9-93a4-e218b01f8860 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:47.304231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b763b077-281d-4ed9-93a4-e218b01f8860 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:47.309939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7620167-4555-4168-8708-9defb259a81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:47.313436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7620167-4555-4168-8708-9defb259a81e admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:47.313436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7620167-4555-4168-8708-9defb259a81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:47.313436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7620167-4555-4168-8708-9defb259a81e admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:47.313436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7620167-4555-4168-8708-9defb259a81e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:47.314832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7620167-4555-4168-8708-9defb259a81e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:47.326905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1302/2609] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:44:47.332034 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7620167-4555-4168-8708-9defb259a81e admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:47.341917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7620167-4555-4168-8708-9defb259a81e admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:47.348477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea44674-6aab-4f96-8d8d-6491d4119f3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:47.349434 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea44674-6aab-4f96-8d8d-6491d4119f3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:47.353702 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea44674-6aab-4f96-8d8d-6491d4119f3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:47.353702 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea44674-6aab-4f96-8d8d-6491d4119f3c admin admin] PATH_INFO: `/v3/projects/cfefb5c4b0f04caba15a15891d632b73/users/5b611af5b8a44ca3a3aab430e3575350/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:47.366945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea44674-6aab-4f96-8d8d-6491d4119f3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=cfefb5c4b0f04caba15a15891d632b73, user_id=5b611af5b8a44ca3a3aab430e3575350, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:47.369814 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea44674-6aab-4f96-8d8d-6491d4119f3c admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:47.375282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1308/2610] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:44:47 2022] POST /identity/v3/projects => generated 405 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:44:47.379831 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56eb316-7d5a-4dfd-83a2-6f0dc9fd2e36 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:47.445892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56eb316-7d5a-4dfd-83a2-6f0dc9fd2e36 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:47.457866 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1303/2611] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:44:47 2022] PUT /identity/v3/projects/cfefb5c4b0f04caba15a15891d632b73/users/5b611af5b8a44ca3a3aab430e3575350/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:44:47.458622 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:47.461860 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34224646-d035-4004-a3e4-26d2a29f36ba None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:47.462157 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34224646-d035-4004-a3e4-26d2a29f36ba None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:47.462456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34224646-d035-4004-a3e4-26d2a29f36ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:47.494946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-34224646-d035-4004-a3e4-26d2a29f36ba None None] MFA Rules not processed for user `5b611af5b8a44ca3a3aab430e3575350`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:47.496188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-34224646-d035-4004-a3e4-26d2a29f36ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:47.528832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968a8ed-e116-4e4e-8387-853da98e19e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:47.528832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968a8ed-e116-4e4e-8387-853da98e19e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:47.528832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968a8ed-e116-4e4e-8387-853da98e19e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:47.528832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c968a8ed-e116-4e4e-8387-853da98e19e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:47.529190 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968a8ed-e116-4e4e-8387-853da98e19e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:47.529190 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c968a8ed-e116-4e4e-8387-853da98e19e0 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:47.562614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:47.568410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1304/2612] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:47 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:44:47.572770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34224646-d035-4004-a3e4-26d2a29f36ba None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:47.584271 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34224646-d035-4004-a3e4-26d2a29f36ba None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:47.589027 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec64a3-b7d7-40a2-aa56-e9029f8c2d0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:47.589683 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec64a3-b7d7-40a2-aa56-e9029f8c2d0d admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:47.589972 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec64a3-b7d7-40a2-aa56-e9029f8c2d0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:47.590282 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceec64a3-b7d7-40a2-aa56-e9029f8c2d0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:47.591007 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec64a3-b7d7-40a2-aa56-e9029f8c2d0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:47.592954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceec64a3-b7d7-40a2-aa56-e9029f8c2d0d admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:47.654776 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1309/2613] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:44:47 2022] POST /identity/v3/users => generated 303 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:44:47.659367 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968a8ed-e116-4e4e-8387-853da98e19e0 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:47.669901 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c968a8ed-e116-4e4e-8387-853da98e19e0 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:47.675659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa838cb2-156f-42a0-9a3a-cc4008c82065 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:47.676310 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa838cb2-156f-42a0-9a3a-cc4008c82065 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:47.676599 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa838cb2-156f-42a0-9a3a-cc4008c82065 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:47.676859 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa838cb2-156f-42a0-9a3a-cc4008c82065 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:47.677590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa838cb2-156f-42a0-9a3a-cc4008c82065 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:47.679211 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa838cb2-156f-42a0-9a3a-cc4008c82065 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:47.689542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1310/2614] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:44:47.695385 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa838cb2-156f-42a0-9a3a-cc4008c82065 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:47.706228 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa838cb2-156f-42a0-9a3a-cc4008c82065 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:47.711023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb36b5-f633-4916-b5c3-bd3cb9c4f558 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:47.711781 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb36b5-f633-4916-b5c3-bd3cb9c4f558 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:47.712062 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb36b5-f633-4916-b5c3-bd3cb9c4f558 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:47.712341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb36b5-f633-4916-b5c3-bd3cb9c4f558 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:47.713068 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb36b5-f633-4916-b5c3-bd3cb9c4f558 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:47.714661 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2feb36b5-f633-4916-b5c3-bd3cb9c4f558 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:47.726234 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1305/2615] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:44:47 2022] POST /identity/v3/projects => generated 383 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:44:47.727532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1311/2616] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:44:47.730618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec64a3-b7d7-40a2-aa56-e9029f8c2d0d admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:47.731573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb36b5-f633-4916-b5c3-bd3cb9c4f558 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:47.742464 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb36b5-f633-4916-b5c3-bd3cb9c4f558 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:47.798821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceec64a3-b7d7-40a2-aa56-e9029f8c2d0d admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:47.803146 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051f674c-2108-4c36-a44c-7041af895fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:47.804085 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f674c-2108-4c36-a44c-7041af895fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:47.804367 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f674c-2108-4c36-a44c-7041af895fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:47.804651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed05e8d-1e7c-48dc-b400-c438b4eabb6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:47.804804 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051f674c-2108-4c36-a44c-7041af895fc1 admin admin] PATH_INFO: `/v3/projects/f6bd073a1de948eca5b2e65f0b614ccc/users/c75a751f3c584aada9f6531539f25054/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:47.805333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed05e8d-1e7c-48dc-b400-c438b4eabb6c admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:47.805613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed05e8d-1e7c-48dc-b400-c438b4eabb6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:47.805888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed05e8d-1e7c-48dc-b400-c438b4eabb6c admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:47.806571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed05e8d-1e7c-48dc-b400-c438b4eabb6c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:47.808544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed05e8d-1e7c-48dc-b400-c438b4eabb6c admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:47.820742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f674c-2108-4c36-a44c-7041af895fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6bd073a1de948eca5b2e65f0b614ccc, user_id=c75a751f3c584aada9f6531539f25054, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:47.823482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051f674c-2108-4c36-a44c-7041af895fc1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:47.980904 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1306/2617] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:44:47 2022] POST /identity/v3/users => generated 292 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:44:47.984478 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed05e8d-1e7c-48dc-b400-c438b4eabb6c admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:47.994381 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed05e8d-1e7c-48dc-b400-c438b4eabb6c admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:47.999200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312c368-98aa-4fbc-b2ea-48c2484825ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:47.999840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312c368-98aa-4fbc-b2ea-48c2484825ac admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:48.000125 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312c368-98aa-4fbc-b2ea-48c2484825ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:48.000403 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9312c368-98aa-4fbc-b2ea-48c2484825ac admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:48.001408 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312c368-98aa-4fbc-b2ea-48c2484825ac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:48.003041 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9312c368-98aa-4fbc-b2ea-48c2484825ac admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:48.009897 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1312/2618] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:44:47 2022] PUT /identity/v3/projects/f6bd073a1de948eca5b2e65f0b614ccc/users/c75a751f3c584aada9f6531539f25054/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:44:48.013819 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1307/2619] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:44:48.015119 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f113c9-bee4-4d11-83af-012b16602347 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:48.015451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f113c9-bee4-4d11-83af-012b16602347 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:48.019945 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f113c9-bee4-4d11-83af-012b16602347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:48.022580 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312c368-98aa-4fbc-b2ea-48c2484825ac admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:48.034006 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9312c368-98aa-4fbc-b2ea-48c2484825ac admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:48.035604 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e0f113c9-bee4-4d11-83af-012b16602347 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:48.036862 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e0f113c9-bee4-4d11-83af-012b16602347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:48.095369 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:48.104848 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1313/2620] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:44:48.110541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f493a0-fcab-42c7-9173-672556be63d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:48.111309 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f493a0-fcab-42c7-9173-672556be63d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:48.111579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f493a0-fcab-42c7-9173-672556be63d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:48.111853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f493a0-fcab-42c7-9173-672556be63d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:48.112597 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f493a0-fcab-42c7-9173-672556be63d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:48.114549 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f493a0-fcab-42c7-9173-672556be63d7 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:48.115135 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f113c9-bee4-4d11-83af-012b16602347 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:48.116521 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e0f113c9-bee4-4d11-83af-012b16602347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:48.125737 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1308/2621] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:44:48.131738 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f493a0-fcab-42c7-9173-672556be63d7 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:48.142327 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f493a0-fcab-42c7-9173-672556be63d7 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:48.147378 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c967022-b546-4dbb-83e1-0a02e25905dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:48.148264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967022-b546-4dbb-83e1-0a02e25905dd admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:48.148544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967022-b546-4dbb-83e1-0a02e25905dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:48.148815 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c967022-b546-4dbb-83e1-0a02e25905dd admin admin] PATH_INFO: `/v3/projects/8c25dc52ddcd4f8885d5751684cdb505/users/5344999afd014465997e62ccd54e9d6e/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:48.164237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c967022-b546-4dbb-83e1-0a02e25905dd admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c25dc52ddcd4f8885d5751684cdb505, user_id=5344999afd014465997e62ccd54e9d6e, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:48.166934 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c967022-b546-4dbb-83e1-0a02e25905dd admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:48.178465 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f113c9-bee4-4d11-83af-012b16602347 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:48.182164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-235d5dae-6c74-47c0-ae17-4481ab3e22c2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:48.182847 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d5dae-6c74-47c0-ae17-4481ab3e22c2 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:48.183133 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d5dae-6c74-47c0-ae17-4481ab3e22c2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:48.183498 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-235d5dae-6c74-47c0-ae17-4481ab3e22c2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:48.193212 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d5dae-6c74-47c0-ae17-4481ab3e22c2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:48.194812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-235d5dae-6c74-47c0-ae17-4481ab3e22c2 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:48.204956 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1314/2622] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:44:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:44:48.238276 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1309/2623] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:44:48 2022] PUT /identity/v3/projects/8c25dc52ddcd4f8885d5751684cdb505/users/5344999afd014465997e62ccd54e9d6e/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:44:48.248861 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd53452-b049-4d32-943e-8160b445fad1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:48.249175 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd53452-b049-4d32-943e-8160b445fad1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:48.249454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd53452-b049-4d32-943e-8160b445fad1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:48.278719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ecd53452-b049-4d32-943e-8160b445fad1 None None] MFA Rules not processed for user `5344999afd014465997e62ccd54e9d6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:48.280004 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ecd53452-b049-4d32-943e-8160b445fad1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:48.355042 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1315/2624] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:48 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:48.359807 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c967022-b546-4dbb-83e1-0a02e25905dd admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:48.395435 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:48.429607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c967022-b546-4dbb-83e1-0a02e25905dd admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:48.434561 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78384029-bf74-482f-b3f3-b9df49317f06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:48.435255 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384029-bf74-482f-b3f3-b9df49317f06 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:48.435539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384029-bf74-482f-b3f3-b9df49317f06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:48.435809 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78384029-bf74-482f-b3f3-b9df49317f06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:48.436492 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78384029-bf74-482f-b3f3-b9df49317f06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:48.438459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78384029-bf74-482f-b3f3-b9df49317f06 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:48.575522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1310/2625] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:44:48 2022] POST /identity/v3/projects => generated 383 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:44:48.579689 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd53452-b049-4d32-943e-8160b445fad1 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:48.591114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecd53452-b049-4d32-943e-8160b445fad1 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:48.660164 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4cde3-2b65-4a09-ae59-d307b875dd43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:48.661493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4cde3-2b65-4a09-ae59-d307b875dd43 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:48.661493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4cde3-2b65-4a09-ae59-d307b875dd43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:48.661738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af4cde3-2b65-4a09-ae59-d307b875dd43 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:48.662440 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4cde3-2b65-4a09-ae59-d307b875dd43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:48.664499 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af4cde3-2b65-4a09-ae59-d307b875dd43 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:48.784517 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1316/2626] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:44:48 2022] POST /identity/v3/users => generated 298 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:44:48.785838 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78384029-bf74-482f-b3f3-b9df49317f06 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:48.796589 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78384029-bf74-482f-b3f3-b9df49317f06 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:48.801635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44a18d-1802-4636-a4f4-048c2268e515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:48.802308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44a18d-1802-4636-a4f4-048c2268e515 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:48.802618 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44a18d-1802-4636-a4f4-048c2268e515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:48.802936 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d44a18d-1802-4636-a4f4-048c2268e515 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:48.803698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44a18d-1802-4636-a4f4-048c2268e515 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:48.805301 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d44a18d-1802-4636-a4f4-048c2268e515 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:48.816835 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1311/2627] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:44:48.823857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4cde3-2b65-4a09-ae59-d307b875dd43 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:48.835270 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af4cde3-2b65-4a09-ae59-d307b875dd43 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:48.839969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587af43-9125-462f-b341-3f567fcf190e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:48.840864 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587af43-9125-462f-b341-3f567fcf190e admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:48.841168 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587af43-9125-462f-b341-3f567fcf190e admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:48.841705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e587af43-9125-462f-b341-3f567fcf190e admin admin] PATH_INFO: `/v3/projects/97e17e5bc2344856a669da2d980af498/users/1f8da9c374194a7b8a9bbb882d7aa3fc/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:48.859510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587af43-9125-462f-b341-3f567fcf190e admin admin] RBAC: Authorizing `identity:create_grant(project_id=97e17e5bc2344856a669da2d980af498, user_id=1f8da9c374194a7b8a9bbb882d7aa3fc, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:48.862606 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e587af43-9125-462f-b341-3f567fcf190e admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:48.946456 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:48.957038 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1317/2628] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:44:48 2022] PUT /identity/v3/projects/97e17e5bc2344856a669da2d980af498/users/1f8da9c374194a7b8a9bbb882d7aa3fc/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:48.958316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44a18d-1802-4636-a4f4-048c2268e515 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:48.969182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d44a18d-1802-4636-a4f4-048c2268e515 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:49.028414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe79631-3ba2-440e-914f-ae5ab095677f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:49.029005 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe79631-3ba2-440e-914f-ae5ab095677f admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:49.029294 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe79631-3ba2-440e-914f-ae5ab095677f admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:49.029576 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe79631-3ba2-440e-914f-ae5ab095677f admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:49.030352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe79631-3ba2-440e-914f-ae5ab095677f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:49.032038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe79631-3ba2-440e-914f-ae5ab095677f admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:49.042635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1312/2629] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:48 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:44:49.046960 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587af43-9125-462f-b341-3f567fcf190e admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:49.058022 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e587af43-9125-462f-b341-3f567fcf190e admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:49.063084 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89cc32-533d-43c5-a969-1a5cca174f39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:49.064529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89cc32-533d-43c5-a969-1a5cca174f39 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:49.064804 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89cc32-533d-43c5-a969-1a5cca174f39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:49.065102 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc89cc32-533d-43c5-a969-1a5cca174f39 admin admin] PATH_INFO: `/v3/projects/97e17e5bc2344856a669da2d980af498/users/1f8da9c374194a7b8a9bbb882d7aa3fc/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:49.067230 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89cc32-533d-43c5-a969-1a5cca174f39 admin admin] RBAC: Authorizing `identity:create_grant(project_id=97e17e5bc2344856a669da2d980af498, user_id=1f8da9c374194a7b8a9bbb882d7aa3fc, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:49.069936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc89cc32-533d-43c5-a969-1a5cca174f39 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:49.082591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1318/2630] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:44:49 2022] PUT /identity/v3/projects/97e17e5bc2344856a669da2d980af498/users/1f8da9c374194a7b8a9bbb882d7aa3fc/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:49.092846 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a9402-9e09-4827-ad67-b2ee01275a45 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:49.093236 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a9402-9e09-4827-ad67-b2ee01275a45 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:49.093533 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9a9402-9e09-4827-ad67-b2ee01275a45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:49.121692 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-eb9a9402-9e09-4827-ad67-b2ee01275a45 None None] MFA Rules not processed for user `1f8da9c374194a7b8a9bbb882d7aa3fc`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:49.123134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-eb9a9402-9e09-4827-ad67-b2ee01275a45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:49.192490 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1313/2631] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:49 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:49.204579 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89cc32-533d-43c5-a969-1a5cca174f39 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:49.206836 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cc89cc32-533d-43c5-a969-1a5cca174f39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:49.265667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc89cc32-533d-43c5-a969-1a5cca174f39 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:49.270387 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d637b4-f5a0-42d6-8c9f-efc8bd0431fe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:49.271063 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d637b4-f5a0-42d6-8c9f-efc8bd0431fe service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:49.271344 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d637b4-f5a0-42d6-8c9f-efc8bd0431fe service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:49.271637 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d637b4-f5a0-42d6-8c9f-efc8bd0431fe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:49.340321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d637b4-f5a0-42d6-8c9f-efc8bd0431fe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:49.342561 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d637b4-f5a0-42d6-8c9f-efc8bd0431fe service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:49.343198 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6442f-603a-47a6-af5c-2d57545d84db None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:49.343707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6442f-603a-47a6-af5c-2d57545d84db None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:49.343963 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c6442f-603a-47a6-af5c-2d57545d84db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:49.353486 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1319/2632] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:44:49 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:44:49.374107 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-73c6442f-603a-47a6-af5c-2d57545d84db None None] MFA Rules not processed for user `c75a751f3c584aada9f6531539f25054`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:49.375446 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-73c6442f-603a-47a6-af5c-2d57545d84db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:49.387507 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:49.459341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1314/2633] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:49 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:44:49.464245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d637b4-f5a0-42d6-8c9f-efc8bd0431fe service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:49.542473 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d637b4-f5a0-42d6-8c9f-efc8bd0431fe service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:49.547251 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3771eb3-9504-4bc2-a0c8-6ffc6915f9ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:49.548655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3771eb3-9504-4bc2-a0c8-6ffc6915f9ad admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:49.549065 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3771eb3-9504-4bc2-a0c8-6ffc6915f9ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:49.549345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3771eb3-9504-4bc2-a0c8-6ffc6915f9ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:49.550069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3771eb3-9504-4bc2-a0c8-6ffc6915f9ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:49.552015 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3771eb3-9504-4bc2-a0c8-6ffc6915f9ad admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:49.661336 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1320/2634] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:44:49 2022] POST /identity/v3/projects => generated 403 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:44:49.665430 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6442f-603a-47a6-af5c-2d57545d84db None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:49.676678 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c6442f-603a-47a6-af5c-2d57545d84db None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:49.734828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c7635-51f9-4bd3-adaa-eb15292372cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:49.737175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c7635-51f9-4bd3-adaa-eb15292372cf admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:49.737175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c7635-51f9-4bd3-adaa-eb15292372cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:49.737175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7c7635-51f9-4bd3-adaa-eb15292372cf admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:49.737739 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c7635-51f9-4bd3-adaa-eb15292372cf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:49.739856 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7c7635-51f9-4bd3-adaa-eb15292372cf admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:49.865108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1315/2635] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:44:49 2022] POST /identity/v3/users => generated 308 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:44:49.865446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3771eb3-9504-4bc2-a0c8-6ffc6915f9ad admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:49.875388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3771eb3-9504-4bc2-a0c8-6ffc6915f9ad admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:49.880281 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807c62f-37d8-4d5f-aef7-ee576f735fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:49.880936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807c62f-37d8-4d5f-aef7-ee576f735fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:49.881216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807c62f-37d8-4d5f-aef7-ee576f735fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:49.881484 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807c62f-37d8-4d5f-aef7-ee576f735fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:49.882203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807c62f-37d8-4d5f-aef7-ee576f735fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:49.883863 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807c62f-37d8-4d5f-aef7-ee576f735fe1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:49.895146 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1321/2636] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:44:49.902583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c7635-51f9-4bd3-adaa-eb15292372cf admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:49.914430 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7c7635-51f9-4bd3-adaa-eb15292372cf admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:49.919387 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d01689-7688-4e6b-98ce-b8e06736b6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:49.920259 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d01689-7688-4e6b-98ce-b8e06736b6da admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:49.920546 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d01689-7688-4e6b-98ce-b8e06736b6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:49.920975 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d01689-7688-4e6b-98ce-b8e06736b6da admin admin] PATH_INFO: `/v3/projects/eb9c818e6544498a8aa1e11f83c49163/users/d69382d921884fcf80e448ada5eeaf57/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:49.937373 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d01689-7688-4e6b-98ce-b8e06736b6da admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9c818e6544498a8aa1e11f83c49163, user_id=d69382d921884fcf80e448ada5eeaf57, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:49.941968 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d01689-7688-4e6b-98ce-b8e06736b6da admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:50.038804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1316/2637] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:44:49 2022] PUT /identity/v3/projects/eb9c818e6544498a8aa1e11f83c49163/users/d69382d921884fcf80e448ada5eeaf57/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:50.042570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807c62f-37d8-4d5f-aef7-ee576f735fe1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:50.053980 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807c62f-37d8-4d5f-aef7-ee576f735fe1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:50.067186 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:50.113223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b1a80-74ec-442d-ac35-818a6af3a24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:50.113893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b1a80-74ec-442d-ac35-818a6af3a24b admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:50.114177 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b1a80-74ec-442d-ac35-818a6af3a24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:50.114444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9b1a80-74ec-442d-ac35-818a6af3a24b admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:50.115381 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b1a80-74ec-442d-ac35-818a6af3a24b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:50.116801 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9b1a80-74ec-442d-ac35-818a6af3a24b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:50.128037 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1322/2638] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:50 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:44:50.132329 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d01689-7688-4e6b-98ce-b8e06736b6da admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:50.143847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d01689-7688-4e6b-98ce-b8e06736b6da admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:50.148628 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d1eb8c-6a24-441e-84f8-fb3c69a2228e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:50.149582 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1eb8c-6a24-441e-84f8-fb3c69a2228e admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:50.149837 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1eb8c-6a24-441e-84f8-fb3c69a2228e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:50.150079 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d1eb8c-6a24-441e-84f8-fb3c69a2228e admin admin] PATH_INFO: `/v3/projects/eb9c818e6544498a8aa1e11f83c49163/users/d69382d921884fcf80e448ada5eeaf57/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:50.152105 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1eb8c-6a24-441e-84f8-fb3c69a2228e admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9c818e6544498a8aa1e11f83c49163, user_id=d69382d921884fcf80e448ada5eeaf57, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:50.154864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d1eb8c-6a24-441e-84f8-fb3c69a2228e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:50.166419 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1317/2639] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:44:50 2022] PUT /identity/v3/projects/eb9c818e6544498a8aa1e11f83c49163/users/d69382d921884fcf80e448ada5eeaf57/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:51.372666 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b1a80-74ec-442d-ac35-818a6af3a24b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:51.374295 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0e9b1a80-74ec-442d-ac35-818a6af3a24b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:51.432980 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9b1a80-74ec-442d-ac35-818a6af3a24b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:51.483770 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a0dcb-f0c0-4930-81bd-117cefe85865 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:51.484418 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a0dcb-f0c0-4930-81bd-117cefe85865 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:51.484702 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a0dcb-f0c0-4930-81bd-117cefe85865 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:51.484980 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24a0dcb-f0c0-4930-81bd-117cefe85865 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:51.547443 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a0dcb-f0c0-4930-81bd-117cefe85865 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:51.549725 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24a0dcb-f0c0-4930-81bd-117cefe85865 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:51.559121 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1323/2640] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:44:51 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:44:51.609581 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be04fc-678d-4a0d-a448-e23be4d2dc06 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:51.610153 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be04fc-678d-4a0d-a448-e23be4d2dc06 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:51.610242 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be04fc-678d-4a0d-a448-e23be4d2dc06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:51.644059 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-66be04fc-678d-4a0d-a448-e23be4d2dc06 None None] MFA Rules not processed for user `d69382d921884fcf80e448ada5eeaf57`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:51.646174 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-66be04fc-678d-4a0d-a448-e23be4d2dc06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:51.705007 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:51.724917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1318/2641] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:51 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:53.036129 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a0dcb-f0c0-4930-81bd-117cefe85865 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:53.044953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24a0dcb-f0c0-4930-81bd-117cefe85865 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:53.048923 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23c710-9502-4772-9efa-89535ebbdc44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:53.049706 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23c710-9502-4772-9efa-89535ebbdc44 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:53.049990 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23c710-9502-4772-9efa-89535ebbdc44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:53.050265 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d23c710-9502-4772-9efa-89535ebbdc44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:53.072763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:53.116304 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23c710-9502-4772-9efa-89535ebbdc44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:53.117735 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d23c710-9502-4772-9efa-89535ebbdc44 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:53.128387 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1324/2642] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:44:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:44:53.210881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be04fc-678d-4a0d-a448-e23be4d2dc06 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:53.277503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be04fc-678d-4a0d-a448-e23be4d2dc06 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:53.282168 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7008a-1ba7-4b2d-8e51-b0ed30c8efe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:53.283287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7008a-1ba7-4b2d-8e51-b0ed30c8efe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:53.283571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7008a-1ba7-4b2d-8e51-b0ed30c8efe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:53.283846 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae7008a-1ba7-4b2d-8e51-b0ed30c8efe3 admin admin] PATH_INFO: `/v3/users/c75a751f3c584aada9f6531539f25054` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:53.285049 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7008a-1ba7-4b2d-8e51-b0ed30c8efe3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c75a751f3c584aada9f6531539f25054)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:53.287017 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae7008a-1ba7-4b2d-8e51-b0ed30c8efe3 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:53.566078 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-1ae7008a-1ba7-4b2d-8e51-b0ed30c8efe3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c75a751f3c584aada9f6531539f25054'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:53.566819 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-1ae7008a-1ba7-4b2d-8e51-b0ed30c8efe3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c75a751f3c584aada9f6531539f25054'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:53.660134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-1ae7008a-1ba7-4b2d-8e51-b0ed30c8efe3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c75a751f3c584aada9f6531539f25054'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:53.660801 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-1ae7008a-1ba7-4b2d-8e51-b0ed30c8efe3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c75a751f3c584aada9f6531539f25054'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:53.674990 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-1ae7008a-1ba7-4b2d-8e51-b0ed30c8efe3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c75a751f3c584aada9f6531539f25054'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:53.687453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1319/2643] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:44:53 2022] DELETE /identity/v3/users/c75a751f3c584aada9f6531539f25054 => generated 0 bytes in 477 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:54.035220 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23c710-9502-4772-9efa-89535ebbdc44 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:54.048428 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d23c710-9502-4772-9efa-89535ebbdc44 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:54.116254 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:54.117151 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:54.117438 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:54.117719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3 admin admin] PATH_INFO: `/v3/projects/f6bd073a1de948eca5b2e65f0b614ccc` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:54.119108 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6bd073a1de948eca5b2e65f0b614ccc)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:54.121126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:54.244640 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6bd073a1de948eca5b2e65f0b614ccc', 'request_id': 'req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:54.252252 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6bd073a1de948eca5b2e65f0b614ccc', 'request_id': 'req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:54.258949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6bd073a1de948eca5b2e65f0b614ccc', 'request_id': 'req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:54.351110 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3 admin admin] The token cache is being invalidate because project f6bd073a1de948eca5b2e65f0b614ccc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:44:54.351323 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:54.351929 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:54.353580 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1325/2644] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:44:54 2022] DELETE /identity/v3/projects/f6bd073a1de948eca5b2e65f0b614ccc => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:54.357828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7008a-1ba7-4b2d-8e51-b0ed30c8efe3 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:54.359261 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1ae7008a-1ba7-4b2d-8e51-b0ed30c8efe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:54.372688 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae7008a-1ba7-4b2d-8e51-b0ed30c8efe3 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:54.432501 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934a09b-0d11-4d41-b8ff-ce692fd38bd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:54.433422 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934a09b-0d11-4d41-b8ff-ce692fd38bd0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:54.433658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934a09b-0d11-4d41-b8ff-ce692fd38bd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:54.433936 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934a09b-0d11-4d41-b8ff-ce692fd38bd0 admin admin] PATH_INFO: `/v3/users/d69382d921884fcf80e448ada5eeaf57` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:54.435229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934a09b-0d11-4d41-b8ff-ce692fd38bd0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d69382d921884fcf80e448ada5eeaf57)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:54.437182 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934a09b-0d11-4d41-b8ff-ce692fd38bd0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:54.448607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:54.656440 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-3934a09b-0d11-4d41-b8ff-ce692fd38bd0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd69382d921884fcf80e448ada5eeaf57'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:54.657089 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-3934a09b-0d11-4d41-b8ff-ce692fd38bd0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd69382d921884fcf80e448ada5eeaf57'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:54.711208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-3934a09b-0d11-4d41-b8ff-ce692fd38bd0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd69382d921884fcf80e448ada5eeaf57'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:54.711855 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-3934a09b-0d11-4d41-b8ff-ce692fd38bd0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd69382d921884fcf80e448ada5eeaf57'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:54.725731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-3934a09b-0d11-4d41-b8ff-ce692fd38bd0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd69382d921884fcf80e448ada5eeaf57'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:54.739553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1320/2645] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:44:54 2022] DELETE /identity/v3/users/d69382d921884fcf80e448ada5eeaf57 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:55.078232 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:55.080046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:55.153861 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:55.190798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751ddf47-f7dd-45ab-a2ac-413cefc1fbe3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:55.252036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672cbd87-a36c-4648-8669-38ecbdebc93d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:55.252036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cbd87-a36c-4648-8669-38ecbdebc93d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:55.252036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cbd87-a36c-4648-8669-38ecbdebc93d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:55.252036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672cbd87-a36c-4648-8669-38ecbdebc93d admin admin] PATH_INFO: `/v3/projects/eb9c818e6544498a8aa1e11f83c49163` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:55.252590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672cbd87-a36c-4648-8669-38ecbdebc93d admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9c818e6544498a8aa1e11f83c49163)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:55.252590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672cbd87-a36c-4648-8669-38ecbdebc93d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:55.415077 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-672cbd87-a36c-4648-8669-38ecbdebc93d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9c818e6544498a8aa1e11f83c49163', 'request_id': 'req-672cbd87-a36c-4648-8669-38ecbdebc93d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:55.421490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-672cbd87-a36c-4648-8669-38ecbdebc93d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9c818e6544498a8aa1e11f83c49163', 'request_id': 'req-672cbd87-a36c-4648-8669-38ecbdebc93d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:55.427120 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-672cbd87-a36c-4648-8669-38ecbdebc93d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9c818e6544498a8aa1e11f83c49163', 'request_id': 'req-672cbd87-a36c-4648-8669-38ecbdebc93d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:55.545925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-672cbd87-a36c-4648-8669-38ecbdebc93d admin admin] The token cache is being invalidate because project eb9c818e6544498a8aa1e11f83c49163 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:44:55.546147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-672cbd87-a36c-4648-8669-38ecbdebc93d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:55.546774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-672cbd87-a36c-4648-8669-38ecbdebc93d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:55.548442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1326/2646] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:44:55 2022] DELETE /identity/v3/projects/eb9c818e6544498a8aa1e11f83c49163 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:55.554580 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7b75e-7a2a-4a63-824e-24b0f405a930 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:55.557395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7b75e-7a2a-4a63-824e-24b0f405a930 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:55.557395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b7b75e-7a2a-4a63-824e-24b0f405a930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:55.616414 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-c9b7b75e-7a2a-4a63-824e-24b0f405a930 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:55.617818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-c9b7b75e-7a2a-4a63-824e-24b0f405a930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:55.678331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1321/2647] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:55.686465 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7622ab-5d7b-42f9-a816-28169f68ce56 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:55.686802 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7622ab-5d7b-42f9-a816-28169f68ce56 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:55.687089 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7622ab-5d7b-42f9-a816-28169f68ce56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:55.706460 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-db7622ab-5d7b-42f9-a816-28169f68ce56 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:55.707738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-db7622ab-5d7b-42f9-a816-28169f68ce56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:55.716021 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1327/2648] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:55.721435 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7b75e-7a2a-4a63-824e-24b0f405a930 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:55.731409 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b7b75e-7a2a-4a63-824e-24b0f405a930 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:55.736423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665f702-69d2-4599-8770-d642cfe0d53b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:55.737128 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665f702-69d2-4599-8770-d642cfe0d53b admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:55.737417 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665f702-69d2-4599-8770-d642cfe0d53b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:55.737696 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2665f702-69d2-4599-8770-d642cfe0d53b admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:55.738536 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665f702-69d2-4599-8770-d642cfe0d53b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:44:55.738911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665f702-69d2-4599-8770-d642cfe0d53b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:55.740613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2665f702-69d2-4599-8770-d642cfe0d53b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:55.753209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1322/2649] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:44:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:44:55.758000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7622ab-5d7b-42f9-a816-28169f68ce56 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:55.768223 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7622ab-5d7b-42f9-a816-28169f68ce56 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:55.773194 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c940b-bde9-4e88-8b4d-cf367390ed1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:55.773844 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c940b-bde9-4e88-8b4d-cf367390ed1a admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:55.774124 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c940b-bde9-4e88-8b4d-cf367390ed1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:55.774394 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75c940b-bde9-4e88-8b4d-cf367390ed1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:55.775118 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c940b-bde9-4e88-8b4d-cf367390ed1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:55.777012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75c940b-bde9-4e88-8b4d-cf367390ed1a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:55.993569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1328/2650] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:44:55 2022] POST /identity/v3/projects => generated 375 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:44:55.997973 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665f702-69d2-4599-8770-d642cfe0d53b admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:56.009079 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2665f702-69d2-4599-8770-d642cfe0d53b admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:56.050915 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:56.067079 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369d5fb-f03e-4cca-864a-3820545497f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:56.067789 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369d5fb-f03e-4cca-864a-3820545497f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:56.068072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369d5fb-f03e-4cca-864a-3820545497f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:56.068355 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b369d5fb-f03e-4cca-864a-3820545497f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:56.069107 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369d5fb-f03e-4cca-864a-3820545497f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:56.071399 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b369d5fb-f03e-4cca-864a-3820545497f8 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:56.197630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1323/2651] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:44:55 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:44:56.201798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c940b-bde9-4e88-8b4d-cf367390ed1a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:56.212430 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75c940b-bde9-4e88-8b4d-cf367390ed1a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:56.217000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f58c7-bbe2-4e91-a638-23d2403ed7cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:56.217656 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f58c7-bbe2-4e91-a638-23d2403ed7cc admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:56.217992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f58c7-bbe2-4e91-a638-23d2403ed7cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:56.218216 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703f58c7-bbe2-4e91-a638-23d2403ed7cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:56.219012 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f58c7-bbe2-4e91-a638-23d2403ed7cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:56.220668 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703f58c7-bbe2-4e91-a638-23d2403ed7cc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:56.232416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1329/2652] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:44:56.236862 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369d5fb-f03e-4cca-864a-3820545497f8 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:56.249755 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b369d5fb-f03e-4cca-864a-3820545497f8 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:56.257765 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68f2c7-3bba-411b-9983-eb154a53f7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:56.262628 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68f2c7-3bba-411b-9983-eb154a53f7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:56.262628 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68f2c7-3bba-411b-9983-eb154a53f7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:56.262628 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68f2c7-3bba-411b-9983-eb154a53f7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:56.262628 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68f2c7-3bba-411b-9983-eb154a53f7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:56.262628 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68f2c7-3bba-411b-9983-eb154a53f7c1 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:56.274050 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1324/2653] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:44:56.278454 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f58c7-bbe2-4e91-a638-23d2403ed7cc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:56.288402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703f58c7-bbe2-4e91-a638-23d2403ed7cc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:56.292914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec85a41-e076-46d3-98fe-719236df89fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:56.293779 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec85a41-e076-46d3-98fe-719236df89fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:56.294058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec85a41-e076-46d3-98fe-719236df89fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:56.294350 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec85a41-e076-46d3-98fe-719236df89fc admin admin] PATH_INFO: `/v3/projects/80451dd7dbc3420491e136061db9614d/users/856c6622644043f895a8a4b313d79d45/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:56.309440 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec85a41-e076-46d3-98fe-719236df89fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=80451dd7dbc3420491e136061db9614d, user_id=856c6622644043f895a8a4b313d79d45, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:56.312094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec85a41-e076-46d3-98fe-719236df89fc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:56.373766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1330/2654] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:44:56 2022] PUT /identity/v3/projects/80451dd7dbc3420491e136061db9614d/users/856c6622644043f895a8a4b313d79d45/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:56.386246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd266e66-c86c-475d-8aba-7002486253d9 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:56.386540 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd266e66-c86c-475d-8aba-7002486253d9 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:56.386848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd266e66-c86c-475d-8aba-7002486253d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:56.415505 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-bd266e66-c86c-475d-8aba-7002486253d9 None None] MFA Rules not processed for user `856c6622644043f895a8a4b313d79d45`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:56.416725 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-bd266e66-c86c-475d-8aba-7002486253d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:56.484920 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1325/2655] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:56.490580 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec85a41-e076-46d3-98fe-719236df89fc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:56.500575 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:56.555754 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec85a41-e076-46d3-98fe-719236df89fc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:56.560359 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345778e2-7c84-480c-9eb5-bc616480ef55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:56.561008 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345778e2-7c84-480c-9eb5-bc616480ef55 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:56.561295 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345778e2-7c84-480c-9eb5-bc616480ef55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:56.561593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345778e2-7c84-480c-9eb5-bc616480ef55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:56.562270 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345778e2-7c84-480c-9eb5-bc616480ef55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:56.564482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345778e2-7c84-480c-9eb5-bc616480ef55 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:56.668010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1331/2656] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:44:56 2022] POST /identity/v3/projects => generated 377 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:44:56.674329 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd266e66-c86c-475d-8aba-7002486253d9 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:56.688377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd266e66-c86c-475d-8aba-7002486253d9 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:56.745880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e099d7-0675-4972-8a50-d4ad8649e3ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:56.746562 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e099d7-0675-4972-8a50-d4ad8649e3ef admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:56.746916 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e099d7-0675-4972-8a50-d4ad8649e3ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:56.747195 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e099d7-0675-4972-8a50-d4ad8649e3ef admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:56.747881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e099d7-0675-4972-8a50-d4ad8649e3ef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:56.749817 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e099d7-0675-4972-8a50-d4ad8649e3ef admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:56.997737 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1326/2657] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:44:56 2022] POST /identity/v3/users => generated 289 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:44:57.002591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345778e2-7c84-480c-9eb5-bc616480ef55 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:57.013815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345778e2-7c84-480c-9eb5-bc616480ef55 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:57.019257 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb93f2-866b-44cb-9725-4501e0eda21c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:57.020027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb93f2-866b-44cb-9725-4501e0eda21c admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:57.020404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb93f2-866b-44cb-9725-4501e0eda21c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:57.020687 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5fb93f2-866b-44cb-9725-4501e0eda21c admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:57.021414 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb93f2-866b-44cb-9725-4501e0eda21c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:57.023127 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5fb93f2-866b-44cb-9725-4501e0eda21c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:57.042740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1332/2658] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:44:57.045390 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e099d7-0675-4972-8a50-d4ad8649e3ef admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:57.056036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e099d7-0675-4972-8a50-d4ad8649e3ef admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:57.060651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c45a62-28ef-4ef6-933c-02d7383ddd6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:57.061307 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c45a62-28ef-4ef6-933c-02d7383ddd6a admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:57.061596 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c45a62-28ef-4ef6-933c-02d7383ddd6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:57.061882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c45a62-28ef-4ef6-933c-02d7383ddd6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:57.062610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c45a62-28ef-4ef6-933c-02d7383ddd6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:57.064654 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c45a62-28ef-4ef6-933c-02d7383ddd6a admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:57.075206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1327/2659] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:44:57.079925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb93f2-866b-44cb-9725-4501e0eda21c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:57.089961 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5fb93f2-866b-44cb-9725-4501e0eda21c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:57.094446 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f538ae-95c7-4822-b6ab-e33998f3f6ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:57.096000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f538ae-95c7-4822-b6ab-e33998f3f6ff admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:57.096279 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f538ae-95c7-4822-b6ab-e33998f3f6ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:57.096549 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f538ae-95c7-4822-b6ab-e33998f3f6ff admin admin] PATH_INFO: `/v3/projects/5447881986dd4cd5819b70633cebdb6e/users/f406d6b96b7b47278b8fdcd430895344/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:57.112324 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f538ae-95c7-4822-b6ab-e33998f3f6ff admin admin] RBAC: Authorizing `identity:create_grant(project_id=5447881986dd4cd5819b70633cebdb6e, user_id=f406d6b96b7b47278b8fdcd430895344, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:57.115037 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f538ae-95c7-4822-b6ab-e33998f3f6ff admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:57.203406 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1333/2660] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:44:57 2022] PUT /identity/v3/projects/5447881986dd4cd5819b70633cebdb6e/users/f406d6b96b7b47278b8fdcd430895344/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:57.215285 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c50dd6-6cc2-4b0a-840e-1799f909a676 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:57.215519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c50dd6-6cc2-4b0a-840e-1799f909a676 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:57.216150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c50dd6-6cc2-4b0a-840e-1799f909a676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:57.251130 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-54c50dd6-6cc2-4b0a-840e-1799f909a676 None None] MFA Rules not processed for user `f406d6b96b7b47278b8fdcd430895344`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:57.251130 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-54c50dd6-6cc2-4b0a-840e-1799f909a676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:57.267891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:57.315918 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1328/2661] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:57 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:57.320420 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f538ae-95c7-4822-b6ab-e33998f3f6ff admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:57.386252 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f538ae-95c7-4822-b6ab-e33998f3f6ff admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:57.391005 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e1331-b64e-41e8-8d87-fafb91a60a2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:57.391667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e1331-b64e-41e8-8d87-fafb91a60a2d admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:57.392638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e1331-b64e-41e8-8d87-fafb91a60a2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:57.393093 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4e1331-b64e-41e8-8d87-fafb91a60a2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:57.393903 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e1331-b64e-41e8-8d87-fafb91a60a2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:57.395867 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c4e1331-b64e-41e8-8d87-fafb91a60a2d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:57.490277 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1334/2662] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:44:57 2022] POST /identity/v3/projects => generated 377 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:44:57.494460 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c50dd6-6cc2-4b0a-840e-1799f909a676 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:57.506011 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c50dd6-6cc2-4b0a-840e-1799f909a676 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:57.690338 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c0bd3-e856-4b90-a456-9ef6789c8759 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:57.691076 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c0bd3-e856-4b90-a456-9ef6789c8759 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:57.691361 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c0bd3-e856-4b90-a456-9ef6789c8759 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:57.691638 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28c0bd3-e856-4b90-a456-9ef6789c8759 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:57.692372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c0bd3-e856-4b90-a456-9ef6789c8759 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:57.694305 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b28c0bd3-e856-4b90-a456-9ef6789c8759 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:57.787560 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1329/2663] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:44:57 2022] POST /identity/v3/users => generated 295 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:44:57.791684 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e1331-b64e-41e8-8d87-fafb91a60a2d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:57.802330 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c4e1331-b64e-41e8-8d87-fafb91a60a2d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:57.807131 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76872fe3-2164-4887-8d9f-563e38df062b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:57.807788 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76872fe3-2164-4887-8d9f-563e38df062b admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:57.808074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76872fe3-2164-4887-8d9f-563e38df062b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:57.811318 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76872fe3-2164-4887-8d9f-563e38df062b admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:57.811318 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76872fe3-2164-4887-8d9f-563e38df062b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:57.811318 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76872fe3-2164-4887-8d9f-563e38df062b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:57.821857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1335/2664] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:44:57.826241 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c0bd3-e856-4b90-a456-9ef6789c8759 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:57.837286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28c0bd3-e856-4b90-a456-9ef6789c8759 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:57.842028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f026eb-d098-412a-aa99-a6181286299f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:57.842946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f026eb-d098-412a-aa99-a6181286299f admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:57.843229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f026eb-d098-412a-aa99-a6181286299f admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:57.843505 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f026eb-d098-412a-aa99-a6181286299f admin admin] PATH_INFO: `/v3/projects/cf5a2efcbea741989689082893be5a91/users/a0167c849c1940ca8b23723f38521427/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:57.859242 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f026eb-d098-412a-aa99-a6181286299f admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5a2efcbea741989689082893be5a91, user_id=a0167c849c1940ca8b23723f38521427, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:57.862439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f026eb-d098-412a-aa99-a6181286299f admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:57.951601 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1330/2665] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:44:57 2022] PUT /identity/v3/projects/cf5a2efcbea741989689082893be5a91/users/a0167c849c1940ca8b23723f38521427/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:57.956549 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76872fe3-2164-4887-8d9f-563e38df062b admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:57.966772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76872fe3-2164-4887-8d9f-563e38df062b admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:57.998116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:58.024736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6665bfd8-10b4-4b44-b305-83bdaefefd2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:58.025409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665bfd8-10b4-4b44-b305-83bdaefefd2f admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:58.025691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665bfd8-10b4-4b44-b305-83bdaefefd2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:58.025966 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6665bfd8-10b4-4b44-b305-83bdaefefd2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:58.026695 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665bfd8-10b4-4b44-b305-83bdaefefd2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:58.028315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6665bfd8-10b4-4b44-b305-83bdaefefd2f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:58.040305 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1336/2666] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:44:57 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:44:58.043836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f026eb-d098-412a-aa99-a6181286299f admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:58.054827 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f026eb-d098-412a-aa99-a6181286299f admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:58.059564 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13505cb-642f-47ec-8837-7535dee53d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:58.060445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13505cb-642f-47ec-8837-7535dee53d0e admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:58.060716 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13505cb-642f-47ec-8837-7535dee53d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:58.060991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13505cb-642f-47ec-8837-7535dee53d0e admin admin] PATH_INFO: `/v3/projects/cf5a2efcbea741989689082893be5a91/users/a0167c849c1940ca8b23723f38521427/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:58.067695 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13505cb-642f-47ec-8837-7535dee53d0e admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf5a2efcbea741989689082893be5a91, user_id=a0167c849c1940ca8b23723f38521427, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:58.072808 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d13505cb-642f-47ec-8837-7535dee53d0e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:58.086005 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1331/2667] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:44:58 2022] PUT /identity/v3/projects/cf5a2efcbea741989689082893be5a91/users/a0167c849c1940ca8b23723f38521427/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:58.096207 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe0bdf-4d8a-4957-82cb-d2a638c94d5c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:58.096571 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe0bdf-4d8a-4957-82cb-d2a638c94d5c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:58.096917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ffe0bdf-4d8a-4957-82cb-d2a638c94d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:58.123926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1ffe0bdf-4d8a-4957-82cb-d2a638c94d5c None None] MFA Rules not processed for user `a0167c849c1940ca8b23723f38521427`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:58.125189 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1ffe0bdf-4d8a-4957-82cb-d2a638c94d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:58.141372 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13505cb-642f-47ec-8837-7535dee53d0e admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:58.143976 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d13505cb-642f-47ec-8837-7535dee53d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:58.198000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1337/2668] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:58 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:58.209802 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe0bdf-4d8a-4957-82cb-d2a638c94d5c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:58.211577 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1ffe0bdf-4d8a-4957-82cb-d2a638c94d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:58.214985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13505cb-642f-47ec-8837-7535dee53d0e admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:58.219647 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b2dfd-37c7-42a8-84ce-25002f12b241 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:58.220562 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b2dfd-37c7-42a8-84ce-25002f12b241 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:58.220845 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b2dfd-37c7-42a8-84ce-25002f12b241 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:58.221121 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367b2dfd-37c7-42a8-84ce-25002f12b241 admin admin] PATH_INFO: `/v3/users/5b611af5b8a44ca3a3aab430e3575350` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:58.222346 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b2dfd-37c7-42a8-84ce-25002f12b241 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b611af5b8a44ca3a3aab430e3575350)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:58.224373 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367b2dfd-37c7-42a8-84ce-25002f12b241 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:58.239777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:58.290885 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ffe0bdf-4d8a-4957-82cb-d2a638c94d5c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:58.294555 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70aec6-cb55-48c0-ad2c-e8fbc0a0ee87 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:58.295255 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70aec6-cb55-48c0-ad2c-e8fbc0a0ee87 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:58.295542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70aec6-cb55-48c0-ad2c-e8fbc0a0ee87 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:58.295849 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd70aec6-cb55-48c0-ad2c-e8fbc0a0ee87 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:58.305685 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70aec6-cb55-48c0-ad2c-e8fbc0a0ee87 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:58.307244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd70aec6-cb55-48c0-ad2c-e8fbc0a0ee87 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:58.317205 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1338/2669] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:44:58 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:44:58.399116 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-367b2dfd-37c7-42a8-84ce-25002f12b241 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b611af5b8a44ca3a3aab430e3575350'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:58.399780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-367b2dfd-37c7-42a8-84ce-25002f12b241 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b611af5b8a44ca3a3aab430e3575350'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:58.433709 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70aec6-cb55-48c0-ad2c-e8fbc0a0ee87 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:58.435148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-fd70aec6-cb55-48c0-ad2c-e8fbc0a0ee87 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:58.446839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd70aec6-cb55-48c0-ad2c-e8fbc0a0ee87 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:58.450583 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbda305-1edc-4a9e-9e39-464f91fc5c61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:58.451282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbda305-1edc-4a9e-9e39-464f91fc5c61 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:58.451566 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbda305-1edc-4a9e-9e39-464f91fc5c61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:58.451866 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbda305-1edc-4a9e-9e39-464f91fc5c61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:58.453820 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-afbda305-1edc-4a9e-9e39-464f91fc5c61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:58.497267 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:58.515105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbda305-1edc-4a9e-9e39-464f91fc5c61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:58.516555 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbda305-1edc-4a9e-9e39-464f91fc5c61 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:58.525963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1339/2670] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:44:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:44:58.534507 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-367b2dfd-37c7-42a8-84ce-25002f12b241 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b611af5b8a44ca3a3aab430e3575350'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:58.535352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-367b2dfd-37c7-42a8-84ce-25002f12b241 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b611af5b8a44ca3a3aab430e3575350'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:58.549678 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-367b2dfd-37c7-42a8-84ce-25002f12b241 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b611af5b8a44ca3a3aab430e3575350'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:58.562617 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1332/2671] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:44:58 2022] DELETE /identity/v3/users/5b611af5b8a44ca3a3aab430e3575350 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:44:58.567412 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c41c1-af9c-4e8b-99c6-9e27f735fbbc None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:58.567705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c41c1-af9c-4e8b-99c6-9e27f735fbbc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:58.568030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5c41c1-af9c-4e8b-99c6-9e27f735fbbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:58.586390 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-bf5c41c1-af9c-4e8b-99c6-9e27f735fbbc None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:44:58.587634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bf5c41c1-af9c-4e8b-99c6-9e27f735fbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:58.649659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1340/2672] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:44:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:44:58.660467 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b2dfd-37c7-42a8-84ce-25002f12b241 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:58.661862 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-367b2dfd-37c7-42a8-84ce-25002f12b241 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:58.727444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367b2dfd-37c7-42a8-84ce-25002f12b241 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:58.732588 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f7517-8f39-424c-baaa-8f5a1d4fff9e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:58.733457 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f7517-8f39-424c-baaa-8f5a1d4fff9e service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:58.733731 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f7517-8f39-424c-baaa-8f5a1d4fff9e service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:58.734064 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f7517-8f39-424c-baaa-8f5a1d4fff9e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:58.746377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f7517-8f39-424c-baaa-8f5a1d4fff9e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:58.747848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f7517-8f39-424c-baaa-8f5a1d4fff9e service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:58.759786 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1333/2673] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:44:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:44:59.239485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c41c1-af9c-4e8b-99c6-9e27f735fbbc None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:59.241086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bf5c41c1-af9c-4e8b-99c6-9e27f735fbbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:44:59.257172 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5c41c1-af9c-4e8b-99c6-9e27f735fbbc None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:59.271649 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868b048-ff43-4361-b116-1b2bdce81a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:59.273112 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868b048-ff43-4361-b116-1b2bdce81a26 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:59.273517 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868b048-ff43-4361-b116-1b2bdce81a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:59.273917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868b048-ff43-4361-b116-1b2bdce81a26 admin admin] PATH_INFO: `/v3/projects/cfefb5c4b0f04caba15a15891d632b73` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:59.275655 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868b048-ff43-4361-b116-1b2bdce81a26 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cfefb5c4b0f04caba15a15891d632b73)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:59.277725 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868b048-ff43-4361-b116-1b2bdce81a26 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:59.411690 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7868b048-ff43-4361-b116-1b2bdce81a26 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cfefb5c4b0f04caba15a15891d632b73', 'request_id': 'req-7868b048-ff43-4361-b116-1b2bdce81a26'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:59.419618 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7868b048-ff43-4361-b116-1b2bdce81a26 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cfefb5c4b0f04caba15a15891d632b73', 'request_id': 'req-7868b048-ff43-4361-b116-1b2bdce81a26'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:59.427047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7868b048-ff43-4361-b116-1b2bdce81a26 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cfefb5c4b0f04caba15a15891d632b73', 'request_id': 'req-7868b048-ff43-4361-b116-1b2bdce81a26'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:59.534891 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7868b048-ff43-4361-b116-1b2bdce81a26 admin admin] The token cache is being invalidate because project cfefb5c4b0f04caba15a15891d632b73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:44:59.535187 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7868b048-ff43-4361-b116-1b2bdce81a26 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:59.536202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-7868b048-ff43-4361-b116-1b2bdce81a26 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:59.538253 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1341/2674] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:44:59 2022] DELETE /identity/v3/projects/cfefb5c4b0f04caba15a15891d632b73 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:44:59.543291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f7517-8f39-424c-baaa-8f5a1d4fff9e service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:44:59.562776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f7517-8f39-424c-baaa-8f5a1d4fff9e service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:44:59.634644 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d9e0c-7b1c-44a0-b731-96b9db04f035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:44:59.635562 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d9e0c-7b1c-44a0-b731-96b9db04f035 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:44:59.635841 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d9e0c-7b1c-44a0-b731-96b9db04f035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:44:59.636114 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3d9e0c-7b1c-44a0-b731-96b9db04f035 admin admin] PATH_INFO: `/v3/users/5344999afd014465997e62ccd54e9d6e` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:44:59.637342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d9e0c-7b1c-44a0-b731-96b9db04f035 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5344999afd014465997e62ccd54e9d6e)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:44:59.639401 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3d9e0c-7b1c-44a0-b731-96b9db04f035 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:44:59.935244 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:44:59.944564 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2e3d9e0c-7b1c-44a0-b731-96b9db04f035 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5344999afd014465997e62ccd54e9d6e'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:44:59.945237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2e3d9e0c-7b1c-44a0-b731-96b9db04f035 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5344999afd014465997e62ccd54e9d6e'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:00.031898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2e3d9e0c-7b1c-44a0-b731-96b9db04f035 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5344999afd014465997e62ccd54e9d6e'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:00.033985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2e3d9e0c-7b1c-44a0-b731-96b9db04f035 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5344999afd014465997e62ccd54e9d6e'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:00.050881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2e3d9e0c-7b1c-44a0-b731-96b9db04f035 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5344999afd014465997e62ccd54e9d6e'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:00.068003 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1334/2675] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:44:59 2022] DELETE /identity/v3/users/5344999afd014465997e62ccd54e9d6e => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:00.626616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868b048-ff43-4361-b116-1b2bdce81a26 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:00.627661 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-7868b048-ff43-4361-b116-1b2bdce81a26 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:00.658685 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868b048-ff43-4361-b116-1b2bdce81a26 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:00.730659 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdbde4-2e53-4732-bdfc-1b0da373deca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:00.731490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdbde4-2e53-4732-bdfc-1b0da373deca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:00.731776 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdbde4-2e53-4732-bdfc-1b0da373deca admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:00.732050 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bdbde4-2e53-4732-bdfc-1b0da373deca admin admin] PATH_INFO: `/v3/projects/8c25dc52ddcd4f8885d5751684cdb505` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:00.733392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdbde4-2e53-4732-bdfc-1b0da373deca admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c25dc52ddcd4f8885d5751684cdb505)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:00.735986 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bdbde4-2e53-4732-bdfc-1b0da373deca admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:00.743619 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:00.940110 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c3bdbde4-2e53-4732-bdfc-1b0da373deca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c25dc52ddcd4f8885d5751684cdb505', 'request_id': 'req-c3bdbde4-2e53-4732-bdfc-1b0da373deca'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:00.950517 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c3bdbde4-2e53-4732-bdfc-1b0da373deca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c25dc52ddcd4f8885d5751684cdb505', 'request_id': 'req-c3bdbde4-2e53-4732-bdfc-1b0da373deca'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:00.960508 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c3bdbde4-2e53-4732-bdfc-1b0da373deca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c25dc52ddcd4f8885d5751684cdb505', 'request_id': 'req-c3bdbde4-2e53-4732-bdfc-1b0da373deca'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:01.026708 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c3bdbde4-2e53-4732-bdfc-1b0da373deca admin admin] The token cache is being invalidate because project 8c25dc52ddcd4f8885d5751684cdb505 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:45:01.026941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c3bdbde4-2e53-4732-bdfc-1b0da373deca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:01.027733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c3bdbde4-2e53-4732-bdfc-1b0da373deca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:01.029360 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1342/2676] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:45:00 2022] DELETE /identity/v3/projects/8c25dc52ddcd4f8885d5751684cdb505 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:01.034420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d9e0c-7b1c-44a0-b731-96b9db04f035 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:01.035943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2e3d9e0c-7b1c-44a0-b731-96b9db04f035 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:01.057697 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3d9e0c-7b1c-44a0-b731-96b9db04f035 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:01.149963 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbd600-2ac4-448f-878f-555320b10701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:01.150883 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbd600-2ac4-448f-878f-555320b10701 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:01.151166 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbd600-2ac4-448f-878f-555320b10701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:01.151449 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbd600-2ac4-448f-878f-555320b10701 admin admin] PATH_INFO: `/v3/users/1f8da9c374194a7b8a9bbb882d7aa3fc` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:01.152712 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbd600-2ac4-448f-878f-555320b10701 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f8da9c374194a7b8a9bbb882d7aa3fc)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:01.154705 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbd600-2ac4-448f-878f-555320b10701 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:01.385343 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a5cbd600-2ac4-448f-878f-555320b10701 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f8da9c374194a7b8a9bbb882d7aa3fc'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:01.386345 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a5cbd600-2ac4-448f-878f-555320b10701 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f8da9c374194a7b8a9bbb882d7aa3fc'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:01.482613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a5cbd600-2ac4-448f-878f-555320b10701 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f8da9c374194a7b8a9bbb882d7aa3fc'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:01.483542 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a5cbd600-2ac4-448f-878f-555320b10701 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f8da9c374194a7b8a9bbb882d7aa3fc'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:01.501775 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a5cbd600-2ac4-448f-878f-555320b10701 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f8da9c374194a7b8a9bbb882d7aa3fc'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:01.519175 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1335/2677] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:45:01 2022] DELETE /identity/v3/users/1f8da9c374194a7b8a9bbb882d7aa3fc => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:02.052096 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdbde4-2e53-4732-bdfc-1b0da373deca admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:02.054364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c3bdbde4-2e53-4732-bdfc-1b0da373deca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:02.073277 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bdbde4-2e53-4732-bdfc-1b0da373deca admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:02.149348 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49f1d67-312f-4548-aeab-f4e7b025a860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:02.150221 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f1d67-312f-4548-aeab-f4e7b025a860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:02.150502 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f1d67-312f-4548-aeab-f4e7b025a860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:02.150811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49f1d67-312f-4548-aeab-f4e7b025a860 admin admin] PATH_INFO: `/v3/projects/97e17e5bc2344856a669da2d980af498` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:02.152014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f1d67-312f-4548-aeab-f4e7b025a860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97e17e5bc2344856a669da2d980af498)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:02.153963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49f1d67-312f-4548-aeab-f4e7b025a860 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:02.304531 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f49f1d67-312f-4548-aeab-f4e7b025a860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97e17e5bc2344856a669da2d980af498', 'request_id': 'req-f49f1d67-312f-4548-aeab-f4e7b025a860'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:02.311257 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f49f1d67-312f-4548-aeab-f4e7b025a860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97e17e5bc2344856a669da2d980af498', 'request_id': 'req-f49f1d67-312f-4548-aeab-f4e7b025a860'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:02.319578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f49f1d67-312f-4548-aeab-f4e7b025a860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97e17e5bc2344856a669da2d980af498', 'request_id': 'req-f49f1d67-312f-4548-aeab-f4e7b025a860'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:02.733878 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f49f1d67-312f-4548-aeab-f4e7b025a860 admin admin] The token cache is being invalidate because project 97e17e5bc2344856a669da2d980af498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:45:02.740611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f49f1d67-312f-4548-aeab-f4e7b025a860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:02.740611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f49f1d67-312f-4548-aeab-f4e7b025a860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:02.740611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1343/2678] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:45:02 2022] DELETE /identity/v3/projects/97e17e5bc2344856a669da2d980af498 => generated 0 bytes in 687 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:02.742186 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e68a5-b5dd-4659-889c-5a10331fb69d None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:02.742671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e68a5-b5dd-4659-889c-5a10331fb69d None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:02.742805 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052e68a5-b5dd-4659-889c-5a10331fb69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:02.761586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-052e68a5-b5dd-4659-889c-5a10331fb69d None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:02.763225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-052e68a5-b5dd-4659-889c-5a10331fb69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:02.799236 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:02.831975 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1336/2679] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:02.904277 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96aec3-6630-4879-83ce-7466ee06ac19 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:02.904568 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96aec3-6630-4879-83ce-7466ee06ac19 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:02.904855 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce96aec3-6630-4879-83ce-7466ee06ac19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:02.927358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ce96aec3-6630-4879-83ce-7466ee06ac19 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:02.928600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ce96aec3-6630-4879-83ce-7466ee06ac19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:02.938152 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1344/2680] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:02.951226 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e68a5-b5dd-4659-889c-5a10331fb69d None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:02.955745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052e68a5-b5dd-4659-889c-5a10331fb69d None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:02.961951 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc57e64-187d-45b4-929f-a8395bb5e6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:02.962923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc57e64-187d-45b4-929f-a8395bb5e6d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:02.963342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc57e64-187d-45b4-929f-a8395bb5e6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:02.963856 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc57e64-187d-45b4-929f-a8395bb5e6d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:02.964762 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc57e64-187d-45b4-929f-a8395bb5e6d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:45:02.965146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc57e64-187d-45b4-929f-a8395bb5e6d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:02.967200 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc57e64-187d-45b4-929f-a8395bb5e6d4 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:02.985336 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1337/2681] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:45:02.990282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96aec3-6630-4879-83ce-7466ee06ac19 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:03.001150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce96aec3-6630-4879-83ce-7466ee06ac19 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:03.006492 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c979c0-f660-497a-8d16-6f982676fa02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:03.007219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c979c0-f660-497a-8d16-6f982676fa02 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:03.007505 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c979c0-f660-497a-8d16-6f982676fa02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:03.007775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c979c0-f660-497a-8d16-6f982676fa02 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:03.008491 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c979c0-f660-497a-8d16-6f982676fa02 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:03.010422 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c979c0-f660-497a-8d16-6f982676fa02 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:03.026914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:03.081362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc57e64-187d-45b4-929f-a8395bb5e6d4 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:03.083215 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ffc57e64-187d-45b4-929f-a8395bb5e6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:03.096793 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc57e64-187d-45b4-929f-a8395bb5e6d4 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:03.101705 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f810c5f2-5b56-4f54-a9dc-884d3d6aa0e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:03.102579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810c5f2-5b56-4f54-a9dc-884d3d6aa0e2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:03.102893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810c5f2-5b56-4f54-a9dc-884d3d6aa0e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:03.103224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f810c5f2-5b56-4f54-a9dc-884d3d6aa0e2 admin admin] PATH_INFO: `/v3/users/856c6622644043f895a8a4b313d79d45` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:03.104875 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810c5f2-5b56-4f54-a9dc-884d3d6aa0e2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=856c6622644043f895a8a4b313d79d45)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:03.107183 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f810c5f2-5b56-4f54-a9dc-884d3d6aa0e2 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:03.148321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1345/2682] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:45:02 2022] POST /identity/v3/projects => generated 373 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:45:03.152851 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c979c0-f660-497a-8d16-6f982676fa02 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:03.216725 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c979c0-f660-497a-8d16-6f982676fa02 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:03.222326 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861d4af-dcce-4e63-90d9-5faeaf413bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:03.223021 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861d4af-dcce-4e63-90d9-5faeaf413bbc admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:03.223308 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861d4af-dcce-4e63-90d9-5faeaf413bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:03.223584 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0861d4af-dcce-4e63-90d9-5faeaf413bbc admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:03.224274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861d4af-dcce-4e63-90d9-5faeaf413bbc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:03.226217 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0861d4af-dcce-4e63-90d9-5faeaf413bbc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:03.393229 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1346/2683] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:45:03 2022] POST /identity/v3/users => generated 287 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:45:03.415767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861d4af-dcce-4e63-90d9-5faeaf413bbc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:03.424072 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f810c5f2-5b56-4f54-a9dc-884d3d6aa0e2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '856c6622644043f895a8a4b313d79d45'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:03.424750 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f810c5f2-5b56-4f54-a9dc-884d3d6aa0e2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '856c6622644043f895a8a4b313d79d45'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:03.428874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0861d4af-dcce-4e63-90d9-5faeaf413bbc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:03.435054 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339609d5-6f19-4d55-89f8-83c3d4bafb16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:03.435784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339609d5-6f19-4d55-89f8-83c3d4bafb16 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:03.436147 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339609d5-6f19-4d55-89f8-83c3d4bafb16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:03.436339 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339609d5-6f19-4d55-89f8-83c3d4bafb16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:03.437309 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339609d5-6f19-4d55-89f8-83c3d4bafb16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:03.439244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339609d5-6f19-4d55-89f8-83c3d4bafb16 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:03.452434 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1347/2684] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:45:03.457431 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339609d5-6f19-4d55-89f8-83c3d4bafb16 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:03.459358 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-339609d5-6f19-4d55-89f8-83c3d4bafb16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:03.472858 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339609d5-6f19-4d55-89f8-83c3d4bafb16 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:03.477714 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d53d4-7d8b-4903-902c-a363174d9996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:03.481291 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d53d4-7d8b-4903-902c-a363174d9996 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:03.481291 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d53d4-7d8b-4903-902c-a363174d9996 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:03.481291 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738d53d4-7d8b-4903-902c-a363174d9996 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:03.481291 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d53d4-7d8b-4903-902c-a363174d9996 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:03.481696 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738d53d4-7d8b-4903-902c-a363174d9996 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:03.493282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1348/2685] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:45:03.497741 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d53d4-7d8b-4903-902c-a363174d9996 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:03.509320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738d53d4-7d8b-4903-902c-a363174d9996 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:03.514144 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb78a25b-890e-42e5-bddb-cfce6be58bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:03.515119 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78a25b-890e-42e5-bddb-cfce6be58bbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:03.515404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78a25b-890e-42e5-bddb-cfce6be58bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:03.515855 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb78a25b-890e-42e5-bddb-cfce6be58bbe admin admin] PATH_INFO: `/v3/projects/5ef81566938540c89e403ac29f786923/users/d0e357a0937e496983345aa1419324f7/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:03.532618 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78a25b-890e-42e5-bddb-cfce6be58bbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=5ef81566938540c89e403ac29f786923, user_id=d0e357a0937e496983345aa1419324f7, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:03.534989 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f810c5f2-5b56-4f54-a9dc-884d3d6aa0e2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '856c6622644043f895a8a4b313d79d45'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:03.535563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb78a25b-890e-42e5-bddb-cfce6be58bbe admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:03.535999 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f810c5f2-5b56-4f54-a9dc-884d3d6aa0e2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '856c6622644043f895a8a4b313d79d45'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:03.550717 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-f810c5f2-5b56-4f54-a9dc-884d3d6aa0e2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '856c6622644043f895a8a4b313d79d45'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:03.566062 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1338/2686] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:45:03 2022] DELETE /identity/v3/users/856c6622644043f895a8a4b313d79d45 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:45:03.573336 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e8e58-e9d2-4866-9b2c-31176f580805 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:03.573616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e8e58-e9d2-4866-9b2c-31176f580805 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:03.573926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-456e8e58-e9d2-4866-9b2c-31176f580805 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:03.594194 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-456e8e58-e9d2-4866-9b2c-31176f580805 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:03.595732 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-456e8e58-e9d2-4866-9b2c-31176f580805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:03.596347 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1349/2687] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:45:03 2022] PUT /identity/v3/projects/5ef81566938540c89e403ac29f786923/users/d0e357a0937e496983345aa1419324f7/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:45:03.603601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ebec7-e8d7-454a-8d8a-925a29efc819 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:03.603953 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ebec7-e8d7-454a-8d8a-925a29efc819 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:03.604476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49ebec7-e8d7-454a-8d8a-925a29efc819 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:03.632766 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d49ebec7-e8d7-454a-8d8a-925a29efc819 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:03.634838 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d49ebec7-e8d7-454a-8d8a-925a29efc819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:03.674305 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1339/2688] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:45:03.684953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e8e58-e9d2-4866-9b2c-31176f580805 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:03.686407 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-456e8e58-e9d2-4866-9b2c-31176f580805 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:03.714903 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1350/2689] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:45:03.729940 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ebec7-e8d7-454a-8d8a-925a29efc819 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:03.731561 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d49ebec7-e8d7-454a-8d8a-925a29efc819 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:03.742185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:03.775511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-456e8e58-e9d2-4866-9b2c-31176f580805 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:03.780503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921701e-8afd-4b8e-8f46-1f9b850f85db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:03.781352 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921701e-8afd-4b8e-8f46-1f9b850f85db service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:03.781954 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921701e-8afd-4b8e-8f46-1f9b850f85db service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:03.782397 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3921701e-8afd-4b8e-8f46-1f9b850f85db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:03.795239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921701e-8afd-4b8e-8f46-1f9b850f85db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:03.805133 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3921701e-8afd-4b8e-8f46-1f9b850f85db service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:03.805298 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:03.808865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1340/2690] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:45:03.820438 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49ebec7-e8d7-454a-8d8a-925a29efc819 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:03.824406 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1229569-ab3e-4c25-a428-c8dc54b01b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:03.824915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1229569-ab3e-4c25-a428-c8dc54b01b56 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:03.825195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1229569-ab3e-4c25-a428-c8dc54b01b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:03.825470 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1229569-ab3e-4c25-a428-c8dc54b01b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:03.836945 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1229569-ab3e-4c25-a428-c8dc54b01b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:03.838428 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1229569-ab3e-4c25-a428-c8dc54b01b56 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:03.855434 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1351/2691] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:45:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:45:04.533358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921701e-8afd-4b8e-8f46-1f9b850f85db service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:04.533358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3921701e-8afd-4b8e-8f46-1f9b850f85db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:04.533358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3921701e-8afd-4b8e-8f46-1f9b850f85db service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:04.536387 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddb1b72-22ce-4440-b235-09540375ad4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:04.536387 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb1b72-22ce-4440-b235-09540375ad4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:04.536387 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb1b72-22ce-4440-b235-09540375ad4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:04.536387 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddb1b72-22ce-4440-b235-09540375ad4e admin admin] PATH_INFO: `/v3/projects/80451dd7dbc3420491e136061db9614d` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:04.539350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb1b72-22ce-4440-b235-09540375ad4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=80451dd7dbc3420491e136061db9614d)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:04.539350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddb1b72-22ce-4440-b235-09540375ad4e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:04.646952 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0ddb1b72-22ce-4440-b235-09540375ad4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80451dd7dbc3420491e136061db9614d', 'request_id': 'req-0ddb1b72-22ce-4440-b235-09540375ad4e'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:04.733958 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0ddb1b72-22ce-4440-b235-09540375ad4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80451dd7dbc3420491e136061db9614d', 'request_id': 'req-0ddb1b72-22ce-4440-b235-09540375ad4e'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:04.742126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0ddb1b72-22ce-4440-b235-09540375ad4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80451dd7dbc3420491e136061db9614d', 'request_id': 'req-0ddb1b72-22ce-4440-b235-09540375ad4e'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:04.754611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0ddb1b72-22ce-4440-b235-09540375ad4e admin admin] The token cache is being invalidate because project 80451dd7dbc3420491e136061db9614d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:45:04.755344 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0ddb1b72-22ce-4440-b235-09540375ad4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:04.755640 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0ddb1b72-22ce-4440-b235-09540375ad4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:04.757215 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1341/2692] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:45:04 2022] DELETE /identity/v3/projects/80451dd7dbc3420491e136061db9614d => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:45:04.761888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1229569-ab3e-4c25-a428-c8dc54b01b56 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:04.779912 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1229569-ab3e-4c25-a428-c8dc54b01b56 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:04.844182 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab70335-6b76-448b-8099-a8cacfe5909a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:04.845059 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab70335-6b76-448b-8099-a8cacfe5909a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:04.845463 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab70335-6b76-448b-8099-a8cacfe5909a admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:04.846024 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab70335-6b76-448b-8099-a8cacfe5909a admin admin] PATH_INFO: `/v3/users/f406d6b96b7b47278b8fdcd430895344` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:04.847796 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab70335-6b76-448b-8099-a8cacfe5909a admin admin] RBAC: Authorizing `identity:delete_user(user_id=f406d6b96b7b47278b8fdcd430895344)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:04.850447 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab70335-6b76-448b-8099-a8cacfe5909a admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:05.084701 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0ab70335-6b76-448b-8099-a8cacfe5909a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f406d6b96b7b47278b8fdcd430895344'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:05.102188 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0ab70335-6b76-448b-8099-a8cacfe5909a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f406d6b96b7b47278b8fdcd430895344'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:05.103006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0ab70335-6b76-448b-8099-a8cacfe5909a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f406d6b96b7b47278b8fdcd430895344'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:05.103873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0ab70335-6b76-448b-8099-a8cacfe5909a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f406d6b96b7b47278b8fdcd430895344'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:05.114631 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0ab70335-6b76-448b-8099-a8cacfe5909a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f406d6b96b7b47278b8fdcd430895344'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:05.214892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1352/2693] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:45:04 2022] DELETE /identity/v3/users/f406d6b96b7b47278b8fdcd430895344 => generated 0 bytes in 454 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:05.458360 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb9d04-e683-4b71-a5ab-219f77074cdf None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:05.458360 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb9d04-e683-4b71-a5ab-219f77074cdf None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:05.458657 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acb9d04-e683-4b71-a5ab-219f77074cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:05.498088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-4acb9d04-e683-4b71-a5ab-219f77074cdf None None] MFA Rules not processed for user `d0e357a0937e496983345aa1419324f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:05.499360 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4acb9d04-e683-4b71-a5ab-219f77074cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:05.612926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1342/2694] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:05 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:05.744633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab70335-6b76-448b-8099-a8cacfe5909a admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:05.744633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-0ab70335-6b76-448b-8099-a8cacfe5909a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:05.744633 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab70335-6b76-448b-8099-a8cacfe5909a admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:05.744915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aed80c-47f2-4149-9391-d4230420d108 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:05.744915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aed80c-47f2-4149-9391-d4230420d108 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:05.744915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aed80c-47f2-4149-9391-d4230420d108 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:05.744915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aed80c-47f2-4149-9391-d4230420d108 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:05.745276 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aed80c-47f2-4149-9391-d4230420d108 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:05.745276 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aed80c-47f2-4149-9391-d4230420d108 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:05.745276 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1353/2695] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:45:05 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:45:05.776073 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb9d04-e683-4b71-a5ab-219f77074cdf None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:05.778289 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4acb9d04-e683-4b71-a5ab-219f77074cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:05.844410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:05.886438 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acb9d04-e683-4b71-a5ab-219f77074cdf None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:05.893258 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5192d76-cac8-4c6e-85fd-faa166a39fd1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad68d871464f4b5588c22070205f159e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:05.893258 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5192d76-cac8-4c6e-85fd-faa166a39fd1 service placement] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:05.893583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5192d76-cac8-4c6e-85fd-faa166a39fd1 service placement] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:05.893692 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5192d76-cac8-4c6e-85fd-faa166a39fd1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:05.895641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f5192d76-cac8-4c6e-85fd-faa166a39fd1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:05.917214 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5192d76-cac8-4c6e-85fd-faa166a39fd1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:05.920302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5192d76-cac8-4c6e-85fd-faa166a39fd1 service placement] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:05.925682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aed80c-47f2-4149-9391-d4230420d108 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:05.928160 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d1aed80c-47f2-4149-9391-d4230420d108 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:05.936946 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:05.942719 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1343/2696] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:45:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:45:06.014122 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aed80c-47f2-4149-9391-d4230420d108 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:06.019849 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fae11c-b643-4a1d-94fb-2509395546a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:06.020718 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fae11c-b643-4a1d-94fb-2509395546a1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:06.020995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fae11c-b643-4a1d-94fb-2509395546a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:06.021264 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fae11c-b643-4a1d-94fb-2509395546a1 admin admin] PATH_INFO: `/v3/projects/5447881986dd4cd5819b70633cebdb6e` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:06.022492 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fae11c-b643-4a1d-94fb-2509395546a1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5447881986dd4cd5819b70633cebdb6e)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:06.024472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fae11c-b643-4a1d-94fb-2509395546a1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:06.173536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0fae11c-b643-4a1d-94fb-2509395546a1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5447881986dd4cd5819b70633cebdb6e', 'request_id': 'req-e0fae11c-b643-4a1d-94fb-2509395546a1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:06.176692 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0fae11c-b643-4a1d-94fb-2509395546a1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5447881986dd4cd5819b70633cebdb6e', 'request_id': 'req-e0fae11c-b643-4a1d-94fb-2509395546a1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:06.183428 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0fae11c-b643-4a1d-94fb-2509395546a1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5447881986dd4cd5819b70633cebdb6e', 'request_id': 'req-e0fae11c-b643-4a1d-94fb-2509395546a1'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:06.448004 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0fae11c-b643-4a1d-94fb-2509395546a1 admin admin] The token cache is being invalidate because project 5447881986dd4cd5819b70633cebdb6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:45:06.448304 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0fae11c-b643-4a1d-94fb-2509395546a1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:06.449004 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-e0fae11c-b643-4a1d-94fb-2509395546a1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:06.450832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1354/2697] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:45:05 2022] DELETE /identity/v3/projects/5447881986dd4cd5819b70633cebdb6e => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:45:06.455178 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5192d76-cac8-4c6e-85fd-faa166a39fd1 service placement] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:06.465833 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5192d76-cac8-4c6e-85fd-faa166a39fd1 service placement] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:06.529892 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47913ecb-9abf-4430-9810-f948bfa24f51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:06.532571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913ecb-9abf-4430-9810-f948bfa24f51 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:06.532571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913ecb-9abf-4430-9810-f948bfa24f51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:06.532571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47913ecb-9abf-4430-9810-f948bfa24f51 admin admin] PATH_INFO: `/v3/users/a0167c849c1940ca8b23723f38521427` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:06.533007 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47913ecb-9abf-4430-9810-f948bfa24f51 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a0167c849c1940ca8b23723f38521427)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:06.534905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47913ecb-9abf-4430-9810-f948bfa24f51 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:06.798851 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-47913ecb-9abf-4430-9810-f948bfa24f51 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a0167c849c1940ca8b23723f38521427'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:06.799811 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-47913ecb-9abf-4430-9810-f948bfa24f51 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a0167c849c1940ca8b23723f38521427'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:06.917658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-47913ecb-9abf-4430-9810-f948bfa24f51 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a0167c849c1940ca8b23723f38521427'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:06.918391 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-47913ecb-9abf-4430-9810-f948bfa24f51 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a0167c849c1940ca8b23723f38521427'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:06.939619 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-47913ecb-9abf-4430-9810-f948bfa24f51 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a0167c849c1940ca8b23723f38521427'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:06.956714 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1344/2698] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:45:06 2022] DELETE /identity/v3/users/a0167c849c1940ca8b23723f38521427 => generated 0 bytes in 502 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:07.488032 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fae11c-b643-4a1d-94fb-2509395546a1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:07.489989 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e0fae11c-b643-4a1d-94fb-2509395546a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:07.507520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fae11c-b643-4a1d-94fb-2509395546a1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:07.580239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa15b7ec-841e-437a-a64c-42d48bdf5155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:07.581107 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15b7ec-841e-437a-a64c-42d48bdf5155 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:07.581393 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15b7ec-841e-437a-a64c-42d48bdf5155 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:07.581680 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa15b7ec-841e-437a-a64c-42d48bdf5155 admin admin] PATH_INFO: `/v3/projects/cf5a2efcbea741989689082893be5a91` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:07.583015 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15b7ec-841e-437a-a64c-42d48bdf5155 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf5a2efcbea741989689082893be5a91)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:07.584982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa15b7ec-841e-437a-a64c-42d48bdf5155 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:07.711060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:07.725449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aa15b7ec-841e-437a-a64c-42d48bdf5155 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf5a2efcbea741989689082893be5a91', 'request_id': 'req-aa15b7ec-841e-437a-a64c-42d48bdf5155'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:07.734915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aa15b7ec-841e-437a-a64c-42d48bdf5155 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf5a2efcbea741989689082893be5a91', 'request_id': 'req-aa15b7ec-841e-437a-a64c-42d48bdf5155'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:07.742538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aa15b7ec-841e-437a-a64c-42d48bdf5155 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf5a2efcbea741989689082893be5a91', 'request_id': 'req-aa15b7ec-841e-437a-a64c-42d48bdf5155'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:07.812793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aa15b7ec-841e-437a-a64c-42d48bdf5155 admin admin] The token cache is being invalidate because project cf5a2efcbea741989689082893be5a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:45:07.812793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aa15b7ec-841e-437a-a64c-42d48bdf5155 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:07.812793 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-aa15b7ec-841e-437a-a64c-42d48bdf5155 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:07.813941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1355/2699] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:45:07 2022] DELETE /identity/v3/projects/cf5a2efcbea741989689082893be5a91 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:45:07.820354 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a291a-2357-4350-928e-1eaa4fec62fe None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:07.820943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a291a-2357-4350-928e-1eaa4fec62fe None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:07.820943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a291a-2357-4350-928e-1eaa4fec62fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:07.842063 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-032a291a-2357-4350-928e-1eaa4fec62fe None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:07.842962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-032a291a-2357-4350-928e-1eaa4fec62fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:07.885758 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:07.889983 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbf3fc-fa40-4740-a635-8db7570176c2 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:07.890383 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbf3fc-fa40-4740-a635-8db7570176c2 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:07.890705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cbf3fc-fa40-4740-a635-8db7570176c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:07.912073 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-c4cbf3fc-fa40-4740-a635-8db7570176c2 None None] MFA Rules not processed for user `d0e357a0937e496983345aa1419324f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:07.924519 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-c4cbf3fc-fa40-4740-a635-8db7570176c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:07.924734 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1345/2700] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:07.935708 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9bb38-fd7e-48a0-87a8-c9a9e0a12094 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:07.936101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9bb38-fd7e-48a0-87a8-c9a9e0a12094 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:07.936498 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe9bb38-fd7e-48a0-87a8-c9a9e0a12094 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:07.958511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-3fe9bb38-fd7e-48a0-87a8-c9a9e0a12094 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:07.959960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3fe9bb38-fd7e-48a0-87a8-c9a9e0a12094 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:07.969371 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1346/2701] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:45:07.974985 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9bb38-fd7e-48a0-87a8-c9a9e0a12094 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:07.984624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe9bb38-fd7e-48a0-87a8-c9a9e0a12094 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:07.990262 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9668c-58ee-49dd-9684-4388a38f4db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:07.990969 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9668c-58ee-49dd-9684-4388a38f4db8 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:07.991247 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9668c-58ee-49dd-9684-4388a38f4db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:07.991518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc9668c-58ee-49dd-9684-4388a38f4db8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:07.992289 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9668c-58ee-49dd-9684-4388a38f4db8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:45:07.992593 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9668c-58ee-49dd-9684-4388a38f4db8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:07.994217 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc9668c-58ee-49dd-9684-4388a38f4db8 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:07.996451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1356/2702] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:45:08.020937 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1347/2703] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:45:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:45:08.030550 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbf3fc-fa40-4740-a635-8db7570176c2 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:08.046923 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cbf3fc-fa40-4740-a635-8db7570176c2 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:08.056169 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b46ced-f58d-440b-be56-2850c95c6493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:08.056169 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b46ced-f58d-440b-be56-2850c95c6493 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:08.056169 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b46ced-f58d-440b-be56-2850c95c6493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:08.056169 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b46ced-f58d-440b-be56-2850c95c6493 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:08.056790 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b46ced-f58d-440b-be56-2850c95c6493 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:08.058920 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b46ced-f58d-440b-be56-2850c95c6493 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:08.205941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1357/2704] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:45:08 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:45:08.211166 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9668c-58ee-49dd-9684-4388a38f4db8 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:08.221949 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc9668c-58ee-49dd-9684-4388a38f4db8 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:08.297078 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769435d-85d1-4ce6-b11d-ba04c600f814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:08.298187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769435d-85d1-4ce6-b11d-ba04c600f814 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:08.298710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769435d-85d1-4ce6-b11d-ba04c600f814 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:08.299127 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5769435d-85d1-4ce6-b11d-ba04c600f814 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:08.300310 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769435d-85d1-4ce6-b11d-ba04c600f814 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:08.303745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5769435d-85d1-4ce6-b11d-ba04c600f814 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:08.314638 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b46ced-f58d-440b-be56-2850c95c6493 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:08.316789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-84b46ced-f58d-440b-be56-2850c95c6493 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:08.381818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1348/2705] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:45:08 2022] POST /identity/v3/users => generated 294 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:45:08.387194 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769435d-85d1-4ce6-b11d-ba04c600f814 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:08.402663 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b46ced-f58d-440b-be56-2850c95c6493 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:08.408920 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5769435d-85d1-4ce6-b11d-ba04c600f814 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:08.409071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a9bd2-d690-4c75-a599-33d39c3e7c8c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:08.409071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a9bd2-d690-4c75-a599-33d39c3e7c8c service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:08.409071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a9bd2-d690-4c75-a599-33d39c3e7c8c service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:08.409071 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57a9bd2-d690-4c75-a599-33d39c3e7c8c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:08.410825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d57a9bd2-d690-4c75-a599-33d39c3e7c8c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:08.411580 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ee818-067d-4af3-a52f-28df1c2da6f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:08.412844 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ee818-067d-4af3-a52f-28df1c2da6f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:08.413337 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ee818-067d-4af3-a52f-28df1c2da6f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:08.413809 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-926ee818-067d-4af3-a52f-28df1c2da6f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:08.415341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ee818-067d-4af3-a52f-28df1c2da6f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:08.418437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-926ee818-067d-4af3-a52f-28df1c2da6f6 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:08.421914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a9bd2-d690-4c75-a599-33d39c3e7c8c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:08.423874 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57a9bd2-d690-4c75-a599-33d39c3e7c8c service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:08.433297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1358/2706] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:45:08 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:45:08.440732 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1349/2707] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:45:08.441969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a9bd2-d690-4c75-a599-33d39c3e7c8c service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:08.455203 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57a9bd2-d690-4c75-a599-33d39c3e7c8c service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:08.462549 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20de7c9-a3c6-42df-a203-774137c477b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:08.463706 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20de7c9-a3c6-42df-a203-774137c477b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:08.464218 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20de7c9-a3c6-42df-a203-774137c477b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:08.464722 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20de7c9-a3c6-42df-a203-774137c477b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:08.466158 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20de7c9-a3c6-42df-a203-774137c477b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:08.471301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20de7c9-a3c6-42df-a203-774137c477b2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:08.484897 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1359/2708] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:45:08 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:45:08.489234 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ee818-067d-4af3-a52f-28df1c2da6f6 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:08.499901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-926ee818-067d-4af3-a52f-28df1c2da6f6 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:08.505658 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adb279-b4f9-4963-ba20-fc456494a287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:08.506570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adb279-b4f9-4963-ba20-fc456494a287 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:08.506897 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adb279-b4f9-4963-ba20-fc456494a287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:08.507179 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64adb279-b4f9-4963-ba20-fc456494a287 admin admin] PATH_INFO: `/v3/projects/5f4f5fd470d842889a671d74ae705d41/users/2af3564b2f5d40f5ae6a711424cd7eb9/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:08.525786 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adb279-b4f9-4963-ba20-fc456494a287 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f4f5fd470d842889a671d74ae705d41, user_id=2af3564b2f5d40f5ae6a711424cd7eb9, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:08.528619 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64adb279-b4f9-4963-ba20-fc456494a287 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:08.591165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1350/2709] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:45:08 2022] PUT /identity/v3/projects/5f4f5fd470d842889a671d74ae705d41/users/2af3564b2f5d40f5ae6a711424cd7eb9/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:08.609129 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79a266-2a76-467e-814e-0fad38c94c34 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:08.609933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79a266-2a76-467e-814e-0fad38c94c34 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:08.609933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff79a266-2a76-467e-814e-0fad38c94c34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:08.654347 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-ff79a266-2a76-467e-814e-0fad38c94c34 None None] MFA Rules not processed for user `2af3564b2f5d40f5ae6a711424cd7eb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:08.656057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-ff79a266-2a76-467e-814e-0fad38c94c34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:08.692437 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:08.745269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1360/2710] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:08 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:45:08.749875 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adb279-b4f9-4963-ba20-fc456494a287 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:08.859080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64adb279-b4f9-4963-ba20-fc456494a287 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:08.866150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0101f3-efe9-41ae-bdb8-22be71790b17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:08.868884 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0101f3-efe9-41ae-bdb8-22be71790b17 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:08.868884 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0101f3-efe9-41ae-bdb8-22be71790b17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:08.868884 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0101f3-efe9-41ae-bdb8-22be71790b17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:08.869171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0101f3-efe9-41ae-bdb8-22be71790b17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:08.871865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0101f3-efe9-41ae-bdb8-22be71790b17 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:09.004692 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:09.013933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1351/2711] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:45:08 2022] POST /identity/v3/projects => generated 387 bytes in 265 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:45:09.018930 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79a266-2a76-467e-814e-0fad38c94c34 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:09.033523 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff79a266-2a76-467e-814e-0fad38c94c34 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:09.128840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490e35b-8b21-4616-8100-c731be8c9583 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:09.129529 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490e35b-8b21-4616-8100-c731be8c9583 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:09.129813 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490e35b-8b21-4616-8100-c731be8c9583 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:09.130088 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490e35b-8b21-4616-8100-c731be8c9583 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:09.130818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490e35b-8b21-4616-8100-c731be8c9583 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:09.132873 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490e35b-8b21-4616-8100-c731be8c9583 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:09.699925 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1361/2712] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:45:09 2022] POST /identity/v3/users => generated 300 bytes in 682 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:45:09.704766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0101f3-efe9-41ae-bdb8-22be71790b17 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:09.716030 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0101f3-efe9-41ae-bdb8-22be71790b17 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:09.727651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc4ca6-aa46-4908-9a1b-74142adce273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:09.727651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc4ca6-aa46-4908-9a1b-74142adce273 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:09.727651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc4ca6-aa46-4908-9a1b-74142adce273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:09.727651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc4ca6-aa46-4908-9a1b-74142adce273 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:09.728119 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc4ca6-aa46-4908-9a1b-74142adce273 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:09.728119 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc4ca6-aa46-4908-9a1b-74142adce273 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:09.735822 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1352/2713] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:45:09 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:45:09.740291 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490e35b-8b21-4616-8100-c731be8c9583 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:09.750250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490e35b-8b21-4616-8100-c731be8c9583 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:09.755562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37948c42-30e6-4268-846a-b2e7bd3fa1be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:09.756438 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948c42-30e6-4268-846a-b2e7bd3fa1be admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:09.756717 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948c42-30e6-4268-846a-b2e7bd3fa1be admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:09.756990 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37948c42-30e6-4268-846a-b2e7bd3fa1be admin admin] PATH_INFO: `/v3/projects/a94e0f85cb1b428da00b48f7aafc93e6/users/46442eaf86114b2b923075b521abf784/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:09.772970 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37948c42-30e6-4268-846a-b2e7bd3fa1be admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94e0f85cb1b428da00b48f7aafc93e6, user_id=46442eaf86114b2b923075b521abf784, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:09.775672 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37948c42-30e6-4268-846a-b2e7bd3fa1be admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:10.012195 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1362/2714] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:45:09 2022] PUT /identity/v3/projects/a94e0f85cb1b428da00b48f7aafc93e6/users/46442eaf86114b2b923075b521abf784/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:10.017386 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc4ca6-aa46-4908-9a1b-74142adce273 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:10.028048 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc4ca6-aa46-4908-9a1b-74142adce273 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:10.095816 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b2768e-d1db-4644-a041-9a457a4de84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:10.096480 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2768e-d1db-4644-a041-9a457a4de84f admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:10.096950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2768e-d1db-4644-a041-9a457a4de84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:10.097231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b2768e-d1db-4644-a041-9a457a4de84f admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:10.098083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2768e-d1db-4644-a041-9a457a4de84f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:10.099751 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b2768e-d1db-4644-a041-9a457a4de84f admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:10.111856 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1353/2715] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:45:10 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:45:10.123033 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37948c42-30e6-4268-846a-b2e7bd3fa1be admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:10.133320 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37948c42-30e6-4268-846a-b2e7bd3fa1be admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:10.138179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7b1a2-f2c8-4dc4-ac35-f72b97c38e36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:10.139170 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7b1a2-f2c8-4dc4-ac35-f72b97c38e36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:10.139450 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7b1a2-f2c8-4dc4-ac35-f72b97c38e36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:10.139735 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b7b1a2-f2c8-4dc4-ac35-f72b97c38e36 admin admin] PATH_INFO: `/v3/projects/a94e0f85cb1b428da00b48f7aafc93e6/users/46442eaf86114b2b923075b521abf784/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:10.141969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7b1a2-f2c8-4dc4-ac35-f72b97c38e36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a94e0f85cb1b428da00b48f7aafc93e6, user_id=46442eaf86114b2b923075b521abf784, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:10.144888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b7b1a2-f2c8-4dc4-ac35-f72b97c38e36 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:10.160941 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1363/2716] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:45:10 2022] PUT /identity/v3/projects/a94e0f85cb1b428da00b48f7aafc93e6/users/46442eaf86114b2b923075b521abf784/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:10.179330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bbc08-772f-4635-9e56-d7e198cc8160 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:10.179690 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bbc08-772f-4635-9e56-d7e198cc8160 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:10.180011 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188bbc08-772f-4635-9e56-d7e198cc8160 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:10.210080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-188bbc08-772f-4635-9e56-d7e198cc8160 None None] MFA Rules not processed for user `46442eaf86114b2b923075b521abf784`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:10.211843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-188bbc08-772f-4635-9e56-d7e198cc8160 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:10.308080 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1354/2717] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:10 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:10.320399 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7b1a2-f2c8-4dc4-ac35-f72b97c38e36 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:10.322332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-18b7b1a2-f2c8-4dc4-ac35-f72b97c38e36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:10.402345 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b7b1a2-f2c8-4dc4-ac35-f72b97c38e36 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:10.407573 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2e2338-4b54-4fd7-b237-ed1f7976bf40 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:10.408613 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e2338-4b54-4fd7-b237-ed1f7976bf40 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:10.409036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e2338-4b54-4fd7-b237-ed1f7976bf40 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:10.410002 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2e2338-4b54-4fd7-b237-ed1f7976bf40 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:10.427034 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e2338-4b54-4fd7-b237-ed1f7976bf40 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:10.428520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2e2338-4b54-4fd7-b237-ed1f7976bf40 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:10.440949 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1364/2718] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:45:10 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:45:11.776476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bbc08-772f-4635-9e56-d7e198cc8160 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:11.847388 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188bbc08-772f-4635-9e56-d7e198cc8160 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:11.852798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32ffa9-d007-4d49-81eb-ef17e32d330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:11.853880 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32ffa9-d007-4d49-81eb-ef17e32d330f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:11.854232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32ffa9-d007-4d49-81eb-ef17e32d330f admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:11.854535 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b32ffa9-d007-4d49-81eb-ef17e32d330f admin admin] PATH_INFO: `/v3/users/2af3564b2f5d40f5ae6a711424cd7eb9` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:11.855994 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32ffa9-d007-4d49-81eb-ef17e32d330f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2af3564b2f5d40f5ae6a711424cd7eb9)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:11.858377 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b32ffa9-d007-4d49-81eb-ef17e32d330f admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:11.872137 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:12.133690 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0b32ffa9-d007-4d49-81eb-ef17e32d330f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2af3564b2f5d40f5ae6a711424cd7eb9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:12.134336 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0b32ffa9-d007-4d49-81eb-ef17e32d330f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2af3564b2f5d40f5ae6a711424cd7eb9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:12.225563 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0b32ffa9-d007-4d49-81eb-ef17e32d330f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2af3564b2f5d40f5ae6a711424cd7eb9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:12.226247 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0b32ffa9-d007-4d49-81eb-ef17e32d330f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2af3564b2f5d40f5ae6a711424cd7eb9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:12.240117 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-0b32ffa9-d007-4d49-81eb-ef17e32d330f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2af3564b2f5d40f5ae6a711424cd7eb9'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:12.258409 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1355/2719] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:45:11 2022] DELETE /identity/v3/users/2af3564b2f5d40f5ae6a711424cd7eb9 => generated 0 bytes in 482 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:12.263239 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10235043-b041-45a0-9d5b-b05256b7795b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:12.263719 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10235043-b041-45a0-9d5b-b05256b7795b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:12.263843 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10235043-b041-45a0-9d5b-b05256b7795b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:12.282352 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-10235043-b041-45a0-9d5b-b05256b7795b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:12.284249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-10235043-b041-45a0-9d5b-b05256b7795b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:12.303911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:12.348765 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1365/2720] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:12.359097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32ffa9-d007-4d49-81eb-ef17e32d330f admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:12.361511 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-0b32ffa9-d007-4d49-81eb-ef17e32d330f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:12.437126 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b32ffa9-d007-4d49-81eb-ef17e32d330f admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:12.441101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae085fe-6ff5-4c97-bb0c-b5980762b0ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:12.446515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae085fe-6ff5-4c97-bb0c-b5980762b0ea service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:12.446515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae085fe-6ff5-4c97-bb0c-b5980762b0ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:12.446515 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae085fe-6ff5-4c97-bb0c-b5980762b0ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:12.452281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae085fe-6ff5-4c97-bb0c-b5980762b0ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:12.453778 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae085fe-6ff5-4c97-bb0c-b5980762b0ea service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:12.464547 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1356/2721] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:45:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:45:12.944821 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10235043-b041-45a0-9d5b-b05256b7795b None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:12.946595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-10235043-b041-45a0-9d5b-b05256b7795b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:12.968581 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10235043-b041-45a0-9d5b-b05256b7795b None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:12.977121 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612deb83-a3c3-4f11-920d-fbdd0533c122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:12.978269 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612deb83-a3c3-4f11-920d-fbdd0533c122 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:12.978730 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612deb83-a3c3-4f11-920d-fbdd0533c122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:12.979037 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612deb83-a3c3-4f11-920d-fbdd0533c122 admin admin] PATH_INFO: `/v3/projects/5f4f5fd470d842889a671d74ae705d41` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:12.981582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612deb83-a3c3-4f11-920d-fbdd0533c122 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f4f5fd470d842889a671d74ae705d41)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:12.991326 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612deb83-a3c3-4f11-920d-fbdd0533c122 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:13.396020 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-612deb83-a3c3-4f11-920d-fbdd0533c122 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f4f5fd470d842889a671d74ae705d41', 'request_id': 'req-612deb83-a3c3-4f11-920d-fbdd0533c122'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:13.405539 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-612deb83-a3c3-4f11-920d-fbdd0533c122 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f4f5fd470d842889a671d74ae705d41', 'request_id': 'req-612deb83-a3c3-4f11-920d-fbdd0533c122'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:13.413591 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-612deb83-a3c3-4f11-920d-fbdd0533c122 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f4f5fd470d842889a671d74ae705d41', 'request_id': 'req-612deb83-a3c3-4f11-920d-fbdd0533c122'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:13.484198 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-612deb83-a3c3-4f11-920d-fbdd0533c122 admin admin] The token cache is being invalidate because project 5f4f5fd470d842889a671d74ae705d41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:45:13.490520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-612deb83-a3c3-4f11-920d-fbdd0533c122 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:13.490520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-612deb83-a3c3-4f11-920d-fbdd0533c122 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:13.490520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1366/2722] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:45:12 2022] DELETE /identity/v3/projects/5f4f5fd470d842889a671d74ae705d41 => generated 0 bytes in 545 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:13.491568 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae085fe-6ff5-4c97-bb0c-b5980762b0ea service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:13.502258 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae085fe-6ff5-4c97-bb0c-b5980762b0ea service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:13.567942 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c45876a-a91d-4fb0-9ee3-0c012dcb2081 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:13.569029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45876a-a91d-4fb0-9ee3-0c012dcb2081 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:13.569741 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45876a-a91d-4fb0-9ee3-0c012dcb2081 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:13.570232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c45876a-a91d-4fb0-9ee3-0c012dcb2081 admin admin] PATH_INFO: `/v3/users/46442eaf86114b2b923075b521abf784` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:13.572161 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45876a-a91d-4fb0-9ee3-0c012dcb2081 admin admin] RBAC: Authorizing `identity:delete_user(user_id=46442eaf86114b2b923075b521abf784)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:13.574720 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c45876a-a91d-4fb0-9ee3-0c012dcb2081 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:13.839909 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:13.857730 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8c45876a-a91d-4fb0-9ee3-0c012dcb2081 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '46442eaf86114b2b923075b521abf784'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:13.858612 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8c45876a-a91d-4fb0-9ee3-0c012dcb2081 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '46442eaf86114b2b923075b521abf784'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:13.979700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8c45876a-a91d-4fb0-9ee3-0c012dcb2081 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '46442eaf86114b2b923075b521abf784'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:13.980874 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8c45876a-a91d-4fb0-9ee3-0c012dcb2081 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '46442eaf86114b2b923075b521abf784'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:14.000093 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8c45876a-a91d-4fb0-9ee3-0c012dcb2081 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '46442eaf86114b2b923075b521abf784'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:14.020168 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1357/2723] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:45:13 2022] DELETE /identity/v3/users/46442eaf86114b2b923075b521abf784 => generated 0 bytes in 529 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:14.690938 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612deb83-a3c3-4f11-920d-fbdd0533c122 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:14.692822 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-612deb83-a3c3-4f11-920d-fbdd0533c122 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:14.716274 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612deb83-a3c3-4f11-920d-fbdd0533c122 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:14.786054 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4861e2b0-5a8b-4eda-bbea-e6bb48ad75e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:14.786978 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e2b0-5a8b-4eda-bbea-e6bb48ad75e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:14.787258 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e2b0-5a8b-4eda-bbea-e6bb48ad75e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:14.787530 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861e2b0-5a8b-4eda-bbea-e6bb48ad75e7 admin admin] PATH_INFO: `/v3/projects/a94e0f85cb1b428da00b48f7aafc93e6` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:14.788789 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861e2b0-5a8b-4eda-bbea-e6bb48ad75e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a94e0f85cb1b428da00b48f7aafc93e6)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:14.790853 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4861e2b0-5a8b-4eda-bbea-e6bb48ad75e7 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:14.913510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4861e2b0-5a8b-4eda-bbea-e6bb48ad75e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a94e0f85cb1b428da00b48f7aafc93e6', 'request_id': 'req-4861e2b0-5a8b-4eda-bbea-e6bb48ad75e7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:14.914609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:14.921421 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4861e2b0-5a8b-4eda-bbea-e6bb48ad75e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a94e0f85cb1b428da00b48f7aafc93e6', 'request_id': 'req-4861e2b0-5a8b-4eda-bbea-e6bb48ad75e7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:14.929393 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4861e2b0-5a8b-4eda-bbea-e6bb48ad75e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a94e0f85cb1b428da00b48f7aafc93e6', 'request_id': 'req-4861e2b0-5a8b-4eda-bbea-e6bb48ad75e7'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:14.986114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4861e2b0-5a8b-4eda-bbea-e6bb48ad75e7 admin admin] The token cache is being invalidate because project a94e0f85cb1b428da00b48f7aafc93e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:45:14.986847 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4861e2b0-5a8b-4eda-bbea-e6bb48ad75e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:14.987733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-4861e2b0-5a8b-4eda-bbea-e6bb48ad75e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:14.989440 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1367/2724] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:45:14 2022] DELETE /identity/v3/projects/a94e0f85cb1b428da00b48f7aafc93e6 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:14.994715 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be6b50-1c51-4fd6-99dd-b799e9540eb0 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:14.998185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be6b50-1c51-4fd6-99dd-b799e9540eb0 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:14.998185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5be6b50-1c51-4fd6-99dd-b799e9540eb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:15.017970 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d5be6b50-1c51-4fd6-99dd-b799e9540eb0 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:15.019392 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d5be6b50-1c51-4fd6-99dd-b799e9540eb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:15.093744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1358/2725] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:15.096384 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635af96d-045b-4c19-ab23-68359985b902 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:15.096672 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635af96d-045b-4c19-ab23-68359985b902 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:15.096946 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635af96d-045b-4c19-ab23-68359985b902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:15.115901 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-635af96d-045b-4c19-ab23-68359985b902 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:15.117132 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-635af96d-045b-4c19-ab23-68359985b902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:15.125109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1368/2726] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:45:15.130101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be6b50-1c51-4fd6-99dd-b799e9540eb0 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:15.140180 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5be6b50-1c51-4fd6-99dd-b799e9540eb0 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:15.145801 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de36e1f-b923-4c04-bb5e-fe419df710fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:15.146572 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de36e1f-b923-4c04-bb5e-fe419df710fa admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:15.146960 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de36e1f-b923-4c04-bb5e-fe419df710fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:15.147230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de36e1f-b923-4c04-bb5e-fe419df710fa admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:15.148100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de36e1f-b923-4c04-bb5e-fe419df710fa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:45:15.148468 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de36e1f-b923-4c04-bb5e-fe419df710fa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:15.150402 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de36e1f-b923-4c04-bb5e-fe419df710fa admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:15.164299 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1359/2727] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:45:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:45:15.168586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635af96d-045b-4c19-ab23-68359985b902 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:15.178321 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635af96d-045b-4c19-ab23-68359985b902 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:15.183704 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd0fbc-1fb0-4123-b630-e09e841c3293 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:15.184347 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd0fbc-1fb0-4123-b630-e09e841c3293 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:15.184620 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd0fbc-1fb0-4123-b630-e09e841c3293 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:15.184892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fd0fbc-1fb0-4123-b630-e09e841c3293 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:15.185590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd0fbc-1fb0-4123-b630-e09e841c3293 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:15.187525 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fd0fbc-1fb0-4123-b630-e09e841c3293 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:15.302041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1369/2728] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:45:15 2022] POST /identity/v3/projects => generated 371 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:45:15.306260 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de36e1f-b923-4c04-bb5e-fe419df710fa admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:15.317134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de36e1f-b923-4c04-bb5e-fe419df710fa admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:15.376886 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee320db5-7cb6-49ee-bd1f-b38c4a404a23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:15.377570 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee320db5-7cb6-49ee-bd1f-b38c4a404a23 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:15.377851 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee320db5-7cb6-49ee-bd1f-b38c4a404a23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:15.378129 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee320db5-7cb6-49ee-bd1f-b38c4a404a23 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:15.378860 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee320db5-7cb6-49ee-bd1f-b38c4a404a23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:15.380816 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee320db5-7cb6-49ee-bd1f-b38c4a404a23 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:15.471708 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1360/2729] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:45:15 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:45:15.475960 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd0fbc-1fb0-4123-b630-e09e841c3293 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:15.488027 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fd0fbc-1fb0-4123-b630-e09e841c3293 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:15.492741 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f56e54-1d3d-4274-b14c-f7a667b94f9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:15.493403 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f56e54-1d3d-4274-b14c-f7a667b94f9d admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:15.493705 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f56e54-1d3d-4274-b14c-f7a667b94f9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:15.493982 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f56e54-1d3d-4274-b14c-f7a667b94f9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:15.494723 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f56e54-1d3d-4274-b14c-f7a667b94f9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:15.496392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f56e54-1d3d-4274-b14c-f7a667b94f9d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:15.511669 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1370/2730] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:45:15.512910 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee320db5-7cb6-49ee-bd1f-b38c4a404a23 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:15.526400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee320db5-7cb6-49ee-bd1f-b38c4a404a23 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:15.531398 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64959191-1eda-4a42-9764-0b8c204e15d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:15.532911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64959191-1eda-4a42-9764-0b8c204e15d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:15.533296 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64959191-1eda-4a42-9764-0b8c204e15d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:15.533575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64959191-1eda-4a42-9764-0b8c204e15d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:15.534350 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64959191-1eda-4a42-9764-0b8c204e15d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:15.535982 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64959191-1eda-4a42-9764-0b8c204e15d1 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:15.546965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1361/2731] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:45:15 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:45:15.552074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f56e54-1d3d-4274-b14c-f7a667b94f9d admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:15.562326 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f56e54-1d3d-4274-b14c-f7a667b94f9d admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:15.567134 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355befd-f381-4280-823f-3a5135c1e993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:15.568023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355befd-f381-4280-823f-3a5135c1e993 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:15.568307 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355befd-f381-4280-823f-3a5135c1e993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:15.568583 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1355befd-f381-4280-823f-3a5135c1e993 admin admin] PATH_INFO: `/v3/projects/19fc8acec6754664970f721237815401/users/09afe9c638124d268c26c9d393fa790c/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:15.583914 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355befd-f381-4280-823f-3a5135c1e993 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19fc8acec6754664970f721237815401, user_id=09afe9c638124d268c26c9d393fa790c, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:15.586642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1355befd-f381-4280-823f-3a5135c1e993 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:15.660526 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1371/2732] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:45:15 2022] PUT /identity/v3/projects/19fc8acec6754664970f721237815401/users/09afe9c638124d268c26c9d393fa790c/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:15.671246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02258b32-4a88-4b14-a136-cadf4b9d40a6 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:15.671538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02258b32-4a88-4b14-a136-cadf4b9d40a6 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:15.671821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02258b32-4a88-4b14-a136-cadf4b9d40a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:15.699096 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-02258b32-4a88-4b14-a136-cadf4b9d40a6 None None] MFA Rules not processed for user `09afe9c638124d268c26c9d393fa790c`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:15.700254 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-02258b32-4a88-4b14-a136-cadf4b9d40a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:15.705030 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:15.771167 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1362/2733] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:15 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:15.783355 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355befd-f381-4280-823f-3a5135c1e993 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:15.785523 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1355befd-f381-4280-823f-3a5135c1e993 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:15.850283 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1355befd-f381-4280-823f-3a5135c1e993 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:15.854593 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a39f1c-9553-42e7-9631-8ad6a791a0d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:15.855329 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a39f1c-9553-42e7-9631-8ad6a791a0d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:15.855840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a39f1c-9553-42e7-9631-8ad6a791a0d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:15.856182 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a39f1c-9553-42e7-9631-8ad6a791a0d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:15.867355 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a39f1c-9553-42e7-9631-8ad6a791a0d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:15.873120 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a39f1c-9553-42e7-9631-8ad6a791a0d9 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:15.879284 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1372/2734] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:45:15 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:45:15.900660 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02258b32-4a88-4b14-a136-cadf4b9d40a6 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:15.982636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02258b32-4a88-4b14-a136-cadf4b9d40a6 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:15.987369 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c67c2f-8a3e-40eb-90e8-8c79f70adfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:15.988239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c67c2f-8a3e-40eb-90e8-8c79f70adfb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:15.988519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c67c2f-8a3e-40eb-90e8-8c79f70adfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:15.988795 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c67c2f-8a3e-40eb-90e8-8c79f70adfb6 admin admin] PATH_INFO: `/v3/users/09afe9c638124d268c26c9d393fa790c` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:15.990036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c67c2f-8a3e-40eb-90e8-8c79f70adfb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=09afe9c638124d268c26c9d393fa790c)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:15.991984 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c67c2f-8a3e-40eb-90e8-8c79f70adfb6 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:16.174170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-87c67c2f-8a3e-40eb-90e8-8c79f70adfb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09afe9c638124d268c26c9d393fa790c'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:16.175061 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-87c67c2f-8a3e-40eb-90e8-8c79f70adfb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09afe9c638124d268c26c9d393fa790c'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:16.276966 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-87c67c2f-8a3e-40eb-90e8-8c79f70adfb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09afe9c638124d268c26c9d393fa790c'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:16.277796 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-87c67c2f-8a3e-40eb-90e8-8c79f70adfb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09afe9c638124d268c26c9d393fa790c'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:16.294316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-87c67c2f-8a3e-40eb-90e8-8c79f70adfb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09afe9c638124d268c26c9d393fa790c'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:16.313955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1363/2735] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:45:15 2022] DELETE /identity/v3/users/09afe9c638124d268c26c9d393fa790c => generated 0 bytes in 414 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:16.318682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fda0e-35be-4376-bdfa-90b2a202d731 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:16.319095 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fda0e-35be-4376-bdfa-90b2a202d731 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:16.319276 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8fda0e-35be-4376-bdfa-90b2a202d731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:16.341616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-2b8fda0e-35be-4376-bdfa-90b2a202d731 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:16.341837 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2b8fda0e-35be-4376-bdfa-90b2a202d731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:16.416567 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1373/2736] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:16.426542 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c67c2f-8a3e-40eb-90e8-8c79f70adfb6 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:16.428594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-87c67c2f-8a3e-40eb-90e8-8c79f70adfb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:16.465486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:16.525202 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c67c2f-8a3e-40eb-90e8-8c79f70adfb6 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:16.528992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f82619-0cf8-4578-ba4e-ea6cf33e45dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:16.529642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f82619-0cf8-4578-ba4e-ea6cf33e45dc service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:16.529926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f82619-0cf8-4578-ba4e-ea6cf33e45dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:16.530204 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f82619-0cf8-4578-ba4e-ea6cf33e45dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:16.541279 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f82619-0cf8-4578-ba4e-ea6cf33e45dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:16.542780 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f82619-0cf8-4578-ba4e-ea6cf33e45dc service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:16.555103 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1364/2737] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:45:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:45:17.021664 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fda0e-35be-4376-bdfa-90b2a202d731 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:17.023796 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2b8fda0e-35be-4376-bdfa-90b2a202d731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:17.038351 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8fda0e-35be-4376-bdfa-90b2a202d731 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:17.043678 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8976527-b98a-4cc3-9a4c-cfaf928023ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:17.044727 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8976527-b98a-4cc3-9a4c-cfaf928023ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:17.045165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8976527-b98a-4cc3-9a4c-cfaf928023ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:17.045414 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8976527-b98a-4cc3-9a4c-cfaf928023ee admin admin] PATH_INFO: `/v3/projects/19fc8acec6754664970f721237815401` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:17.046913 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8976527-b98a-4cc3-9a4c-cfaf928023ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=19fc8acec6754664970f721237815401)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:17.051348 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8976527-b98a-4cc3-9a4c-cfaf928023ee admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:17.062328 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:17.159857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f8976527-b98a-4cc3-9a4c-cfaf928023ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19fc8acec6754664970f721237815401', 'request_id': 'req-f8976527-b98a-4cc3-9a4c-cfaf928023ee'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:17.166530 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f8976527-b98a-4cc3-9a4c-cfaf928023ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19fc8acec6754664970f721237815401', 'request_id': 'req-f8976527-b98a-4cc3-9a4c-cfaf928023ee'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:17.173578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f8976527-b98a-4cc3-9a4c-cfaf928023ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19fc8acec6754664970f721237815401', 'request_id': 'req-f8976527-b98a-4cc3-9a4c-cfaf928023ee'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:17.253832 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f8976527-b98a-4cc3-9a4c-cfaf928023ee admin admin] The token cache is being invalidate because project 19fc8acec6754664970f721237815401 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:45:17.254116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f8976527-b98a-4cc3-9a4c-cfaf928023ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:17.254743 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-f8976527-b98a-4cc3-9a4c-cfaf928023ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:17.256370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1374/2738] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:45:17 2022] DELETE /identity/v3/projects/19fc8acec6754664970f721237815401 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:17.261349 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d19b23-54ca-4957-81d8-9f1af1c425ce None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:17.261845 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d19b23-54ca-4957-81d8-9f1af1c425ce None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:17.261949 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d19b23-54ca-4957-81d8-9f1af1c425ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:17.281281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-36d19b23-54ca-4957-81d8-9f1af1c425ce None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:17.283174 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-36d19b23-54ca-4957-81d8-9f1af1c425ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:17.346477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1365/2739] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:17.355467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54064c-649f-4f1e-bfb5-e00cf43fd02e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:17.355751 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54064c-649f-4f1e-bfb5-e00cf43fd02e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:17.356028 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54064c-649f-4f1e-bfb5-e00cf43fd02e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:17.374902 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5e54064c-649f-4f1e-bfb5-e00cf43fd02e None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:17.376542 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5e54064c-649f-4f1e-bfb5-e00cf43fd02e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:17.385102 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1375/2740] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:17.389538 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d19b23-54ca-4957-81d8-9f1af1c425ce None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:17.407965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d19b23-54ca-4957-81d8-9f1af1c425ce None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:17.407965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d893398-9836-42f6-89dc-1be1db469ce7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:17.407965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d893398-9836-42f6-89dc-1be1db469ce7 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:17.407965 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d893398-9836-42f6-89dc-1be1db469ce7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:17.408322 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d893398-9836-42f6-89dc-1be1db469ce7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:17.408322 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d893398-9836-42f6-89dc-1be1db469ce7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:45:17.408322 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d893398-9836-42f6-89dc-1be1db469ce7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:17.409229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d893398-9836-42f6-89dc-1be1db469ce7 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:17.421187 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1366/2741] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:45:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:45:17.425774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54064c-649f-4f1e-bfb5-e00cf43fd02e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:17.435242 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54064c-649f-4f1e-bfb5-e00cf43fd02e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:17.440896 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00019247-5e81-4c8e-a247-89a0bd923639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:17.448048 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00019247-5e81-4c8e-a247-89a0bd923639 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:17.448048 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00019247-5e81-4c8e-a247-89a0bd923639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:17.448048 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00019247-5e81-4c8e-a247-89a0bd923639 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:17.448048 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00019247-5e81-4c8e-a247-89a0bd923639 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:17.448048 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00019247-5e81-4c8e-a247-89a0bd923639 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:17.582811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1376/2742] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:45:17 2022] POST /identity/v3/projects => generated 377 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:45:17.643706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d893398-9836-42f6-89dc-1be1db469ce7 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:17.654291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d893398-9836-42f6-89dc-1be1db469ce7 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:17.719400 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70df8c7-eab3-43cb-9a6f-d2cb106c98d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:17.720083 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70df8c7-eab3-43cb-9a6f-d2cb106c98d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:17.720368 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70df8c7-eab3-43cb-9a6f-d2cb106c98d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:17.720638 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c70df8c7-eab3-43cb-9a6f-d2cb106c98d0 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:17.721331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70df8c7-eab3-43cb-9a6f-d2cb106c98d0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:17.723425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c70df8c7-eab3-43cb-9a6f-d2cb106c98d0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:17.825993 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1367/2743] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:45:17 2022] POST /identity/v3/users => generated 289 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:45:17.830087 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00019247-5e81-4c8e-a247-89a0bd923639 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:17.840810 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00019247-5e81-4c8e-a247-89a0bd923639 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:17.846187 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc679a-ff3f-485d-8474-059425840eac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:17.846929 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc679a-ff3f-485d-8474-059425840eac admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:17.847209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc679a-ff3f-485d-8474-059425840eac admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:17.847476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc679a-ff3f-485d-8474-059425840eac admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:17.848212 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc679a-ff3f-485d-8474-059425840eac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:17.849809 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc679a-ff3f-485d-8474-059425840eac admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:17.862937 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1377/2744] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:45:17.866763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70df8c7-eab3-43cb-9a6f-d2cb106c98d0 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:17.877660 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c70df8c7-eab3-43cb-9a6f-d2cb106c98d0 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:17.882342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37637cff-713b-48c4-ae49-1ab6c854a68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:17.883036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37637cff-713b-48c4-ae49-1ab6c854a68c admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:17.883316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37637cff-713b-48c4-ae49-1ab6c854a68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:17.883590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37637cff-713b-48c4-ae49-1ab6c854a68c admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:17.884346 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37637cff-713b-48c4-ae49-1ab6c854a68c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:17.885929 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37637cff-713b-48c4-ae49-1ab6c854a68c admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:17.897409 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1368/2745] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:45:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:45:17.908742 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc679a-ff3f-485d-8474-059425840eac admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:17.919107 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc679a-ff3f-485d-8474-059425840eac admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:17.924372 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f88bd-2b1e-47a6-9599-e459813ea487 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:17.925260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f88bd-2b1e-47a6-9599-e459813ea487 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:17.925537 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f88bd-2b1e-47a6-9599-e459813ea487 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:17.925812 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950f88bd-2b1e-47a6-9599-e459813ea487 admin admin] PATH_INFO: `/v3/projects/08d3d26f6d9241078cbf151c4661dc04/users/8aa330bd172d4922a7ab89af281fa848/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:17.945001 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f88bd-2b1e-47a6-9599-e459813ea487 admin admin] RBAC: Authorizing `identity:create_grant(project_id=08d3d26f6d9241078cbf151c4661dc04, user_id=8aa330bd172d4922a7ab89af281fa848, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:17.947736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-950f88bd-2b1e-47a6-9599-e459813ea487 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:18.032816 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1378/2746] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:45:17 2022] PUT /identity/v3/projects/08d3d26f6d9241078cbf151c4661dc04/users/8aa330bd172d4922a7ab89af281fa848/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:18.043255 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c76c3-a674-4359-aa72-b114937922e7 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:18.043542 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c76c3-a674-4359-aa72-b114937922e7 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:18.043823 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-834c76c3-a674-4359-aa72-b114937922e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:18.075366 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:18.080526 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-834c76c3-a674-4359-aa72-b114937922e7 None None] MFA Rules not processed for user `8aa330bd172d4922a7ab89af281fa848`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:18.081831 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-834c76c3-a674-4359-aa72-b114937922e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:18.159088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1369/2747] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:18.167772 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f88bd-2b1e-47a6-9599-e459813ea487 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:18.169634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-950f88bd-2b1e-47a6-9599-e459813ea487 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:18.231116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950f88bd-2b1e-47a6-9599-e459813ea487 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:18.234893 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc900e7-2cb9-42fd-ae8a-188c29069641 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2352b5c2aa664bf0a7e321ff3a5038fd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:18.235808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc900e7-2cb9-42fd-ae8a-188c29069641 service glance] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:18.236123 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc900e7-2cb9-42fd-ae8a-188c29069641 service glance] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:18.236402 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc900e7-2cb9-42fd-ae8a-188c29069641 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:18.245688 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc900e7-2cb9-42fd-ae8a-188c29069641 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:18.247466 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc900e7-2cb9-42fd-ae8a-188c29069641 service glance] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:18.257946 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1379/2748] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:45:18 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:45:28.253420 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=72,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:28.259932 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=26 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:28.527432 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3bf6d-0c17-43b8-9a32-2ef4311e0f47 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:28.527718 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3bf6d-0c17-43b8-9a32-2ef4311e0f47 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:28.527995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d3bf6d-0c17-43b8-9a32-2ef4311e0f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:28.551602 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-99d3bf6d-0c17-43b8-9a32-2ef4311e0f47 None None] MFA Rules not processed for user `d0e357a0937e496983345aa1419324f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:28.555170 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-99d3bf6d-0c17-43b8-9a32-2ef4311e0f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:28.638349 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1370/2749] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:28 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:45:33.491297 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc44222-494a-48f8-9ec8-84921ff23d67 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:33.491839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc44222-494a-48f8-9ec8-84921ff23d67 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:33.492041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc44222-494a-48f8-9ec8-84921ff23d67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:33.534099 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3fc44222-494a-48f8-9ec8-84921ff23d67 None None] MFA Rules not processed for user `5503d249dd3a448fb94b9b3aed87de7a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:33.534099 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3fc44222-494a-48f8-9ec8-84921ff23d67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:33.593535 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1380/2750] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:34.863216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3bf6d-0c17-43b8-9a32-2ef4311e0f47 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:34.948342 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d3bf6d-0c17-43b8-9a32-2ef4311e0f47 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:34.955862 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12818d-47ae-4891-b82b-de8d45130eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:34.956754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12818d-47ae-4891-b82b-de8d45130eb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:34.957033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12818d-47ae-4891-b82b-de8d45130eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:34.957312 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d12818d-47ae-4891-b82b-de8d45130eb6 admin admin] PATH_INFO: `/v3/users/8aa330bd172d4922a7ab89af281fa848` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:34.958557 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12818d-47ae-4891-b82b-de8d45130eb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8aa330bd172d4922a7ab89af281fa848)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:34.960665 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d12818d-47ae-4891-b82b-de8d45130eb6 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:35.140293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8d12818d-47ae-4891-b82b-de8d45130eb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8aa330bd172d4922a7ab89af281fa848'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:35.141923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8d12818d-47ae-4891-b82b-de8d45130eb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8aa330bd172d4922a7ab89af281fa848'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:35.213711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8d12818d-47ae-4891-b82b-de8d45130eb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8aa330bd172d4922a7ab89af281fa848'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:35.214339 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8d12818d-47ae-4891-b82b-de8d45130eb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8aa330bd172d4922a7ab89af281fa848'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:35.227528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-8d12818d-47ae-4891-b82b-de8d45130eb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8aa330bd172d4922a7ab89af281fa848'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:35.241487 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1371/2751] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:45:34 2022] DELETE /identity/v3/users/8aa330bd172d4922a7ab89af281fa848 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:35.245762 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c03716-dc9c-4178-bd6e-1e64741160c4 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:35.246410 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c03716-dc9c-4178-bd6e-1e64741160c4 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:35.246410 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c03716-dc9c-4178-bd6e-1e64741160c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:35.266451 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-65c03716-dc9c-4178-bd6e-1e64741160c4 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:35.267820 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-65c03716-dc9c-4178-bd6e-1e64741160c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:35.333433 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1381/2752] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:35.343764 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12818d-47ae-4891-b82b-de8d45130eb6 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:35.345428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8d12818d-47ae-4891-b82b-de8d45130eb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:35.376466 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:35.409887 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d12818d-47ae-4891-b82b-de8d45130eb6 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:35.414205 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ea822c-a614-4a67-8a65-b96ddbb68a53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:35.414943 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea822c-a614-4a67-8a65-b96ddbb68a53 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:35.415281 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea822c-a614-4a67-8a65-b96ddbb68a53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:35.415585 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ea822c-a614-4a67-8a65-b96ddbb68a53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:35.425831 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea822c-a614-4a67-8a65-b96ddbb68a53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:35.427277 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ea822c-a614-4a67-8a65-b96ddbb68a53 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:35.440787 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1372/2753] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:45:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:45:36.021540 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c03716-dc9c-4178-bd6e-1e64741160c4 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:36.023232 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-65c03716-dc9c-4178-bd6e-1e64741160c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:36.037969 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c03716-dc9c-4178-bd6e-1e64741160c4 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:36.042830 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0240003d-5ca4-4f53-9b2e-c7e75979b2b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:36.043711 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240003d-5ca4-4f53-9b2e-c7e75979b2b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:36.043991 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240003d-5ca4-4f53-9b2e-c7e75979b2b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:36.044262 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0240003d-5ca4-4f53-9b2e-c7e75979b2b3 admin admin] PATH_INFO: `/v3/projects/08d3d26f6d9241078cbf151c4661dc04` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:36.045624 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240003d-5ca4-4f53-9b2e-c7e75979b2b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=08d3d26f6d9241078cbf151c4661dc04)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:36.047921 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0240003d-5ca4-4f53-9b2e-c7e75979b2b3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:36.272916 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0240003d-5ca4-4f53-9b2e-c7e75979b2b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '08d3d26f6d9241078cbf151c4661dc04', 'request_id': 'req-0240003d-5ca4-4f53-9b2e-c7e75979b2b3'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:36.279268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0240003d-5ca4-4f53-9b2e-c7e75979b2b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '08d3d26f6d9241078cbf151c4661dc04', 'request_id': 'req-0240003d-5ca4-4f53-9b2e-c7e75979b2b3'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:36.286319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0240003d-5ca4-4f53-9b2e-c7e75979b2b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '08d3d26f6d9241078cbf151c4661dc04', 'request_id': 'req-0240003d-5ca4-4f53-9b2e-c7e75979b2b3'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:36.401936 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0240003d-5ca4-4f53-9b2e-c7e75979b2b3 admin admin] The token cache is being invalidate because project 08d3d26f6d9241078cbf151c4661dc04 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:45:36.402172 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0240003d-5ca4-4f53-9b2e-c7e75979b2b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:36.402817 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-0240003d-5ca4-4f53-9b2e-c7e75979b2b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:36.404374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1382/2754] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:45:36 2022] DELETE /identity/v3/projects/08d3d26f6d9241078cbf151c4661dc04 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:36.410677 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d3d59-8df7-41cb-9728-8171b38184bb None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:36.411256 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d3d59-8df7-41cb-9728-8171b38184bb None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:36.411256 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0d3d59-8df7-41cb-9728-8171b38184bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:36.429932 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-8f0d3d59-8df7-41cb-9728-8171b38184bb None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:36.431196 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8f0d3d59-8df7-41cb-9728-8171b38184bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:36.494196 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1373/2755] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:36.502732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083fdde-10e4-4ecd-9a26-1d2723540614 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:36.503081 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083fdde-10e4-4ecd-9a26-1d2723540614 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:36.503371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5083fdde-10e4-4ecd-9a26-1d2723540614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:36.523053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-5083fdde-10e4-4ecd-9a26-1d2723540614 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:36.524307 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-5083fdde-10e4-4ecd-9a26-1d2723540614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:36.533522 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1383/2756] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:36.538185 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d3d59-8df7-41cb-9728-8171b38184bb None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:36.549214 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0d3d59-8df7-41cb-9728-8171b38184bb None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:36.554450 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f01bfa-64cc-4bb7-a82b-7ebd931d6642 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:36.555343 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f01bfa-64cc-4bb7-a82b-7ebd931d6642 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:36.555606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f01bfa-64cc-4bb7-a82b-7ebd931d6642 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:36.555883 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f01bfa-64cc-4bb7-a82b-7ebd931d6642 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:36.556632 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f01bfa-64cc-4bb7-a82b-7ebd931d6642 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:45:36.556941 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f01bfa-64cc-4bb7-a82b-7ebd931d6642 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:36.558660 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45f01bfa-64cc-4bb7-a82b-7ebd931d6642 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:36.577235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1374/2757] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:45:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:45:36.578912 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083fdde-10e4-4ecd-9a26-1d2723540614 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:36.589029 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5083fdde-10e4-4ecd-9a26-1d2723540614 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:36.594986 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02389695-1dac-4e57-a64a-44e1ed6e2c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:36.595856 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02389695-1dac-4e57-a64a-44e1ed6e2c05 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:36.596148 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02389695-1dac-4e57-a64a-44e1ed6e2c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:36.596493 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02389695-1dac-4e57-a64a-44e1ed6e2c05 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:36.597273 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02389695-1dac-4e57-a64a-44e1ed6e2c05 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:36.600414 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02389695-1dac-4e57-a64a-44e1ed6e2c05 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:36.712788 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:36.721319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1384/2758] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:45:36 2022] POST /identity/v3/projects => generated 391 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:45:36.725714 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f01bfa-64cc-4bb7-a82b-7ebd931d6642 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:36.737341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f01bfa-64cc-4bb7-a82b-7ebd931d6642 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:36.804470 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83be9a-1411-483f-bd7b-950058e1beb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:36.805152 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83be9a-1411-483f-bd7b-950058e1beb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:36.805428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83be9a-1411-483f-bd7b-950058e1beb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:36.805701 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d83be9a-1411-483f-bd7b-950058e1beb9 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:36.806393 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83be9a-1411-483f-bd7b-950058e1beb9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:36.808383 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d83be9a-1411-483f-bd7b-950058e1beb9 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:36.948649 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1375/2759] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:45:36 2022] POST /identity/v3/users => generated 296 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:45:36.949976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02389695-1dac-4e57-a64a-44e1ed6e2c05 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:36.961700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02389695-1dac-4e57-a64a-44e1ed6e2c05 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:36.971256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f975701-e82a-4ab2-8672-ff2e57681842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:36.971256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f975701-e82a-4ab2-8672-ff2e57681842 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:36.971256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f975701-e82a-4ab2-8672-ff2e57681842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:36.971256 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f975701-e82a-4ab2-8672-ff2e57681842 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:36.971563 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f975701-e82a-4ab2-8672-ff2e57681842 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:36.971990 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f975701-e82a-4ab2-8672-ff2e57681842 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:36.986853 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1385/2760] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:45:36.988143 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83be9a-1411-483f-bd7b-950058e1beb9 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:36.998939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d83be9a-1411-483f-bd7b-950058e1beb9 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:37.004010 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903ed33-8a48-4317-9a00-ac15edd20e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:37.004706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903ed33-8a48-4317-9a00-ac15edd20e99 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:37.004991 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903ed33-8a48-4317-9a00-ac15edd20e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:37.005291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903ed33-8a48-4317-9a00-ac15edd20e99 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:37.006015 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903ed33-8a48-4317-9a00-ac15edd20e99 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:37.007671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903ed33-8a48-4317-9a00-ac15edd20e99 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:37.019275 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1376/2761] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:45:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:45:37.023520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f975701-e82a-4ab2-8672-ff2e57681842 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:37.034460 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f975701-e82a-4ab2-8672-ff2e57681842 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:37.039245 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958817a-c90d-4828-9e08-3c692df67621 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:37.040133 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958817a-c90d-4828-9e08-3c692df67621 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:37.040536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958817a-c90d-4828-9e08-3c692df67621 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:37.040987 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8958817a-c90d-4828-9e08-3c692df67621 admin admin] PATH_INFO: `/v3/projects/70c762f26dc94422bbe58917814a1c8d/users/5bc0b4e638c642c7bf02aff9feaea429/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:37.057113 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958817a-c90d-4828-9e08-3c692df67621 admin admin] RBAC: Authorizing `identity:create_grant(project_id=70c762f26dc94422bbe58917814a1c8d, user_id=5bc0b4e638c642c7bf02aff9feaea429, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:37.059858 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8958817a-c90d-4828-9e08-3c692df67621 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:37.162995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1386/2762] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:45:37 2022] PUT /identity/v3/projects/70c762f26dc94422bbe58917814a1c8d/users/5bc0b4e638c642c7bf02aff9feaea429/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:37.175024 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a625a7-1574-4b78-97ea-a567a9c565ec None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:37.176213 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a625a7-1574-4b78-97ea-a567a9c565ec None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:37.176496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a625a7-1574-4b78-97ea-a567a9c565ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:37.216079 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-70a625a7-1574-4b78-97ea-a567a9c565ec None None] MFA Rules not processed for user `5bc0b4e638c642c7bf02aff9feaea429`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:37.217302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-70a625a7-1574-4b78-97ea-a567a9c565ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:37.239851 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:37.295177 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1377/2763] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:37.307241 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958817a-c90d-4828-9e08-3c692df67621 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:37.309110 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-8958817a-c90d-4828-9e08-3c692df67621 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:37.396275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8958817a-c90d-4828-9e08-3c692df67621 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:37.400209 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e543e27e-0522-4607-a083-3270e807ee1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:37.400924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543e27e-0522-4607-a083-3270e807ee1f service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:37.401215 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543e27e-0522-4607-a083-3270e807ee1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:37.401485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e543e27e-0522-4607-a083-3270e807ee1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:37.411831 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543e27e-0522-4607-a083-3270e807ee1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:37.413290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e543e27e-0522-4607-a083-3270e807ee1f service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:37.423375 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1387/2764] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:45:37 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:45:47.299239 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=17 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:47.418774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=50,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:50.446933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a625a7-1574-4b78-97ea-a567a9c565ec None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:50.522716 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a625a7-1574-4b78-97ea-a567a9c565ec None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:50.527599 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32d390-3e18-4a33-879f-85ec27e9b7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:50.529118 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32d390-3e18-4a33-879f-85ec27e9b7e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:50.529405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32d390-3e18-4a33-879f-85ec27e9b7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:50.529687 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c32d390-3e18-4a33-879f-85ec27e9b7e9 admin admin] PATH_INFO: `/v3/users/5bc0b4e638c642c7bf02aff9feaea429` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:50.530933 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32d390-3e18-4a33-879f-85ec27e9b7e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bc0b4e638c642c7bf02aff9feaea429)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:50.532925 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c32d390-3e18-4a33-879f-85ec27e9b7e9 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:50.748132 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7c32d390-3e18-4a33-879f-85ec27e9b7e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bc0b4e638c642c7bf02aff9feaea429'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:50.749093 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7c32d390-3e18-4a33-879f-85ec27e9b7e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bc0b4e638c642c7bf02aff9feaea429'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:50.865867 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7c32d390-3e18-4a33-879f-85ec27e9b7e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bc0b4e638c642c7bf02aff9feaea429'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:50.866181 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7c32d390-3e18-4a33-879f-85ec27e9b7e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bc0b4e638c642c7bf02aff9feaea429'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:50.886560 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-7c32d390-3e18-4a33-879f-85ec27e9b7e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bc0b4e638c642c7bf02aff9feaea429'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:50.908767 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1378/2765] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:45:50 2022] DELETE /identity/v3/users/5bc0b4e638c642c7bf02aff9feaea429 => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:50.910798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe14a8-1353-4b8a-8aeb-183d0324f42f None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:50.911332 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe14a8-1353-4b8a-8aeb-183d0324f42f None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:50.911483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fe14a8-1353-4b8a-8aeb-183d0324f42f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:50.933849 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-e6fe14a8-1353-4b8a-8aeb-183d0324f42f None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:50.935119 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e6fe14a8-1353-4b8a-8aeb-183d0324f42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:51.016171 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1388/2766] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:45:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:45:51.029099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32d390-3e18-4a33-879f-85ec27e9b7e9 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:51.031243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-7c32d390-3e18-4a33-879f-85ec27e9b7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:51.123882 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c32d390-3e18-4a33-879f-85ec27e9b7e9 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:51.128798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8712b3d1-9d17-407c-b0b6-016f1c51222d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:51.129448 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712b3d1-9d17-407c-b0b6-016f1c51222d service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:51.129729 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712b3d1-9d17-407c-b0b6-016f1c51222d service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:51.132316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8712b3d1-9d17-407c-b0b6-016f1c51222d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:51.140583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712b3d1-9d17-407c-b0b6-016f1c51222d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:51.142330 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8712b3d1-9d17-407c-b0b6-016f1c51222d service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:51.153159 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1379/2767] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:45:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:45:51.594094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe14a8-1353-4b8a-8aeb-183d0324f42f None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:51.596691 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e6fe14a8-1353-4b8a-8aeb-183d0324f42f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:51.613786 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fe14a8-1353-4b8a-8aeb-183d0324f42f None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:51.619058 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a675676f-74af-4173-9a7c-68f9cc967255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:51.619919 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675676f-74af-4173-9a7c-68f9cc967255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:51.620197 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675676f-74af-4173-9a7c-68f9cc967255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:51.620510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a675676f-74af-4173-9a7c-68f9cc967255 admin admin] PATH_INFO: `/v3/projects/70c762f26dc94422bbe58917814a1c8d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:51.622065 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675676f-74af-4173-9a7c-68f9cc967255 admin admin] RBAC: Authorizing `identity:delete_project(project_id=70c762f26dc94422bbe58917814a1c8d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:51.624122 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a675676f-74af-4173-9a7c-68f9cc967255 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:51.694636 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d334d4-e411-415b-8aa7-7af763144465 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:51.695188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d334d4-e411-415b-8aa7-7af763144465 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:51.695471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d334d4-e411-415b-8aa7-7af763144465 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:51.730499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-e6d334d4-e411-415b-8aa7-7af763144465 None None] MFA Rules not processed for user `deed55901c264b8da58e57c21840c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:45:51.731903 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e6d334d4-e411-415b-8aa7-7af763144465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:51.741832 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:51.762651 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a675676f-74af-4173-9a7c-68f9cc967255 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '70c762f26dc94422bbe58917814a1c8d', 'request_id': 'req-a675676f-74af-4173-9a7c-68f9cc967255'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:51.771138 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a675676f-74af-4173-9a7c-68f9cc967255 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '70c762f26dc94422bbe58917814a1c8d', 'request_id': 'req-a675676f-74af-4173-9a7c-68f9cc967255'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:51.778105 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a675676f-74af-4173-9a7c-68f9cc967255 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '70c762f26dc94422bbe58917814a1c8d', 'request_id': 'req-a675676f-74af-4173-9a7c-68f9cc967255'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:51.809232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1380/2768] 10.222.0.40 () {58 vars in 1009 bytes} [Fri Jul 15 19:45:51 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:45:51.917299 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a675676f-74af-4173-9a7c-68f9cc967255 admin admin] The token cache is being invalidate because project 70c762f26dc94422bbe58917814a1c8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:45:51.917869 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a675676f-74af-4173-9a7c-68f9cc967255 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:51.919481 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-a675676f-74af-4173-9a7c-68f9cc967255 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:45:51.921444 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1389/2769] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:45:51 2022] DELETE /identity/v3/projects/70c762f26dc94422bbe58917814a1c8d => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:45:52.050463 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d334d4-e411-415b-8aa7-7af763144465 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:45:52.052408 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e6d334d4-e411-415b-8aa7-7af763144465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:52.149585 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d334d4-e411-415b-8aa7-7af763144465 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:45:52.226134 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb225d89-5f91-4f39-8ce0-3d753d2d43dc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0402e1bd20b042cdbdcb890616b22726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:45:52.226845 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb225d89-5f91-4f39-8ce0-3d753d2d43dc service swift] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:45:52.227136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb225d89-5f91-4f39-8ce0-3d753d2d43dc service swift] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:45:52.227413 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb225d89-5f91-4f39-8ce0-3d753d2d43dc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:45:52.230418 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-eb225d89-5f91-4f39-8ce0-3d753d2d43dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:45:52.294111 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:45:52.296573 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb225d89-5f91-4f39-8ce0-3d753d2d43dc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:45:52.299197 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb225d89-5f91-4f39-8ce0-3d753d2d43dc service swift] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:45:52.309363 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1381/2770] 10.222.0.40 () {60 vars in 1384 bytes} [Fri Jul 15 19:45:52 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 15 19:46:01.913657 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=54,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:46:02.327286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:46:09.366278 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be16f6-a552-44b9-9be2-9ca6fc2c0d86 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:09.366724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be16f6-a552-44b9-9be2-9ca6fc2c0d86 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:09.366852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05be16f6-a552-44b9-9be2-9ca6fc2c0d86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:09.385002 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-05be16f6-a552-44b9-9be2-9ca6fc2c0d86 None None] MFA Rules not processed for user `deed55901c264b8da58e57c21840c491`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:46:09.386192 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-05be16f6-a552-44b9-9be2-9ca6fc2c0d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:09.393733 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1390/2771] 10.222.0.40 () {58 vars in 967 bytes} [Fri Jul 15 19:46:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:46:09.405624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb225d89-5f91-4f39-8ce0-3d753d2d43dc service swift] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:09.407901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-eb225d89-5f91-4f39-8ce0-3d753d2d43dc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:09.420980 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb225d89-5f91-4f39-8ce0-3d753d2d43dc service swift] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:09.425916 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5263476-17fc-46b6-8bb5-8ca28948d3be service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0402e1bd20b042cdbdcb890616b22726', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:09.426554 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5263476-17fc-46b6-8bb5-8ca28948d3be service swift] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:09.426871 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5263476-17fc-46b6-8bb5-8ca28948d3be service swift] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:09.427151 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5263476-17fc-46b6-8bb5-8ca28948d3be service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:09.435293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5263476-17fc-46b6-8bb5-8ca28948d3be service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:09.436888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5263476-17fc-46b6-8bb5-8ca28948d3be service swift] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:09.445813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1382/2772] 10.222.0.40 () {60 vars in 1384 bytes} [Fri Jul 15 19:46:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 15 19:46:12.305407 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be16f6-a552-44b9-9be2-9ca6fc2c0d86 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:12.306947 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-05be16f6-a552-44b9-9be2-9ca6fc2c0d86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:12.377588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05be16f6-a552-44b9-9be2-9ca6fc2c0d86 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:12.382671 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e428c2e-ee14-4cfa-898a-69ce95d6dce4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad68d871464f4b5588c22070205f159e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:12.383329 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e428c2e-ee14-4cfa-898a-69ce95d6dce4 service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:12.383607 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e428c2e-ee14-4cfa-898a-69ce95d6dce4 service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:12.383881 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e428c2e-ee14-4cfa-898a-69ce95d6dce4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:12.385608 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2e428c2e-ee14-4cfa-898a-69ce95d6dce4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:12.397799 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e428c2e-ee14-4cfa-898a-69ce95d6dce4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:12.399453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e428c2e-ee14-4cfa-898a-69ce95d6dce4 service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:12.410614 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1391/2773] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:46:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:46:12.425232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5263476-17fc-46b6-8bb5-8ca28948d3be service swift] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:12.426699 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a5263476-17fc-46b6-8bb5-8ca28948d3be service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:12.495710 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5263476-17fc-46b6-8bb5-8ca28948d3be service swift] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:12.500444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533837bb-be43-45cb-8004-cb6d4d78c6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:12.501374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533837bb-be43-45cb-8004-cb6d4d78c6b0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:12.501652 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533837bb-be43-45cb-8004-cb6d4d78c6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:12.501927 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533837bb-be43-45cb-8004-cb6d4d78c6b0 admin admin] PATH_INFO: `/v3/users/d0e357a0937e496983345aa1419324f7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:12.503255 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533837bb-be43-45cb-8004-cb6d4d78c6b0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d0e357a0937e496983345aa1419324f7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:12.505173 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533837bb-be43-45cb-8004-cb6d4d78c6b0 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:12.637502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-533837bb-be43-45cb-8004-cb6d4d78c6b0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd0e357a0937e496983345aa1419324f7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:12.638132 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-533837bb-be43-45cb-8004-cb6d4d78c6b0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd0e357a0937e496983345aa1419324f7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:12.704778 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-533837bb-be43-45cb-8004-cb6d4d78c6b0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd0e357a0937e496983345aa1419324f7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:12.705482 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-533837bb-be43-45cb-8004-cb6d4d78c6b0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd0e357a0937e496983345aa1419324f7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:12.719150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-533837bb-be43-45cb-8004-cb6d4d78c6b0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd0e357a0937e496983345aa1419324f7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:12.731436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1383/2774] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:46:12 2022] DELETE /identity/v3/users/d0e357a0937e496983345aa1419324f7 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:46:12.991498 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e428c2e-ee14-4cfa-898a-69ce95d6dce4 service placement] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:13.003652 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e428c2e-ee14-4cfa-898a-69ce95d6dce4 service placement] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:13.062897 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2515b4a9-8178-4467-8f44-9c9381077a1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:13.064473 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515b4a9-8178-4467-8f44-9c9381077a1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:13.064751 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515b4a9-8178-4467-8f44-9c9381077a1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:13.065026 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2515b4a9-8178-4467-8f44-9c9381077a1d admin admin] PATH_INFO: `/v3/projects/5ef81566938540c89e403ac29f786923` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:13.066247 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515b4a9-8178-4467-8f44-9c9381077a1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=5ef81566938540c89e403ac29f786923)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:13.068201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2515b4a9-8178-4467-8f44-9c9381077a1d admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:13.167528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2515b4a9-8178-4467-8f44-9c9381077a1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5ef81566938540c89e403ac29f786923', 'request_id': 'req-2515b4a9-8178-4467-8f44-9c9381077a1d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:13.174488 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2515b4a9-8178-4467-8f44-9c9381077a1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5ef81566938540c89e403ac29f786923', 'request_id': 'req-2515b4a9-8178-4467-8f44-9c9381077a1d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:13.180436 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2515b4a9-8178-4467-8f44-9c9381077a1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5ef81566938540c89e403ac29f786923', 'request_id': 'req-2515b4a9-8178-4467-8f44-9c9381077a1d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:13.234615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2515b4a9-8178-4467-8f44-9c9381077a1d admin admin] The token cache is being invalidate because project 5ef81566938540c89e403ac29f786923 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:46:13.235378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2515b4a9-8178-4467-8f44-9c9381077a1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:13.236204 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2515b4a9-8178-4467-8f44-9c9381077a1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:13.237775 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1392/2775] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:46:12 2022] DELETE /identity/v3/projects/5ef81566938540c89e403ac29f786923 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:46:13.243029 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad3de6-35af-4191-85f6-2e0e513ddc52 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:13.243324 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad3de6-35af-4191-85f6-2e0e513ddc52 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:13.243604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ad3de6-35af-4191-85f6-2e0e513ddc52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:13.262907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-18ad3de6-35af-4191-85f6-2e0e513ddc52 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:46:13.264121 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-18ad3de6-35af-4191-85f6-2e0e513ddc52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:13.327684 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1384/2776] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:46:13.335667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d04e7-d325-4334-9f76-45c426572dc3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:13.336167 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d04e7-d325-4334-9f76-45c426572dc3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:13.336268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3d04e7-d325-4334-9f76-45c426572dc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:13.354600 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-6e3d04e7-d325-4334-9f76-45c426572dc3 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:46:13.355839 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-6e3d04e7-d325-4334-9f76-45c426572dc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:13.364242 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1393/2777] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:46:13.368559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad3de6-35af-4191-85f6-2e0e513ddc52 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:13.379532 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18ad3de6-35af-4191-85f6-2e0e513ddc52 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:13.384222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bb6b3-f14f-4886-864a-0cb63044e4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:13.384875 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bb6b3-f14f-4886-864a-0cb63044e4fc admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:13.385181 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bb6b3-f14f-4886-864a-0cb63044e4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:13.385484 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569bb6b3-f14f-4886-864a-0cb63044e4fc admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:13.386208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bb6b3-f14f-4886-864a-0cb63044e4fc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:46:13.386513 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bb6b3-f14f-4886-864a-0cb63044e4fc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:13.388159 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569bb6b3-f14f-4886-864a-0cb63044e4fc admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:13.389813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:46:13.400574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1385/2778] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:46:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:46:13.408014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d04e7-d325-4334-9f76-45c426572dc3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:13.417406 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3d04e7-d325-4334-9f76-45c426572dc3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:13.422084 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46832c8b-d9e6-4056-a1ff-80048a014542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:13.423315 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46832c8b-d9e6-4056-a1ff-80048a014542 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:13.423599 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46832c8b-d9e6-4056-a1ff-80048a014542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:13.423870 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46832c8b-d9e6-4056-a1ff-80048a014542 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:13.424566 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46832c8b-d9e6-4056-a1ff-80048a014542 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:13.426485 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46832c8b-d9e6-4056-a1ff-80048a014542 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:13.429857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:46:13.517615 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1394/2779] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:46:13 2022] POST /identity/v3/projects => generated 383 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:46:13.521867 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bb6b3-f14f-4886-864a-0cb63044e4fc admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:13.532522 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569bb6b3-f14f-4886-864a-0cb63044e4fc admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:13.589001 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107a55d-6a65-4a8c-93f7-d9b728d8b889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:13.589665 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107a55d-6a65-4a8c-93f7-d9b728d8b889 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:13.589947 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107a55d-6a65-4a8c-93f7-d9b728d8b889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:13.590224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f107a55d-6a65-4a8c-93f7-d9b728d8b889 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:13.590950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107a55d-6a65-4a8c-93f7-d9b728d8b889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:13.592891 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f107a55d-6a65-4a8c-93f7-d9b728d8b889 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:13.659057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1386/2780] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:46:13 2022] POST /identity/v3/users => generated 292 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:46:13.663246 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46832c8b-d9e6-4056-a1ff-80048a014542 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:13.674578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46832c8b-d9e6-4056-a1ff-80048a014542 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:13.679282 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11171331-16be-4f68-9a7b-7b685aca1969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:13.679924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11171331-16be-4f68-9a7b-7b685aca1969 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:13.680202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11171331-16be-4f68-9a7b-7b685aca1969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:13.680474 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11171331-16be-4f68-9a7b-7b685aca1969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:13.681201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11171331-16be-4f68-9a7b-7b685aca1969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:13.682819 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11171331-16be-4f68-9a7b-7b685aca1969 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:13.693161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1395/2781] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:46:13.697287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107a55d-6a65-4a8c-93f7-d9b728d8b889 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:13.707347 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f107a55d-6a65-4a8c-93f7-d9b728d8b889 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:13.712013 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ae00a7-fa09-46a8-bdd8-ce216e6659de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:13.712671 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae00a7-fa09-46a8-bdd8-ce216e6659de admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:13.712957 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae00a7-fa09-46a8-bdd8-ce216e6659de admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:13.713249 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ae00a7-fa09-46a8-bdd8-ce216e6659de admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:13.714009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae00a7-fa09-46a8-bdd8-ce216e6659de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:13.715633 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ae00a7-fa09-46a8-bdd8-ce216e6659de admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:13.726293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1387/2782] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:46:13 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:46:13.730510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11171331-16be-4f68-9a7b-7b685aca1969 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:13.741373 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11171331-16be-4f68-9a7b-7b685aca1969 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:13.745959 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb26141-31b0-4466-84a9-9e436051351c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:13.746853 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb26141-31b0-4466-84a9-9e436051351c admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:13.747134 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb26141-31b0-4466-84a9-9e436051351c admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:13.747405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb26141-31b0-4466-84a9-9e436051351c admin admin] PATH_INFO: `/v3/projects/68bd7c9b8773450b8cf2af734ef2c846/users/3274e7f7b6014f08916342dca7b3c365/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:13.762337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb26141-31b0-4466-84a9-9e436051351c admin admin] RBAC: Authorizing `identity:create_grant(project_id=68bd7c9b8773450b8cf2af734ef2c846, user_id=3274e7f7b6014f08916342dca7b3c365, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:13.765241 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb26141-31b0-4466-84a9-9e436051351c admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:13.870472 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1396/2783] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:46:13 2022] PUT /identity/v3/projects/68bd7c9b8773450b8cf2af734ef2c846/users/3274e7f7b6014f08916342dca7b3c365/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:46:13.875845 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5ff1e-c888-4d98-94b7-1fcb5855cfd1 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:13.876286 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5ff1e-c888-4d98-94b7-1fcb5855cfd1 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:13.876526 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b5ff1e-c888-4d98-94b7-1fcb5855cfd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:13.895992 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-44b5ff1e-c888-4d98-94b7-1fcb5855cfd1 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:46:13.897318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-44b5ff1e-c888-4d98-94b7-1fcb5855cfd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:13.958015 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1388/2784] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:46:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:46:13.968036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb26141-31b0-4466-84a9-9e436051351c admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:13.970456 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9eb26141-31b0-4466-84a9-9e436051351c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:14.029611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb26141-31b0-4466-84a9-9e436051351c admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:14.034286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3cef6-8b81-4a6f-8c5a-b464a190c096 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:14.035010 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3cef6-8b81-4a6f-8c5a-b464a190c096 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:14.035288 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3cef6-8b81-4a6f-8c5a-b464a190c096 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:14.035562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a3cef6-8b81-4a6f-8c5a-b464a190c096 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:14.045046 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3cef6-8b81-4a6f-8c5a-b464a190c096 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:14.046476 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a3cef6-8b81-4a6f-8c5a-b464a190c096 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:14.056543 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1397/2785] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:46:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:46:15.158957 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f845fc-1dfb-41ec-ab39-6c00ef537dc1 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:15.159499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f845fc-1dfb-41ec-ab39-6c00ef537dc1 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:15.159499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f845fc-1dfb-41ec-ab39-6c00ef537dc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:15.187365 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-e6f845fc-1dfb-41ec-ab39-6c00ef537dc1 None None] MFA Rules not processed for user `3274e7f7b6014f08916342dca7b3c365`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:46:15.191093 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-e6f845fc-1dfb-41ec-ab39-6c00ef537dc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:15.254131 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1389/2786] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:46:15 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:46:15.264947 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3cef6-8b81-4a6f-8c5a-b464a190c096 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:15.266413 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-23a3cef6-8b81-4a6f-8c5a-b464a190c096 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:15.327287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a3cef6-8b81-4a6f-8c5a-b464a190c096 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:15.331188 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853111c8-6e98-43d2-863e-47e221206aad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:15.331924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853111c8-6e98-43d2-863e-47e221206aad service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:15.332207 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853111c8-6e98-43d2-863e-47e221206aad service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:15.332479 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853111c8-6e98-43d2-863e-47e221206aad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:15.341039 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853111c8-6e98-43d2-863e-47e221206aad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:15.342501 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853111c8-6e98-43d2-863e-47e221206aad service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:15.352592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1398/2787] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:46:15 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:46:17.105686 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdc763-e96a-4477-b80e-e4d0bec205a6 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:17.106193 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdc763-e96a-4477-b80e-e4d0bec205a6 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:17.106297 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdc763-e96a-4477-b80e-e4d0bec205a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:17.112761 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:46:17.124955 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-00cdc763-e96a-4477-b80e-e4d0bec205a6 None None] MFA Rules not processed for user `3274e7f7b6014f08916342dca7b3c365`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:46:17.126149 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-00cdc763-e96a-4477-b80e-e4d0bec205a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:17.133813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1390/2788] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:46:17 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:46:25.347537 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=73,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:46:27.212346 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:46:49.159668 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd2a85-27b1-4f26-bc67-117b4ac79d3b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:49.160197 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd2a85-27b1-4f26-bc67-117b4ac79d3b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:49.160197 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aedd2a85-27b1-4f26-bc67-117b4ac79d3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:49.180095 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-aedd2a85-27b1-4f26-bc67-117b4ac79d3b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:46:49.181329 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-aedd2a85-27b1-4f26-bc67-117b4ac79d3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:49.189747 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1399/2789] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 15 19:46:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:46:49.204519 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdc763-e96a-4477-b80e-e4d0bec205a6 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:49.206042 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-00cdc763-e96a-4477-b80e-e4d0bec205a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:49.303120 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdc763-e96a-4477-b80e-e4d0bec205a6 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:49.309087 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6993ca-3e13-45b7-97a2-57f2a679a84b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:49.309733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6993ca-3e13-45b7-97a2-57f2a679a84b service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:49.310017 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6993ca-3e13-45b7-97a2-57f2a679a84b service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:49.310294 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd6993ca-3e13-45b7-97a2-57f2a679a84b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:49.318818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6993ca-3e13-45b7-97a2-57f2a679a84b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:49.320421 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd6993ca-3e13-45b7-97a2-57f2a679a84b service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:49.330919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1391/2790] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:46:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:46:53.668784 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e05b8-ebf8-4b05-929c-11716adffcc5 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:53.669767 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e05b8-ebf8-4b05-929c-11716adffcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:53.670317 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428e05b8-ebf8-4b05-929c-11716adffcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:53.692122 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-428e05b8-ebf8-4b05-929c-11716adffcc5 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:46:53.693498 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-428e05b8-ebf8-4b05-929c-11716adffcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:53.705192 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1400/2791] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 15 19:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:46:53.735307 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6993ca-3e13-45b7-97a2-57f2a679a84b service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:53.738033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-fd6993ca-3e13-45b7-97a2-57f2a679a84b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:53.759911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd6993ca-3e13-45b7-97a2-57f2a679a84b service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:53.767149 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f5315-5b17-4ab2-a81d-95ae43044b37 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:53.768224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f5315-5b17-4ab2-a81d-95ae43044b37 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:53.768766 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f5315-5b17-4ab2-a81d-95ae43044b37 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:53.769361 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261f5315-5b17-4ab2-a81d-95ae43044b37 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:53.781996 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f5315-5b17-4ab2-a81d-95ae43044b37 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:53.783953 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261f5315-5b17-4ab2-a81d-95ae43044b37 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:53.795967 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1392/2792] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:46:55.236213 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e05b8-ebf8-4b05-929c-11716adffcc5 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:55.237926 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-428e05b8-ebf8-4b05-929c-11716adffcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:55.251511 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428e05b8-ebf8-4b05-929c-11716adffcc5 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:55.256482 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57c117f-38ad-466e-8874-385bfbb3fcee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:55.257353 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c117f-38ad-466e-8874-385bfbb3fcee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:55.257631 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c117f-38ad-466e-8874-385bfbb3fcee admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:55.257912 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57c117f-38ad-466e-8874-385bfbb3fcee admin admin] PATH_INFO: `/v3/users/5503d249dd3a448fb94b9b3aed87de7a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:55.259135 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c117f-38ad-466e-8874-385bfbb3fcee admin admin] RBAC: Authorizing `identity:delete_user(user_id=5503d249dd3a448fb94b9b3aed87de7a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:55.261796 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57c117f-38ad-466e-8874-385bfbb3fcee admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:55.443196 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c57c117f-38ad-466e-8874-385bfbb3fcee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5503d249dd3a448fb94b9b3aed87de7a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:55.455965 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c57c117f-38ad-466e-8874-385bfbb3fcee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5503d249dd3a448fb94b9b3aed87de7a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:55.456680 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c57c117f-38ad-466e-8874-385bfbb3fcee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5503d249dd3a448fb94b9b3aed87de7a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:55.457280 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c57c117f-38ad-466e-8874-385bfbb3fcee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5503d249dd3a448fb94b9b3aed87de7a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:55.465562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-c57c117f-38ad-466e-8874-385bfbb3fcee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5503d249dd3a448fb94b9b3aed87de7a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:55.549527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1401/2793] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:46:55 2022] DELETE /identity/v3/users/5503d249dd3a448fb94b9b3aed87de7a => generated 0 bytes in 314 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:46:55.807395 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f5315-5b17-4ab2-a81d-95ae43044b37 service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:55.821009 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261f5315-5b17-4ab2-a81d-95ae43044b37 service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:55.879502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370657b0-634f-40bb-8fa5-571dd16b6d03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:55.880363 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370657b0-634f-40bb-8fa5-571dd16b6d03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:55.880647 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370657b0-634f-40bb-8fa5-571dd16b6d03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:55.880919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370657b0-634f-40bb-8fa5-571dd16b6d03 admin admin] PATH_INFO: `/v3/projects/e9a7d6626a134407b0928aac985d9aa0` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:55.882118 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370657b0-634f-40bb-8fa5-571dd16b6d03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9a7d6626a134407b0928aac985d9aa0)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:55.884049 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370657b0-634f-40bb-8fa5-571dd16b6d03 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:56.041802 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-370657b0-634f-40bb-8fa5-571dd16b6d03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9a7d6626a134407b0928aac985d9aa0', 'request_id': 'req-370657b0-634f-40bb-8fa5-571dd16b6d03'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:56.046108 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:46:56.154616 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-370657b0-634f-40bb-8fa5-571dd16b6d03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9a7d6626a134407b0928aac985d9aa0', 'request_id': 'req-370657b0-634f-40bb-8fa5-571dd16b6d03'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:56.161703 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-370657b0-634f-40bb-8fa5-571dd16b6d03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9a7d6626a134407b0928aac985d9aa0', 'request_id': 'req-370657b0-634f-40bb-8fa5-571dd16b6d03'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:56.173293 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-370657b0-634f-40bb-8fa5-571dd16b6d03 admin admin] The token cache is being invalidate because project e9a7d6626a134407b0928aac985d9aa0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:46:56.173583 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-370657b0-634f-40bb-8fa5-571dd16b6d03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:56.174235 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-370657b0-634f-40bb-8fa5-571dd16b6d03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:46:56.175857 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1393/2794] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:46:55 2022] DELETE /identity/v3/projects/e9a7d6626a134407b0928aac985d9aa0 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:46:56.180903 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2909e-5ff2-4db8-9bdc-e194e9d9469e None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:56.181187 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2909e-5ff2-4db8-9bdc-e194e9d9469e None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:56.181460 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c2909e-5ff2-4db8-9bdc-e194e9d9469e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:56.201475 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-d1c2909e-5ff2-4db8-9bdc-e194e9d9469e None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:46:56.202693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-d1c2909e-5ff2-4db8-9bdc-e194e9d9469e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:56.264487 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1402/2795] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:46:56.272813 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f61a-8816-4c95-b108-3694b3e5c323 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:56.273273 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f61a-8816-4c95-b108-3694b3e5c323 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:56.273561 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d053f61a-8816-4c95-b108-3694b3e5c323 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:56.293287 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-d053f61a-8816-4c95-b108-3694b3e5c323 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:46:56.294206 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d053f61a-8816-4c95-b108-3694b3e5c323 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:56.302630 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1394/2796] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:46:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:46:56.307013 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2909e-5ff2-4db8-9bdc-e194e9d9469e None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:56.317821 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c2909e-5ff2-4db8-9bdc-e194e9d9469e None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:56.322694 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c1988-b7cc-4875-a292-73c45e249fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:56.323443 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c1988-b7cc-4875-a292-73c45e249fab admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:56.323837 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c1988-b7cc-4875-a292-73c45e249fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:56.324165 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d61c1988-b7cc-4875-a292-73c45e249fab admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:56.324964 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c1988-b7cc-4875-a292-73c45e249fab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:46:56.325219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c1988-b7cc-4875-a292-73c45e249fab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:56.326855 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d61c1988-b7cc-4875-a292-73c45e249fab admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:56.340442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1403/2797] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:46:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:46:56.344791 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f61a-8816-4c95-b108-3694b3e5c323 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:56.356837 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d053f61a-8816-4c95-b108-3694b3e5c323 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:56.361684 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034b336-d7e6-4be0-9be1-c3676538549e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:56.362374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034b336-d7e6-4be0-9be1-c3676538549e admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:56.362656 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034b336-d7e6-4be0-9be1-c3676538549e admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:56.362958 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f034b336-d7e6-4be0-9be1-c3676538549e admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:56.363655 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034b336-d7e6-4be0-9be1-c3676538549e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:56.365697 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f034b336-d7e6-4be0-9be1-c3676538549e admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:56.463033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1395/2798] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:46:56 2022] POST /identity/v3/projects => generated 375 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:46:56.464847 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c1988-b7cc-4875-a292-73c45e249fab admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:56.475579 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d61c1988-b7cc-4875-a292-73c45e249fab admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:56.520380 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:46:56.533610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213542c-9b4d-4f01-8b5b-ff3c233c6bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:56.534276 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213542c-9b4d-4f01-8b5b-ff3c233c6bd1 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:56.534553 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213542c-9b4d-4f01-8b5b-ff3c233c6bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:56.534857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8213542c-9b4d-4f01-8b5b-ff3c233c6bd1 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:56.535588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213542c-9b4d-4f01-8b5b-ff3c233c6bd1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:56.537586 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8213542c-9b4d-4f01-8b5b-ff3c233c6bd1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:56.680504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1404/2799] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:46:56 2022] POST /identity/v3/users => generated 288 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:46:56.684788 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034b336-d7e6-4be0-9be1-c3676538549e admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:56.695140 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f034b336-d7e6-4be0-9be1-c3676538549e admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:56.700318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64290806-8bd0-4512-88a8-f9758d3b18d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:56.700962 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64290806-8bd0-4512-88a8-f9758d3b18d8 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:56.701244 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64290806-8bd0-4512-88a8-f9758d3b18d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:56.701518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64290806-8bd0-4512-88a8-f9758d3b18d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:56.702232 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64290806-8bd0-4512-88a8-f9758d3b18d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:56.703848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64290806-8bd0-4512-88a8-f9758d3b18d8 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:56.714625 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1396/2800] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:46:56.718528 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213542c-9b4d-4f01-8b5b-ff3c233c6bd1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:56.732534 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8213542c-9b4d-4f01-8b5b-ff3c233c6bd1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:56.738978 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b89271-e7ae-4633-8f12-1ed827cbb49f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:56.739658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b89271-e7ae-4633-8f12-1ed827cbb49f admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:56.740000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b89271-e7ae-4633-8f12-1ed827cbb49f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:56.740341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b89271-e7ae-4633-8f12-1ed827cbb49f admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:56.741150 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b89271-e7ae-4633-8f12-1ed827cbb49f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:56.743100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b89271-e7ae-4633-8f12-1ed827cbb49f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:56.757016 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1405/2801] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:46:56 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:46:56.761499 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64290806-8bd0-4512-88a8-f9758d3b18d8 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:56.771776 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64290806-8bd0-4512-88a8-f9758d3b18d8 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:56.776939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58338c12-330b-4f62-a010-a1e240ef586b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:56.777843 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58338c12-330b-4f62-a010-a1e240ef586b admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:56.778127 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58338c12-330b-4f62-a010-a1e240ef586b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:56.778410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58338c12-330b-4f62-a010-a1e240ef586b admin admin] PATH_INFO: `/v3/projects/75bc0233abcf4f0ebd4e187bb30f1ef2/users/6f9d8dcfd9a94087b50d5f601662802a/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:56.794562 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58338c12-330b-4f62-a010-a1e240ef586b admin admin] RBAC: Authorizing `identity:create_grant(project_id=75bc0233abcf4f0ebd4e187bb30f1ef2, user_id=6f9d8dcfd9a94087b50d5f601662802a, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:56.797264 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58338c12-330b-4f62-a010-a1e240ef586b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:56.887742 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1397/2802] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:46:56 2022] PUT /identity/v3/projects/75bc0233abcf4f0ebd4e187bb30f1ef2/users/6f9d8dcfd9a94087b50d5f601662802a/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:46:56.898007 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2e121-3d18-4620-9964-5291d3eac466 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:56.898323 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2e121-3d18-4620-9964-5291d3eac466 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:56.898598 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f2e121-3d18-4620-9964-5291d3eac466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:56.925367 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a5f2e121-3d18-4620-9964-5291d3eac466 None None] MFA Rules not processed for user `6f9d8dcfd9a94087b50d5f601662802a`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:46:56.926566 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a5f2e121-3d18-4620-9964-5291d3eac466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:56.993295 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1406/2803] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:46:56 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:46:56.997898 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58338c12-330b-4f62-a010-a1e240ef586b admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:57.060624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58338c12-330b-4f62-a010-a1e240ef586b admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:57.065919 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3aed4f1-c3f5-4e8e-9106-f2c197a34866 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:57.066574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aed4f1-c3f5-4e8e-9106-f2c197a34866 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:57.066886 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aed4f1-c3f5-4e8e-9106-f2c197a34866 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:57.067167 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3aed4f1-c3f5-4e8e-9106-f2c197a34866 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:57.068060 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aed4f1-c3f5-4e8e-9106-f2c197a34866 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:57.069966 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3aed4f1-c3f5-4e8e-9106-f2c197a34866 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:57.185230 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1398/2804] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:46:56 2022] POST /identity/v3/projects => generated 375 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:46:57.189302 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2e121-3d18-4620-9964-5291d3eac466 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:57.200504 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f2e121-3d18-4620-9964-5291d3eac466 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:57.225517 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b622ba8-b1aa-41c3-a622-c89cf54adbcb None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:57.225864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b622ba8-b1aa-41c3-a622-c89cf54adbcb None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:57.226077 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b622ba8-b1aa-41c3-a622-c89cf54adbcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:57.250711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-3b622ba8-b1aa-41c3-a622-c89cf54adbcb None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:46:57.250711 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3b622ba8-b1aa-41c3-a622-c89cf54adbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:57.267416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33685e40-f596-4714-9b77-6a3de738bc63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:57.268094 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33685e40-f596-4714-9b77-6a3de738bc63 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:57.270088 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33685e40-f596-4714-9b77-6a3de738bc63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:57.270088 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33685e40-f596-4714-9b77-6a3de738bc63 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:57.270088 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33685e40-f596-4714-9b77-6a3de738bc63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:57.271356 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33685e40-f596-4714-9b77-6a3de738bc63 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:57.301845 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=95,keystone:DELETE=2,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:46:57.313801 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1399/2805] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 15 19:46:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:46:57.328172 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b622ba8-b1aa-41c3-a622-c89cf54adbcb None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:57.329495 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-3b622ba8-b1aa-41c3-a622-c89cf54adbcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:57.356159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1407/2806] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:46:57 2022] POST /identity/v3/users => generated 294 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:46:57.360161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33685e40-f596-4714-9b77-6a3de738bc63 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:57.370036 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33685e40-f596-4714-9b77-6a3de738bc63 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:57.375107 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81898ecc-9898-4d65-993b-8168b50ad350 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:57.375765 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81898ecc-9898-4d65-993b-8168b50ad350 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:57.376049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81898ecc-9898-4d65-993b-8168b50ad350 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:57.376397 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81898ecc-9898-4d65-993b-8168b50ad350 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:57.377061 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81898ecc-9898-4d65-993b-8168b50ad350 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:57.378712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81898ecc-9898-4d65-993b-8168b50ad350 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:57.389622 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1408/2807] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:46:57.393818 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81898ecc-9898-4d65-993b-8168b50ad350 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:57.404168 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81898ecc-9898-4d65-993b-8168b50ad350 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:57.406472 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b622ba8-b1aa-41c3-a622-c89cf54adbcb None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:57.409047 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3d562-e096-40d0-90e5-a560177b9291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:57.410149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3d562-e096-40d0-90e5-a560177b9291 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:57.410434 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3d562-e096-40d0-90e5-a560177b9291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:57.410709 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5b3d562-e096-40d0-90e5-a560177b9291 admin admin] PATH_INFO: `/v3/projects/c5dd9eac5d824f39a1b4054ee962a0ec/users/31748830d55b46e6a71e6bd04b22ec3d/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:57.412504 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfe091-52e5-4e8c-a747-16664b4d54e0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:57.413149 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfe091-52e5-4e8c-a747-16664b4d54e0 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:57.413428 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfe091-52e5-4e8c-a747-16664b4d54e0 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:57.413702 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfcfe091-52e5-4e8c-a747-16664b4d54e0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:57.423594 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfe091-52e5-4e8c-a747-16664b4d54e0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:57.425854 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfcfe091-52e5-4e8c-a747-16664b4d54e0 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:57.426915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3d562-e096-40d0-90e5-a560177b9291 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5dd9eac5d824f39a1b4054ee962a0ec, user_id=31748830d55b46e6a71e6bd04b22ec3d, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:57.429688 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5b3d562-e096-40d0-90e5-a560177b9291 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:57.436782 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1400/2808] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:46:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:46:57.499366 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1409/2809] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:46:57 2022] PUT /identity/v3/projects/c5dd9eac5d824f39a1b4054ee962a0ec/users/31748830d55b46e6a71e6bd04b22ec3d/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:46:57.513819 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfe091-52e5-4e8c-a747-16664b4d54e0 service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:57.523912 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfcfe091-52e5-4e8c-a747-16664b4d54e0 service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:57.583405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfcd553e-2e5e-42f3-8211-925aa5abc9b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:57.584075 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd553e-2e5e-42f3-8211-925aa5abc9b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:57.584359 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd553e-2e5e-42f3-8211-925aa5abc9b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:57.584634 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfcd553e-2e5e-42f3-8211-925aa5abc9b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:57.585412 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd553e-2e5e-42f3-8211-925aa5abc9b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:57.587071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfcd553e-2e5e-42f3-8211-925aa5abc9b5 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:57.598968 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1401/2810] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:46:57.603154 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3d562-e096-40d0-90e5-a560177b9291 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:57.614676 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5b3d562-e096-40d0-90e5-a560177b9291 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:57.619575 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ff6ba-2172-428e-a737-33d984c7fcff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:57.620581 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ff6ba-2172-428e-a737-33d984c7fcff admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:57.620848 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ff6ba-2172-428e-a737-33d984c7fcff admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:57.621069 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-154ff6ba-2172-428e-a737-33d984c7fcff admin admin] PATH_INFO: `/v3/projects/c5dd9eac5d824f39a1b4054ee962a0ec/users/31748830d55b46e6a71e6bd04b22ec3d/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:57.623112 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ff6ba-2172-428e-a737-33d984c7fcff admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5dd9eac5d824f39a1b4054ee962a0ec, user_id=31748830d55b46e6a71e6bd04b22ec3d, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:57.626103 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-154ff6ba-2172-428e-a737-33d984c7fcff admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:57.629414 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:46:57.637899 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1410/2811] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:46:57 2022] PUT /identity/v3/projects/c5dd9eac5d824f39a1b4054ee962a0ec/users/31748830d55b46e6a71e6bd04b22ec3d/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:46:57.649127 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03ccd4-5565-4f00-b6b9-879f993a5f91 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:57.649479 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03ccd4-5565-4f00-b6b9-879f993a5f91 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:57.649867 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f03ccd4-5565-4f00-b6b9-879f993a5f91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:57.677320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-7f03ccd4-5565-4f00-b6b9-879f993a5f91 None None] MFA Rules not processed for user `31748830d55b46e6a71e6bd04b22ec3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:46:57.682332 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-7f03ccd4-5565-4f00-b6b9-879f993a5f91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:57.746765 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1402/2812] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:46:57 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:46:57.758179 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ff6ba-2172-428e-a737-33d984c7fcff admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:46:57.759929 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-154ff6ba-2172-428e-a737-33d984c7fcff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:46:57.822524 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-154ff6ba-2172-428e-a737-33d984c7fcff admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:46:57.827251 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce12cf7-0769-433e-aa1d-d052cda838f3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:46:57.827933 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce12cf7-0769-433e-aa1d-d052cda838f3 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:46:57.828219 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce12cf7-0769-433e-aa1d-d052cda838f3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:46:57.828614 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce12cf7-0769-433e-aa1d-d052cda838f3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:46:57.887740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce12cf7-0769-433e-aa1d-d052cda838f3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:46:57.889391 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce12cf7-0769-433e-aa1d-d052cda838f3 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:46:57.899365 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1411/2813] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:46:57 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:01.034990 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa64369-db47-4040-964c-27ef94548b8f None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:01.035502 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa64369-db47-4040-964c-27ef94548b8f None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:01.035617 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa64369-db47-4040-964c-27ef94548b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:01.041916 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:01.054845 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-4aa64369-db47-4040-964c-27ef94548b8f None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:01.056144 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4aa64369-db47-4040-964c-27ef94548b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:01.117075 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1403/2814] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 15 19:47:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:01.132976 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce12cf7-0769-433e-aa1d-d052cda838f3 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:01.134407 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1ce12cf7-0769-433e-aa1d-d052cda838f3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:01.207404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce12cf7-0769-433e-aa1d-d052cda838f3 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:01.212892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8b260c-0771-4e03-a6b5-bfa1bae66df2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:01.213556 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b260c-0771-4e03-a6b5-bfa1bae66df2 service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:01.213840 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b260c-0771-4e03-a6b5-bfa1bae66df2 service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:01.214116 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8b260c-0771-4e03-a6b5-bfa1bae66df2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:01.222569 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b260c-0771-4e03-a6b5-bfa1bae66df2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:01.224180 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8b260c-0771-4e03-a6b5-bfa1bae66df2 service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:01.234357 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1412/2815] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:01.399028 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa64369-db47-4040-964c-27ef94548b8f None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:01.400421 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4aa64369-db47-4040-964c-27ef94548b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:01.412445 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa64369-db47-4040-964c-27ef94548b8f None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:01.416629 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd22bb-1e8c-4bdd-89b1-a65126f4a555 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:01.417271 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd22bb-1e8c-4bdd-89b1-a65126f4a555 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:01.418039 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd22bb-1e8c-4bdd-89b1-a65126f4a555 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:01.418358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96fd22bb-1e8c-4bdd-89b1-a65126f4a555 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:01.427828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd22bb-1e8c-4bdd-89b1-a65126f4a555 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:01.429248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96fd22bb-1e8c-4bdd-89b1-a65126f4a555 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:01.439895 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1404/2816] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:04.272333 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd38fff-bbbc-42a2-b739-ad6f51ced38b None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:04.272895 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd38fff-bbbc-42a2-b739-ad6f51ced38b None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:04.272895 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd38fff-bbbc-42a2-b739-ad6f51ced38b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:04.292352 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-cfd38fff-bbbc-42a2-b739-ad6f51ced38b None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:04.293639 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-cfd38fff-bbbc-42a2-b739-ad6f51ced38b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:04.306097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1413/2817] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 15 19:47:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:04.323222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd22bb-1e8c-4bdd-89b1-a65126f4a555 service cinder] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:04.336905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96fd22bb-1e8c-4bdd-89b1-a65126f4a555 service cinder] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:04.343301 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e169d-5fae-4a84-81e1-80429de3f7b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:04.343938 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e169d-5fae-4a84-81e1-80429de3f7b8 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:04.344224 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e169d-5fae-4a84-81e1-80429de3f7b8 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:04.344500 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674e169d-5fae-4a84-81e1-80429de3f7b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:04.353062 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e169d-5fae-4a84-81e1-80429de3f7b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:04.354643 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674e169d-5fae-4a84-81e1-80429de3f7b8 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:04.364793 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1405/2818] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:07.549014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c5ee9-7ef0-406c-a834-2fb28ccfc9ad None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:07.549503 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c5ee9-7ef0-406c-a834-2fb28ccfc9ad None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:07.549774 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3c5ee9-7ef0-406c-a834-2fb28ccfc9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:07.569922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-1b3c5ee9-7ef0-406c-a834-2fb28ccfc9ad None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:07.571285 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-1b3c5ee9-7ef0-406c-a834-2fb28ccfc9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:07.583825 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1414/2819] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 15 19:47:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:07.598979 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e169d-5fae-4a84-81e1-80429de3f7b8 service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:07.610968 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674e169d-5fae-4a84-81e1-80429de3f7b8 service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:07.616905 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1d097-4c34-4c84-a0a0-8401990b75ac service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:07.622426 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1d097-4c34-4c84-a0a0-8401990b75ac service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:07.622426 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1d097-4c34-4c84-a0a0-8401990b75ac service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:07.622426 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b1d097-4c34-4c84-a0a0-8401990b75ac service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:07.628708 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1d097-4c34-4c84-a0a0-8401990b75ac service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:07.630430 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b1d097-4c34-4c84-a0a0-8401990b75ac service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:07.641216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1406/2820] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:10.676033 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c5ee9-7ef0-406c-a834-2fb28ccfc9ad None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:10.686729 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3c5ee9-7ef0-406c-a834-2fb28ccfc9ad None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:10.695950 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23357324-52eb-45c1-9988-9ee4dddfc6a5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:10.695950 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23357324-52eb-45c1-9988-9ee4dddfc6a5 service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:10.695950 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23357324-52eb-45c1-9988-9ee4dddfc6a5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:10.695950 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23357324-52eb-45c1-9988-9ee4dddfc6a5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:10.696342 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-23357324-52eb-45c1-9988-9ee4dddfc6a5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:10.707846 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23357324-52eb-45c1-9988-9ee4dddfc6a5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:10.709275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23357324-52eb-45c1-9988-9ee4dddfc6a5 service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:10.720575 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1415/2821] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:10 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:13.666576 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1d097-4c34-4c84-a0a0-8401990b75ac service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:13.668128 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-82b1d097-4c34-4c84-a0a0-8401990b75ac service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:13.726864 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b1d097-4c34-4c84-a0a0-8401990b75ac service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:13.730606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eeffff5-178b-4371-9621-9de301e2dd92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:13.731321 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeffff5-178b-4371-9621-9de301e2dd92 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:13.731604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeffff5-178b-4371-9621-9de301e2dd92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:13.732076 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eeffff5-178b-4371-9621-9de301e2dd92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:13.734234 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-8eeffff5-178b-4371-9621-9de301e2dd92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:13.749331 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeffff5-178b-4371-9621-9de301e2dd92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:13.750778 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eeffff5-178b-4371-9621-9de301e2dd92 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:13.762383 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1407/2822] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:13 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:16.366626 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23357324-52eb-45c1-9988-9ee4dddfc6a5 service cinder] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:16.377990 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23357324-52eb-45c1-9988-9ee4dddfc6a5 service cinder] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:16.382510 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d798c-6cbc-4a89-a10a-9a7e87249dc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:16.389808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d798c-6cbc-4a89-a10a-9a7e87249dc9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:16.389808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d798c-6cbc-4a89-a10a-9a7e87249dc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:16.389808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5d798c-6cbc-4a89-a10a-9a7e87249dc9 admin admin] PATH_INFO: `/v3/users/6f9d8dcfd9a94087b50d5f601662802a` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:16.389808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d798c-6cbc-4a89-a10a-9a7e87249dc9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f9d8dcfd9a94087b50d5f601662802a)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:16.389808 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5d798c-6cbc-4a89-a10a-9a7e87249dc9 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:16.390452 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:16.574224 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2c5d798c-6cbc-4a89-a10a-9a7e87249dc9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f9d8dcfd9a94087b50d5f601662802a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:16.586972 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2c5d798c-6cbc-4a89-a10a-9a7e87249dc9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f9d8dcfd9a94087b50d5f601662802a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:16.587738 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2c5d798c-6cbc-4a89-a10a-9a7e87249dc9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f9d8dcfd9a94087b50d5f601662802a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:16.588360 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2c5d798c-6cbc-4a89-a10a-9a7e87249dc9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f9d8dcfd9a94087b50d5f601662802a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:16.595681 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-2c5d798c-6cbc-4a89-a10a-9a7e87249dc9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f9d8dcfd9a94087b50d5f601662802a'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:16.674137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1416/2823] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:47:16 2022] DELETE /identity/v3/users/6f9d8dcfd9a94087b50d5f601662802a => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:16.678950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c607a9f-1dc4-4c6d-b1eb-75da5fa2dd18 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:16.679452 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c607a9f-1dc4-4c6d-b1eb-75da5fa2dd18 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:16.679562 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c607a9f-1dc4-4c6d-b1eb-75da5fa2dd18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:16.697732 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-5c607a9f-1dc4-4c6d-b1eb-75da5fa2dd18 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:16.698957 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5c607a9f-1dc4-4c6d-b1eb-75da5fa2dd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:16.761209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1408/2824] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:47:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:16.771015 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d798c-6cbc-4a89-a10a-9a7e87249dc9 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:16.772409 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-2c5d798c-6cbc-4a89-a10a-9a7e87249dc9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:16.834249 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5d798c-6cbc-4a89-a10a-9a7e87249dc9 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:16.837878 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb6c28-a83d-43e9-9cbd-72fabcc726f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:16.838515 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb6c28-a83d-43e9-9cbd-72fabcc726f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:16.838821 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb6c28-a83d-43e9-9cbd-72fabcc726f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:16.839127 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fb6c28-a83d-43e9-9cbd-72fabcc726f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:16.848732 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb6c28-a83d-43e9-9cbd-72fabcc726f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:16.850109 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fb6c28-a83d-43e9-9cbd-72fabcc726f7 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:16.860634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1417/2825] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:47:17.288503 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c607a9f-1dc4-4c6d-b1eb-75da5fa2dd18 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:17.291115 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5c607a9f-1dc4-4c6d-b1eb-75da5fa2dd18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:17.317441 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c607a9f-1dc4-4c6d-b1eb-75da5fa2dd18 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:17.325456 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92055cb-b821-444f-bac8-24de401464c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:17.328415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92055cb-b821-444f-bac8-24de401464c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:17.329030 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92055cb-b821-444f-bac8-24de401464c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:17.329610 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92055cb-b821-444f-bac8-24de401464c6 admin admin] PATH_INFO: `/v3/projects/75bc0233abcf4f0ebd4e187bb30f1ef2` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:17.332850 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92055cb-b821-444f-bac8-24de401464c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=75bc0233abcf4f0ebd4e187bb30f1ef2)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:17.337627 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92055cb-b821-444f-bac8-24de401464c6 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:17.340551 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=100 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:17.455021 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a92055cb-b821-444f-bac8-24de401464c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '75bc0233abcf4f0ebd4e187bb30f1ef2', 'request_id': 'req-a92055cb-b821-444f-bac8-24de401464c6'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:17.509066 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a92055cb-b821-444f-bac8-24de401464c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '75bc0233abcf4f0ebd4e187bb30f1ef2', 'request_id': 'req-a92055cb-b821-444f-bac8-24de401464c6'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:17.516679 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a92055cb-b821-444f-bac8-24de401464c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '75bc0233abcf4f0ebd4e187bb30f1ef2', 'request_id': 'req-a92055cb-b821-444f-bac8-24de401464c6'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:17.527269 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a92055cb-b821-444f-bac8-24de401464c6 admin admin] The token cache is being invalidate because project 75bc0233abcf4f0ebd4e187bb30f1ef2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:47:17.527557 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a92055cb-b821-444f-bac8-24de401464c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:17.528974 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-a92055cb-b821-444f-bac8-24de401464c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:17.530648 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1409/2826] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:47:17 2022] DELETE /identity/v3/projects/75bc0233abcf4f0ebd4e187bb30f1ef2 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:47:17.534725 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb6c28-a83d-43e9-9cbd-72fabcc726f7 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:17.545574 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fb6c28-a83d-43e9-9cbd-72fabcc726f7 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:17.609731 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d48e190-a7a0-4778-a82a-86ed3175634b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:17.610607 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48e190-a7a0-4778-a82a-86ed3175634b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:17.610922 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48e190-a7a0-4778-a82a-86ed3175634b admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:17.612740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d48e190-a7a0-4778-a82a-86ed3175634b admin admin] PATH_INFO: `/v3/users/31748830d55b46e6a71e6bd04b22ec3d` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:17.612740 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48e190-a7a0-4778-a82a-86ed3175634b admin admin] RBAC: Authorizing `identity:delete_user(user_id=31748830d55b46e6a71e6bd04b22ec3d)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:17.614356 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d48e190-a7a0-4778-a82a-86ed3175634b admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:17.721503 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:17.860950 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3d48e190-a7a0-4778-a82a-86ed3175634b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '31748830d55b46e6a71e6bd04b22ec3d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:17.873594 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3d48e190-a7a0-4778-a82a-86ed3175634b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '31748830d55b46e6a71e6bd04b22ec3d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:17.874339 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3d48e190-a7a0-4778-a82a-86ed3175634b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '31748830d55b46e6a71e6bd04b22ec3d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:17.874983 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3d48e190-a7a0-4778-a82a-86ed3175634b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '31748830d55b46e6a71e6bd04b22ec3d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:17.882014 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-3d48e190-a7a0-4778-a82a-86ed3175634b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '31748830d55b46e6a71e6bd04b22ec3d'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:17.995590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1418/2827] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:47:17 2022] DELETE /identity/v3/users/31748830d55b46e6a71e6bd04b22ec3d => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:18.471053 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92055cb-b821-444f-bac8-24de401464c6 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:18.473921 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a92055cb-b821-444f-bac8-24de401464c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:18.491387 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92055cb-b821-444f-bac8-24de401464c6 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:18.555374 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be24c7-7976-4412-968d-9d62180449a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:18.556247 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be24c7-7976-4412-968d-9d62180449a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:18.556447 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be24c7-7976-4412-968d-9d62180449a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:18.556728 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be24c7-7976-4412-968d-9d62180449a2 admin admin] PATH_INFO: `/v3/projects/c5dd9eac5d824f39a1b4054ee962a0ec` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:18.557946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be24c7-7976-4412-968d-9d62180449a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5dd9eac5d824f39a1b4054ee962a0ec)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:18.560524 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be24c7-7976-4412-968d-9d62180449a2 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:18.657924 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-48be24c7-7976-4412-968d-9d62180449a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5dd9eac5d824f39a1b4054ee962a0ec', 'request_id': 'req-48be24c7-7976-4412-968d-9d62180449a2'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:18.720309 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-48be24c7-7976-4412-968d-9d62180449a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5dd9eac5d824f39a1b4054ee962a0ec', 'request_id': 'req-48be24c7-7976-4412-968d-9d62180449a2'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:18.727571 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-48be24c7-7976-4412-968d-9d62180449a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5dd9eac5d824f39a1b4054ee962a0ec', 'request_id': 'req-48be24c7-7976-4412-968d-9d62180449a2'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:18.739146 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-48be24c7-7976-4412-968d-9d62180449a2 admin admin] The token cache is being invalidate because project c5dd9eac5d824f39a1b4054ee962a0ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:47:18.739433 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-48be24c7-7976-4412-968d-9d62180449a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:18.740090 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-48be24c7-7976-4412-968d-9d62180449a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:18.741637 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1410/2828] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:47:18 2022] DELETE /identity/v3/projects/c5dd9eac5d824f39a1b4054ee962a0ec => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:18.747892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628057d5-f6df-4333-a6b1-747127e248fb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:18.747892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628057d5-f6df-4333-a6b1-747127e248fb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:18.747892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628057d5-f6df-4333-a6b1-747127e248fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:18.766040 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-628057d5-f6df-4333-a6b1-747127e248fb None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:18.767290 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-628057d5-f6df-4333-a6b1-747127e248fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:18.827890 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1419/2829] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:18.835763 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99852b92-b6c1-4631-9aa0-af09477dfeb2 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:18.836798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99852b92-b6c1-4631-9aa0-af09477dfeb2 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:18.836798 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99852b92-b6c1-4631-9aa0-af09477dfeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:18.856613 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-99852b92-b6c1-4631-9aa0-af09477dfeb2 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:18.857969 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-99852b92-b6c1-4631-9aa0-af09477dfeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:18.865926 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1411/2830] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:47:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:18.870518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628057d5-f6df-4333-a6b1-747127e248fb None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:18.881123 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-628057d5-f6df-4333-a6b1-747127e248fb None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:18.886026 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb4bd7-5111-41f6-ad57-b804d6d638d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:18.886678 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb4bd7-5111-41f6-ad57-b804d6d638d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:18.886997 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb4bd7-5111-41f6-ad57-b804d6d638d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:18.892086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ecb4bd7-5111-41f6-ad57-b804d6d638d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:18.892086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb4bd7-5111-41f6-ad57-b804d6d638d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80362) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:47:18.892086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb4bd7-5111-41f6-ad57-b804d6d638d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:18.892086 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ecb4bd7-5111-41f6-ad57-b804d6d638d2 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:18.901855 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1420/2831] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:47:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:47:18.906911 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99852b92-b6c1-4631-9aa0-af09477dfeb2 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:18.917846 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99852b92-b6c1-4631-9aa0-af09477dfeb2 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:18.923183 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd9e46-d8c7-460d-84cf-7af529f05c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:18.923825 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd9e46-d8c7-460d-84cf-7af529f05c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:18.924165 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd9e46-d8c7-460d-84cf-7af529f05c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:18.924454 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bd9e46-d8c7-460d-84cf-7af529f05c26 admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:18.925151 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd9e46-d8c7-460d-84cf-7af529f05c26 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:18.927136 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bd9e46-d8c7-460d-84cf-7af529f05c26 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:18.938132 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:19.081873 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1412/2832] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:47:18 2022] POST /identity/v3/projects => generated 387 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:47:19.086149 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb4bd7-5111-41f6-ad57-b804d6d638d2 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:19.096964 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ecb4bd7-5111-41f6-ad57-b804d6d638d2 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:19.156959 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2879de-7c6b-4db6-ab1b-2354001d21c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:19.157622 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2879de-7c6b-4db6-ab1b-2354001d21c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:19.157908 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2879de-7c6b-4db6-ab1b-2354001d21c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:19.158185 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2879de-7c6b-4db6-ab1b-2354001d21c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:19.158915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2879de-7c6b-4db6-ab1b-2354001d21c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:19.160834 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2879de-7c6b-4db6-ab1b-2354001d21c3 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:19.217885 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1421/2833] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:47:19 2022] POST /identity/v3/users => generated 294 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:47:19.222085 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd9e46-d8c7-460d-84cf-7af529f05c26 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:19.233819 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bd9e46-d8c7-460d-84cf-7af529f05c26 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:19.238565 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923771f-1cac-4c7d-9235-921b1b2983da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:19.239248 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923771f-1cac-4c7d-9235-921b1b2983da admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:19.239531 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923771f-1cac-4c7d-9235-921b1b2983da admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:19.239805 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c923771f-1cac-4c7d-9235-921b1b2983da admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:19.240528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923771f-1cac-4c7d-9235-921b1b2983da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:19.242113 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c923771f-1cac-4c7d-9235-921b1b2983da admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:19.253682 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1413/2834] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:47:19.257952 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2879de-7c6b-4db6-ab1b-2354001d21c3 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:19.268736 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2879de-7c6b-4db6-ab1b-2354001d21c3 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:19.273401 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5c70e3-d558-4dfe-8159-00af31e11524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:19.274057 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c70e3-d558-4dfe-8159-00af31e11524 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:19.274341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c70e3-d558-4dfe-8159-00af31e11524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:19.274611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5c70e3-d558-4dfe-8159-00af31e11524 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:19.275404 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c70e3-d558-4dfe-8159-00af31e11524 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:19.277025 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5c70e3-d558-4dfe-8159-00af31e11524 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:19.287794 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1422/2835] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:47:19.292032 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923771f-1cac-4c7d-9235-921b1b2983da admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:19.302266 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c923771f-1cac-4c7d-9235-921b1b2983da admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:19.306840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872a5a6-7e65-4d1f-9020-785f8a2a3a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:19.307744 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872a5a6-7e65-4d1f-9020-785f8a2a3a0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:19.308026 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872a5a6-7e65-4d1f-9020-785f8a2a3a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:19.308302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7872a5a6-7e65-4d1f-9020-785f8a2a3a0b admin admin] PATH_INFO: `/v3/projects/0a46d56774734e298e6dcd493393ce79/users/acb1ffa3bbaf48948790bef39fa4a430/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:19.322709 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872a5a6-7e65-4d1f-9020-785f8a2a3a0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a46d56774734e298e6dcd493393ce79, user_id=acb1ffa3bbaf48948790bef39fa4a430, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:19.325893 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7872a5a6-7e65-4d1f-9020-785f8a2a3a0b admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:19.389459 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1414/2836] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:47:19 2022] PUT /identity/v3/projects/0a46d56774734e298e6dcd493393ce79/users/acb1ffa3bbaf48948790bef39fa4a430/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:19.399730 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cee25-2f02-4c6d-9497-71d075e7facc None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:19.400020 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cee25-2f02-4c6d-9497-71d075e7facc None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:19.400301 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769cee25-2f02-4c6d-9497-71d075e7facc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:19.420303 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:19.428888 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-769cee25-2f02-4c6d-9497-71d075e7facc None None] MFA Rules not processed for user `acb1ffa3bbaf48948790bef39fa4a430`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:19.430114 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-769cee25-2f02-4c6d-9497-71d075e7facc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:19.498287 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1423/2837] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:47:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:19.502801 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872a5a6-7e65-4d1f-9020-785f8a2a3a0b admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:19.564899 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7872a5a6-7e65-4d1f-9020-785f8a2a3a0b admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:19.569553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c5a8d-07e0-4fbb-b51e-e405afd16eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:19.570214 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c5a8d-07e0-4fbb-b51e-e405afd16eeb admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:19.570496 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c5a8d-07e0-4fbb-b51e-e405afd16eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:19.570820 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-766c5a8d-07e0-4fbb-b51e-e405afd16eeb admin admin] PATH_INFO: `/v3/projects` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:19.571510 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c5a8d-07e0-4fbb-b51e-e405afd16eeb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:19.573420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-766c5a8d-07e0-4fbb-b51e-e405afd16eeb admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:19.696550 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1415/2838] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:47:19 2022] POST /identity/v3/projects => generated 387 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:47:19.697532 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cee25-2f02-4c6d-9497-71d075e7facc None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:19.708723 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769cee25-2f02-4c6d-9497-71d075e7facc None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:19.765631 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0634d-764f-4dc3-bb70-efa1ed26f4dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:19.766316 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0634d-764f-4dc3-bb70-efa1ed26f4dd admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:19.766558 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0634d-764f-4dc3-bb70-efa1ed26f4dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:19.766892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad0634d-764f-4dc3-bb70-efa1ed26f4dd admin admin] PATH_INFO: `/v3/users` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:19.767582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0634d-764f-4dc3-bb70-efa1ed26f4dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:19.769507 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad0634d-764f-4dc3-bb70-efa1ed26f4dd admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:19.881469 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1424/2839] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:47:19 2022] POST /identity/v3/users => generated 300 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:47:19.885590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c5a8d-07e0-4fbb-b51e-e405afd16eeb admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:19.896815 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-766c5a8d-07e0-4fbb-b51e-e405afd16eeb admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:19.901738 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec989d6-9b6e-48df-a504-934d61800c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:19.902412 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec989d6-9b6e-48df-a504-934d61800c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:19.903486 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec989d6-9b6e-48df-a504-934d61800c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:19.903713 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec989d6-9b6e-48df-a504-934d61800c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:19.904489 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec989d6-9b6e-48df-a504-934d61800c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:19.906093 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ec989d6-9b6e-48df-a504-934d61800c10 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:19.917415 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1416/2840] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:47:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:47:19.928815 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0634d-764f-4dc3-bb70-efa1ed26f4dd admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:19.939782 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad0634d-764f-4dc3-bb70-efa1ed26f4dd admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:19.945060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7772ab-023c-4f3e-bc5b-b006515a48cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:19.945965 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7772ab-023c-4f3e-bc5b-b006515a48cc admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:19.946250 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7772ab-023c-4f3e-bc5b-b006515a48cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:19.946527 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7772ab-023c-4f3e-bc5b-b006515a48cc admin admin] PATH_INFO: `/v3/projects/c20c9beb7fce4bd489ef8e7dc5704dde/users/224b4a74527f47979753a1f2e3bad504/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:19.963530 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7772ab-023c-4f3e-bc5b-b006515a48cc admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20c9beb7fce4bd489ef8e7dc5704dde, user_id=224b4a74527f47979753a1f2e3bad504, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:19.966884 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f7772ab-023c-4f3e-bc5b-b006515a48cc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:20.057551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1425/2841] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:47:19 2022] PUT /identity/v3/projects/c20c9beb7fce4bd489ef8e7dc5704dde/users/224b4a74527f47979753a1f2e3bad504/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:20.061604 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec989d6-9b6e-48df-a504-934d61800c10 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:20.072655 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec989d6-9b6e-48df-a504-934d61800c10 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:20.156085 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd72ee05-4b29-4d4f-9ba2-296d6647d092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:20.156753 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72ee05-4b29-4d4f-9ba2-296d6647d092 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:20.157040 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72ee05-4b29-4d4f-9ba2-296d6647d092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:20.157316 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd72ee05-4b29-4d4f-9ba2-296d6647d092 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:20.158067 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72ee05-4b29-4d4f-9ba2-296d6647d092 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:20.159698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd72ee05-4b29-4d4f-9ba2-296d6647d092 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:20.169821 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1417/2842] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:47:20 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:47:20.174126 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7772ab-023c-4f3e-bc5b-b006515a48cc admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:20.184496 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7772ab-023c-4f3e-bc5b-b006515a48cc admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:20.189134 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b4a69-cb20-4770-8e2e-320806349781 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:20.190015 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b4a69-cb20-4770-8e2e-320806349781 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:20.190293 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b4a69-cb20-4770-8e2e-320806349781 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:20.190562 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31b4a69-cb20-4770-8e2e-320806349781 admin admin] PATH_INFO: `/v3/projects/c20c9beb7fce4bd489ef8e7dc5704dde/users/224b4a74527f47979753a1f2e3bad504/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:20.192582 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b4a69-cb20-4770-8e2e-320806349781 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20c9beb7fce4bd489ef8e7dc5704dde, user_id=224b4a74527f47979753a1f2e3bad504, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:20.195268 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31b4a69-cb20-4770-8e2e-320806349781 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:20.206624 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1426/2843] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:47:20 2022] PUT /identity/v3/projects/c20c9beb7fce4bd489ef8e7dc5704dde/users/224b4a74527f47979753a1f2e3bad504/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:20.218564 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b4e5d-8583-42ae-b91f-185c2f6cb56a None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:20.218889 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b4e5d-8583-42ae-b91f-185c2f6cb56a None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:20.219177 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047b4e5d-8583-42ae-b91f-185c2f6cb56a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:20.245836 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-047b4e5d-8583-42ae-b91f-185c2f6cb56a None None] MFA Rules not processed for user `224b4a74527f47979753a1f2e3bad504`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:20.247092 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-047b4e5d-8583-42ae-b91f-185c2f6cb56a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:20.260025 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:20.318946 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1418/2844] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:47:20 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:20.331325 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b4a69-cb20-4770-8e2e-320806349781 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:20.333467 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a31b4a69-cb20-4770-8e2e-320806349781 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:20.393039 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31b4a69-cb20-4770-8e2e-320806349781 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:20.396724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00e4895-d8ec-477b-b8b9-eab52359303d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:20.397359 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e4895-d8ec-477b-b8b9-eab52359303d service cinder] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:20.397642 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e4895-d8ec-477b-b8b9-eab52359303d service cinder] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:20.397915 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00e4895-d8ec-477b-b8b9-eab52359303d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:20.404352 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:20.408015 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e4895-d8ec-477b-b8b9-eab52359303d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:20.409388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00e4895-d8ec-477b-b8b9-eab52359303d service cinder] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:20.419184 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1427/2845] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:20 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:20.447439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b4e5d-8583-42ae-b91f-185c2f6cb56a None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:20.511592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047b4e5d-8583-42ae-b91f-185c2f6cb56a None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:20.516907 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbf5be-574c-47b6-b6c0-be0b483c2028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:20.517828 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbf5be-574c-47b6-b6c0-be0b483c2028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:20.518132 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbf5be-574c-47b6-b6c0-be0b483c2028 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:20.518410 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddbf5be-574c-47b6-b6c0-be0b483c2028 admin admin] PATH_INFO: `/v3/users/acb1ffa3bbaf48948790bef39fa4a430` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:20.519654 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbf5be-574c-47b6-b6c0-be0b483c2028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acb1ffa3bbaf48948790bef39fa4a430)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:20.521574 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddbf5be-574c-47b6-b6c0-be0b483c2028 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:20.727642 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-cddbf5be-574c-47b6-b6c0-be0b483c2028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acb1ffa3bbaf48948790bef39fa4a430'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:20.728225 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-cddbf5be-574c-47b6-b6c0-be0b483c2028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acb1ffa3bbaf48948790bef39fa4a430'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:20.799997 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-cddbf5be-574c-47b6-b6c0-be0b483c2028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acb1ffa3bbaf48948790bef39fa4a430'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:20.800606 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-cddbf5be-574c-47b6-b6c0-be0b483c2028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acb1ffa3bbaf48948790bef39fa4a430'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:20.814128 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-cddbf5be-574c-47b6-b6c0-be0b483c2028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acb1ffa3bbaf48948790bef39fa4a430'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:20.826437 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1419/2846] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:47:20 2022] DELETE /identity/v3/users/acb1ffa3bbaf48948790bef39fa4a430 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:20.831013 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055cd5c-32d2-4aea-a100-4301c68b6831 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:20.831520 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055cd5c-32d2-4aea-a100-4301c68b6831 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:20.831639 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9055cd5c-32d2-4aea-a100-4301c68b6831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:20.849316 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-9055cd5c-32d2-4aea-a100-4301c68b6831 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:20.850545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9055cd5c-32d2-4aea-a100-4301c68b6831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:20.910578 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1428/2847] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:47:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:20.921044 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbf5be-574c-47b6-b6c0-be0b483c2028 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:20.922471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-cddbf5be-574c-47b6-b6c0-be0b483c2028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:20.957453 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:20.980322 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddbf5be-574c-47b6-b6c0-be0b483c2028 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:20.984590 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a12a5-5dd0-4aa0-8923-f17624365776 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:20.985237 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a12a5-5dd0-4aa0-8923-f17624365776 service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:20.985528 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a12a5-5dd0-4aa0-8923-f17624365776 service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:20.985804 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185a12a5-5dd0-4aa0-8923-f17624365776 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:20.995311 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a12a5-5dd0-4aa0-8923-f17624365776 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:20.997698 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185a12a5-5dd0-4aa0-8923-f17624365776 service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:21.007575 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1420/2848] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:21.431682 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055cd5c-32d2-4aea-a100-4301c68b6831 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:21.434545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-9055cd5c-32d2-4aea-a100-4301c68b6831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:21.457465 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9055cd5c-32d2-4aea-a100-4301c68b6831 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:21.463535 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ce7dd-8490-4b55-b6b7-f14b99746864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:21.464408 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ce7dd-8490-4b55-b6b7-f14b99746864 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:21.464693 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ce7dd-8490-4b55-b6b7-f14b99746864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:21.464971 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9ce7dd-8490-4b55-b6b7-f14b99746864 admin admin] PATH_INFO: `/v3/projects/0a46d56774734e298e6dcd493393ce79` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:21.466244 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ce7dd-8490-4b55-b6b7-f14b99746864 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a46d56774734e298e6dcd493393ce79)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:21.468208 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9ce7dd-8490-4b55-b6b7-f14b99746864 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:21.580927 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dd9ce7dd-8490-4b55-b6b7-f14b99746864 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a46d56774734e298e6dcd493393ce79', 'request_id': 'req-dd9ce7dd-8490-4b55-b6b7-f14b99746864'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:21.587712 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dd9ce7dd-8490-4b55-b6b7-f14b99746864 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a46d56774734e298e6dcd493393ce79', 'request_id': 'req-dd9ce7dd-8490-4b55-b6b7-f14b99746864'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:21.593748 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dd9ce7dd-8490-4b55-b6b7-f14b99746864 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a46d56774734e298e6dcd493393ce79', 'request_id': 'req-dd9ce7dd-8490-4b55-b6b7-f14b99746864'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:21.662074 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dd9ce7dd-8490-4b55-b6b7-f14b99746864 admin admin] The token cache is being invalidate because project 0a46d56774734e298e6dcd493393ce79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:47:21.662364 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dd9ce7dd-8490-4b55-b6b7-f14b99746864 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:21.663118 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-dd9ce7dd-8490-4b55-b6b7-f14b99746864 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:21.664667 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1429/2849] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:47:21 2022] DELETE /identity/v3/projects/0a46d56774734e298e6dcd493393ce79 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:21.669302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a12a5-5dd0-4aa0-8923-f17624365776 service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:21.679242 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185a12a5-5dd0-4aa0-8923-f17624365776 service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:21.738650 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31ad77f-66c9-4f22-acab-89f9bcb6b3cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:21.739541 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ad77f-66c9-4f22-acab-89f9bcb6b3cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:21.739824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ad77f-66c9-4f22-acab-89f9bcb6b3cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:21.740099 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31ad77f-66c9-4f22-acab-89f9bcb6b3cc admin admin] PATH_INFO: `/v3/users/224b4a74527f47979753a1f2e3bad504` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:21.741302 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ad77f-66c9-4f22-acab-89f9bcb6b3cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=224b4a74527f47979753a1f2e3bad504)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:21.743435 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d31ad77f-66c9-4f22-acab-89f9bcb6b3cc admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:21.906169 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d31ad77f-66c9-4f22-acab-89f9bcb6b3cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '224b4a74527f47979753a1f2e3bad504'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:21.906865 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d31ad77f-66c9-4f22-acab-89f9bcb6b3cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '224b4a74527f47979753a1f2e3bad504'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:21.976733 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d31ad77f-66c9-4f22-acab-89f9bcb6b3cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '224b4a74527f47979753a1f2e3bad504'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:21.977358 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d31ad77f-66c9-4f22-acab-89f9bcb6b3cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '224b4a74527f47979753a1f2e3bad504'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:21.990769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d31ad77f-66c9-4f22-acab-89f9bcb6b3cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '224b4a74527f47979753a1f2e3bad504'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:22.003611 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1421/2850] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:47:21 2022] DELETE /identity/v3/users/224b4a74527f47979753a1f2e3bad504 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:22.441084 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ce7dd-8490-4b55-b6b7-f14b99746864 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:22.442702 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dd9ce7dd-8490-4b55-b6b7-f14b99746864 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:22.456576 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9ce7dd-8490-4b55-b6b7-f14b99746864 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:22.527590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-944ef403-f0ee-4aad-bccf-fee982e78039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:22.528950 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ef403-f0ee-4aad-bccf-fee982e78039 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:22.529233 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ef403-f0ee-4aad-bccf-fee982e78039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:22.529506 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-944ef403-f0ee-4aad-bccf-fee982e78039 admin admin] PATH_INFO: `/v3/projects/c20c9beb7fce4bd489ef8e7dc5704dde` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:22.530720 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ef403-f0ee-4aad-bccf-fee982e78039 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20c9beb7fce4bd489ef8e7dc5704dde)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:22.532715 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-944ef403-f0ee-4aad-bccf-fee982e78039 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:22.554202 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:22.675080 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-944ef403-f0ee-4aad-bccf-fee982e78039 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20c9beb7fce4bd489ef8e7dc5704dde', 'request_id': 'req-944ef403-f0ee-4aad-bccf-fee982e78039'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:22.681413 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-944ef403-f0ee-4aad-bccf-fee982e78039 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20c9beb7fce4bd489ef8e7dc5704dde', 'request_id': 'req-944ef403-f0ee-4aad-bccf-fee982e78039'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:22.687846 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-944ef403-f0ee-4aad-bccf-fee982e78039 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20c9beb7fce4bd489ef8e7dc5704dde', 'request_id': 'req-944ef403-f0ee-4aad-bccf-fee982e78039'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:22.755100 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-944ef403-f0ee-4aad-bccf-fee982e78039 admin admin] The token cache is being invalidate because project c20c9beb7fce4bd489ef8e7dc5704dde was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:47:22.755523 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-944ef403-f0ee-4aad-bccf-fee982e78039 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:22.756192 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-944ef403-f0ee-4aad-bccf-fee982e78039 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:22.757752 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1430/2851] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:47:22 2022] DELETE /identity/v3/projects/c20c9beb7fce4bd489ef8e7dc5704dde => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:22.763699 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4a0b4-8973-44bf-96ac-28a30afc31c4 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:22.764213 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4a0b4-8973-44bf-96ac-28a30afc31c4 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:22.765150 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b4a0b4-8973-44bf-96ac-28a30afc31c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:22.783190 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-f2b4a0b4-8973-44bf-96ac-28a30afc31c4 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:22.784592 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-f2b4a0b4-8973-44bf-96ac-28a30afc31c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:22.841423 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:22.859294 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1422/2852] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:22.865649 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cccc4-2be0-440b-8b62-33a10792e265 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:22.865937 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cccc4-2be0-440b-8b62-33a10792e265 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:22.866231 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-696cccc4-2be0-440b-8b62-33a10792e265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:22.886798 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-696cccc4-2be0-440b-8b62-33a10792e265 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:22.888850 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-696cccc4-2be0-440b-8b62-33a10792e265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:22.896955 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1431/2853] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:47:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:22.901283 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4a0b4-8973-44bf-96ac-28a30afc31c4 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:22.911320 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b4a0b4-8973-44bf-96ac-28a30afc31c4 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:22.915993 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68237ac7-397b-48ee-a85f-ec204fd14014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:22.916648 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68237ac7-397b-48ee-a85f-ec204fd14014 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:22.916934 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68237ac7-397b-48ee-a85f-ec204fd14014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:22.917211 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68237ac7-397b-48ee-a85f-ec204fd14014 admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:22.917949 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68237ac7-397b-48ee-a85f-ec204fd14014 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:47:22.919019 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68237ac7-397b-48ee-a85f-ec204fd14014 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:22.920614 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68237ac7-397b-48ee-a85f-ec204fd14014 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:22.934930 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1423/2854] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:47:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:47:22.939911 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cccc4-2be0-440b-8b62-33a10792e265 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:22.949298 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-696cccc4-2be0-440b-8b62-33a10792e265 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:22.955587 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747704f3-8670-4007-9a48-6a2a905b6959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:22.956242 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747704f3-8670-4007-9a48-6a2a905b6959 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:22.956518 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747704f3-8670-4007-9a48-6a2a905b6959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:22.956783 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747704f3-8670-4007-9a48-6a2a905b6959 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:22.957535 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747704f3-8670-4007-9a48-6a2a905b6959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:22.959631 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747704f3-8670-4007-9a48-6a2a905b6959 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:23.094163 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1432/2855] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:47:22 2022] POST /identity/v3/projects => generated 387 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:47:23.153308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68237ac7-397b-48ee-a85f-ec204fd14014 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:23.153308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68237ac7-397b-48ee-a85f-ec204fd14014 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:23.164468 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87859685-c752-4e37-baa5-631a2c4e3aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:23.165138 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859685-c752-4e37-baa5-631a2c4e3aed admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:23.165431 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859685-c752-4e37-baa5-631a2c4e3aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:23.165705 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87859685-c752-4e37-baa5-631a2c4e3aed admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:23.166427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87859685-c752-4e37-baa5-631a2c4e3aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:23.168908 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87859685-c752-4e37-baa5-631a2c4e3aed admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:23.314621 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1424/2856] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:47:23 2022] POST /identity/v3/users => generated 294 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:47:23.318811 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747704f3-8670-4007-9a48-6a2a905b6959 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:23.329491 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747704f3-8670-4007-9a48-6a2a905b6959 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:23.334417 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd1bf2-3a90-47e5-91c2-af5cf6c87cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:23.335101 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd1bf2-3a90-47e5-91c2-af5cf6c87cfe admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:23.335387 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd1bf2-3a90-47e5-91c2-af5cf6c87cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:23.335662 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3bd1bf2-3a90-47e5-91c2-af5cf6c87cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:23.336392 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd1bf2-3a90-47e5-91c2-af5cf6c87cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:23.337980 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3bd1bf2-3a90-47e5-91c2-af5cf6c87cfe admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:23.349257 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1433/2857] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:47:23.357008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87859685-c752-4e37-baa5-631a2c4e3aed admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:23.367228 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87859685-c752-4e37-baa5-631a2c4e3aed admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:23.372171 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2252db2d-540e-4021-b5bd-9fe9a0602cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:23.372881 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252db2d-540e-4021-b5bd-9fe9a0602cfe admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:23.373420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252db2d-540e-4021-b5bd-9fe9a0602cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:23.373723 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2252db2d-540e-4021-b5bd-9fe9a0602cfe admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:23.374440 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252db2d-540e-4021-b5bd-9fe9a0602cfe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:23.376063 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2252db2d-540e-4021-b5bd-9fe9a0602cfe admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:23.386291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1425/2858] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:47:23 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:47:23.390986 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd1bf2-3a90-47e5-91c2-af5cf6c87cfe admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:23.401388 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3bd1bf2-3a90-47e5-91c2-af5cf6c87cfe admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:23.406713 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad4edb-4b71-42eb-9a61-dbdb8b4b8eb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:23.407616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad4edb-4b71-42eb-9a61-dbdb8b4b8eb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:23.407890 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad4edb-4b71-42eb-9a61-dbdb8b4b8eb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:23.408160 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ad4edb-4b71-42eb-9a61-dbdb8b4b8eb1 admin admin] PATH_INFO: `/v3/projects/b2c82eed64b54b75a718f367b52617fe/users/04199c860e2b44078415b1b2a07856cb/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:23.424628 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad4edb-4b71-42eb-9a61-dbdb8b4b8eb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c82eed64b54b75a718f367b52617fe, user_id=04199c860e2b44078415b1b2a07856cb, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:23.427465 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ad4edb-4b71-42eb-9a61-dbdb8b4b8eb1 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:23.520616 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1434/2859] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:47:23 2022] PUT /identity/v3/projects/b2c82eed64b54b75a718f367b52617fe/users/04199c860e2b44078415b1b2a07856cb/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:23.532001 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266fe07-d224-4224-ba60-9f97ccd8ca6c None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:23.532382 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266fe07-d224-4224-ba60-9f97ccd8ca6c None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:23.532673 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1266fe07-d224-4224-ba60-9f97ccd8ca6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:23.561142 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-1266fe07-d224-4224-ba60-9f97ccd8ca6c None None] MFA Rules not processed for user `04199c860e2b44078415b1b2a07856cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:23.562359 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-1266fe07-d224-4224-ba60-9f97ccd8ca6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:23.628047 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1426/2860] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:47:23 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:23.632654 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad4edb-4b71-42eb-9a61-dbdb8b4b8eb1 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:23.694857 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ad4edb-4b71-42eb-9a61-dbdb8b4b8eb1 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:23.700210 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f79670-e101-4bf2-8430-7b6cb3be7737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:23.700859 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79670-e101-4bf2-8430-7b6cb3be7737 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:23.701142 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79670-e101-4bf2-8430-7b6cb3be7737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:23.701538 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f79670-e101-4bf2-8430-7b6cb3be7737 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:23.702237 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f79670-e101-4bf2-8430-7b6cb3be7737 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:23.704174 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f79670-e101-4bf2-8430-7b6cb3be7737 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:23.812917 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1435/2861] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:47:23 2022] POST /identity/v3/projects => generated 387 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:47:23.817210 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266fe07-d224-4224-ba60-9f97ccd8ca6c None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:23.828989 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1266fe07-d224-4224-ba60-9f97ccd8ca6c None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:23.875624 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:23.888596 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb308ba-a735-4d75-bd76-a3deeea27689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:23.891579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb308ba-a735-4d75-bd76-a3deeea27689 admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:23.891579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb308ba-a735-4d75-bd76-a3deeea27689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:23.891579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb308ba-a735-4d75-bd76-a3deeea27689 admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:23.891579 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb308ba-a735-4d75-bd76-a3deeea27689 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:23.892559 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb308ba-a735-4d75-bd76-a3deeea27689 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:23.900588 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3eb3b-a614-49c5-9a67-bda3a7a51da3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:23.900987 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3eb3b-a614-49c5-9a67-bda3a7a51da3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:23.901271 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc3eb3b-a614-49c5-9a67-bda3a7a51da3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:23.920172 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3bc3eb3b-a614-49c5-9a67-bda3a7a51da3 None None] MFA Rules not processed for user `3274e7f7b6014f08916342dca7b3c365`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:23.921387 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3bc3eb3b-a614-49c5-9a67-bda3a7a51da3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:23.946773 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:23.980144 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1436/2862] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:47:23 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:47:24.005057 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1427/2863] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:47:23 2022] POST /identity/v3/users => generated 300 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:47:24.013841 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3eb3b-a614-49c5-9a67-bda3a7a51da3 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:24.025082 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc3eb3b-a614-49c5-9a67-bda3a7a51da3 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:24.034233 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f855b-5216-43f4-9317-3b331f85cf95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:24.034897 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f855b-5216-43f4-9317-3b331f85cf95 admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:24.035266 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f855b-5216-43f4-9317-3b331f85cf95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:24.035464 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25f855b-5216-43f4-9317-3b331f85cf95 admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:24.036235 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f855b-5216-43f4-9317-3b331f85cf95 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:24.037998 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25f855b-5216-43f4-9317-3b331f85cf95 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:24.049545 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1437/2864] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:47:24.054012 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb308ba-a735-4d75-bd76-a3deeea27689 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:24.065390 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb308ba-a735-4d75-bd76-a3deeea27689 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:24.070477 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe953ab-f786-4b3c-b0f1-9617610dc4e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:24.071442 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe953ab-f786-4b3c-b0f1-9617610dc4e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:24.071718 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe953ab-f786-4b3c-b0f1-9617610dc4e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:24.071989 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe953ab-f786-4b3c-b0f1-9617610dc4e2 admin admin] PATH_INFO: `/v3/projects/560983639baf4f3b869d4c0c62027fa5/users/0b6dd922baa948a3bc0e3acebd93c194/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:24.091491 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe953ab-f786-4b3c-b0f1-9617610dc4e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560983639baf4f3b869d4c0c62027fa5, user_id=0b6dd922baa948a3bc0e3acebd93c194, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:24.098137 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe953ab-f786-4b3c-b0f1-9617610dc4e2 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:24.172164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1428/2865] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:47:24 2022] PUT /identity/v3/projects/560983639baf4f3b869d4c0c62027fa5/users/0b6dd922baa948a3bc0e3acebd93c194/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:24.176159 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f855b-5216-43f4-9317-3b331f85cf95 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:24.187785 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25f855b-5216-43f4-9317-3b331f85cf95 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:24.250197 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1b5f70-5be0-4b7a-984f-4c7266ae44bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:24.251006 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b5f70-5be0-4b7a-984f-4c7266ae44bb admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:24.251319 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b5f70-5be0-4b7a-984f-4c7266ae44bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:24.251597 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1b5f70-5be0-4b7a-984f-4c7266ae44bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:24.252337 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b5f70-5be0-4b7a-984f-4c7266ae44bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:24.253995 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1b5f70-5be0-4b7a-984f-4c7266ae44bb admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:24.265353 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1438/2866] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:47:24 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:47:24.269517 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe953ab-f786-4b3c-b0f1-9617610dc4e2 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:24.280743 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe953ab-f786-4b3c-b0f1-9617610dc4e2 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:24.287112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b36fff-5e1c-402c-8b6f-c9c90c277e04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:24.288197 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36fff-5e1c-402c-8b6f-c9c90c277e04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:24.288483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36fff-5e1c-402c-8b6f-c9c90c277e04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:24.288816 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b36fff-5e1c-402c-8b6f-c9c90c277e04 admin admin] PATH_INFO: `/v3/projects/560983639baf4f3b869d4c0c62027fa5/users/0b6dd922baa948a3bc0e3acebd93c194/roles/af24d7fdf6044033afe14451ae6aa3c7` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:24.290952 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b36fff-5e1c-402c-8b6f-c9c90c277e04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=560983639baf4f3b869d4c0c62027fa5, user_id=0b6dd922baa948a3bc0e3acebd93c194, role_id=af24d7fdf6044033afe14451ae6aa3c7)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:24.294332 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b36fff-5e1c-402c-8b6f-c9c90c277e04 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:24.305700 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1429/2867] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:47:24 2022] PUT /identity/v3/projects/560983639baf4f3b869d4c0c62027fa5/users/0b6dd922baa948a3bc0e3acebd93c194/roles/af24d7fdf6044033afe14451ae6aa3c7 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:24.372312 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f256865-45f8-4cb0-b2a5-d77f39d2d69c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:24.372624 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f256865-45f8-4cb0-b2a5-d77f39d2d69c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:24.372904 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f256865-45f8-4cb0-b2a5-d77f39d2d69c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:24.401123 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-4f256865-45f8-4cb0-b2a5-d77f39d2d69c None None] MFA Rules not processed for user `0b6dd922baa948a3bc0e3acebd93c194`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:24.402405 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4f256865-45f8-4cb0-b2a5-d77f39d2d69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:24.477786 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1439/2868] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:47:24 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:24.488713 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b36fff-5e1c-402c-8b6f-c9c90c277e04 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:24.491143 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-98b36fff-5e1c-402c-8b6f-c9c90c277e04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:24.552619 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b36fff-5e1c-402c-8b6f-c9c90c277e04 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:24.556476 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebde08b-8c91-4347-bac3-4da8acd716fd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:24.557125 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebde08b-8c91-4347-bac3-4da8acd716fd service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:24.557409 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebde08b-8c91-4347-bac3-4da8acd716fd service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:24.558406 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ebde08b-8c91-4347-bac3-4da8acd716fd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:24.567474 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebde08b-8c91-4347-bac3-4da8acd716fd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:24.568901 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ebde08b-8c91-4347-bac3-4da8acd716fd service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:24.579257 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1430/2869] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:24 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:24.662828 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f256865-45f8-4cb0-b2a5-d77f39d2d69c None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:24.664692 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-4f256865-45f8-4cb0-b2a5-d77f39d2d69c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:24.713404 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebde08b-8c91-4347-bac3-4da8acd716fd service cinder] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:24.719474 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=100 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:24.745060 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f256865-45f8-4cb0-b2a5-d77f39d2d69c None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:24.751483 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f656d2-b687-4963-b323-2773e9df460a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad68d871464f4b5588c22070205f159e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:24.752517 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f656d2-b687-4963-b323-2773e9df460a service placement] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:24.752826 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f656d2-b687-4963-b323-2773e9df460a service placement] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:24.753229 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f656d2-b687-4963-b323-2773e9df460a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:24.755118 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-34f656d2-b687-4963-b323-2773e9df460a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:24.767865 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f656d2-b687-4963-b323-2773e9df460a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:24.769449 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f656d2-b687-4963-b323-2773e9df460a service placement] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:24.779696 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1440/2870] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:24 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:24.790325 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ebde08b-8c91-4347-bac3-4da8acd716fd service cinder] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:24.795301 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64df2b-898f-4702-97cb-907c900a7d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:24.796208 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64df2b-898f-4702-97cb-907c900a7d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:24.796483 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64df2b-898f-4702-97cb-907c900a7d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:24.796756 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee64df2b-898f-4702-97cb-907c900a7d89 admin admin] PATH_INFO: `/v3/users/04199c860e2b44078415b1b2a07856cb` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:24.799173 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64df2b-898f-4702-97cb-907c900a7d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=04199c860e2b44078415b1b2a07856cb)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:24.799917 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee64df2b-898f-4702-97cb-907c900a7d89 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:25.178607 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:25.180406 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-ee64df2b-898f-4702-97cb-907c900a7d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '04199c860e2b44078415b1b2a07856cb'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:25.181124 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-ee64df2b-898f-4702-97cb-907c900a7d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '04199c860e2b44078415b1b2a07856cb'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:25.251174 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-ee64df2b-898f-4702-97cb-907c900a7d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '04199c860e2b44078415b1b2a07856cb'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:25.251800 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-ee64df2b-898f-4702-97cb-907c900a7d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '04199c860e2b44078415b1b2a07856cb'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:25.265416 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-ee64df2b-898f-4702-97cb-907c900a7d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '04199c860e2b44078415b1b2a07856cb'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:25.277845 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1431/2871] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:47:24 2022] DELETE /identity/v3/users/04199c860e2b44078415b1b2a07856cb => generated 0 bytes in 565 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:47:25.282394 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1dcf5-4e5e-4e9d-b6a7-b72c34b11979 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:25.282661 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1dcf5-4e5e-4e9d-b6a7-b72c34b11979 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:25.282992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1dcf5-4e5e-4e9d-b6a7-b72c34b11979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:25.301208 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-01b1dcf5-4e5e-4e9d-b6a7-b72c34b11979 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:25.302447 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-01b1dcf5-4e5e-4e9d-b6a7-b72c34b11979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:25.369946 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1441/2872] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:47:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:25.380706 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64df2b-898f-4702-97cb-907c900a7d89 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:25.382166 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-ee64df2b-898f-4702-97cb-907c900a7d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:25.440088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee64df2b-898f-4702-97cb-907c900a7d89 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:25.444444 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9e52d-d45f-428e-8e84-e0beb5f3292f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:25.448586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9e52d-d45f-428e-8e84-e0beb5f3292f service neutron] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:25.448586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9e52d-d45f-428e-8e84-e0beb5f3292f service neutron] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:25.448586 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc9e52d-d45f-428e-8e84-e0beb5f3292f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:25.455702 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9e52d-d45f-428e-8e84-e0beb5f3292f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:25.457118 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc9e52d-d45f-428e-8e84-e0beb5f3292f service neutron] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:25.466779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1432/2873] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:25.974070 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1dcf5-4e5e-4e9d-b6a7-b72c34b11979 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:25.975746 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-01b1dcf5-4e5e-4e9d-b6a7-b72c34b11979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:25.988610 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b1dcf5-4e5e-4e9d-b6a7-b72c34b11979 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:25.993735 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96938c60-68bf-47ef-83a7-81df5748f790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:25.994601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96938c60-68bf-47ef-83a7-81df5748f790 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:25.994924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96938c60-68bf-47ef-83a7-81df5748f790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:25.995201 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96938c60-68bf-47ef-83a7-81df5748f790 admin admin] PATH_INFO: `/v3/projects/b2c82eed64b54b75a718f367b52617fe` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:25.996640 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96938c60-68bf-47ef-83a7-81df5748f790 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2c82eed64b54b75a718f367b52617fe)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:26.004700 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96938c60-68bf-47ef-83a7-81df5748f790 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:26.133049 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-96938c60-68bf-47ef-83a7-81df5748f790 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2c82eed64b54b75a718f367b52617fe', 'request_id': 'req-96938c60-68bf-47ef-83a7-81df5748f790'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:26.140286 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-96938c60-68bf-47ef-83a7-81df5748f790 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2c82eed64b54b75a718f367b52617fe', 'request_id': 'req-96938c60-68bf-47ef-83a7-81df5748f790'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:26.146378 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-96938c60-68bf-47ef-83a7-81df5748f790 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2c82eed64b54b75a718f367b52617fe', 'request_id': 'req-96938c60-68bf-47ef-83a7-81df5748f790'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:26.217869 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-96938c60-68bf-47ef-83a7-81df5748f790 admin admin] The token cache is being invalidate because project b2c82eed64b54b75a718f367b52617fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:47:26.218160 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-96938c60-68bf-47ef-83a7-81df5748f790 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:26.218852 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-96938c60-68bf-47ef-83a7-81df5748f790 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:26.220416 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1442/2874] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:47:25 2022] DELETE /identity/v3/projects/b2c82eed64b54b75a718f367b52617fe => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:26.224420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9e52d-d45f-428e-8e84-e0beb5f3292f service neutron] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:26.234510 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc9e52d-d45f-428e-8e84-e0beb5f3292f service neutron] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:26.294945 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea7683-8645-4804-9034-adb2e5173af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:26.295824 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea7683-8645-4804-9034-adb2e5173af9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:26.296112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea7683-8645-4804-9034-adb2e5173af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:26.296427 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea7683-8645-4804-9034-adb2e5173af9 admin admin] PATH_INFO: `/v3/users/0b6dd922baa948a3bc0e3acebd93c194` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:26.299539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea7683-8645-4804-9034-adb2e5173af9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b6dd922baa948a3bc0e3acebd93c194)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:26.301135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea7683-8645-4804-9034-adb2e5173af9 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:26.460270 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-bcea7683-8645-4804-9034-adb2e5173af9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b6dd922baa948a3bc0e3acebd93c194'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:26.461236 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-bcea7683-8645-4804-9034-adb2e5173af9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b6dd922baa948a3bc0e3acebd93c194'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:26.508380 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-bcea7683-8645-4804-9034-adb2e5173af9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b6dd922baa948a3bc0e3acebd93c194'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:26.509013 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-bcea7683-8645-4804-9034-adb2e5173af9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b6dd922baa948a3bc0e3acebd93c194'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:26.520439 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:26.522362 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-bcea7683-8645-4804-9034-adb2e5173af9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b6dd922baa948a3bc0e3acebd93c194'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:26.535651 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1433/2875] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:47:26 2022] DELETE /identity/v3/users/0b6dd922baa948a3bc0e3acebd93c194 => generated 0 bytes in 312 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:27.070658 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96938c60-68bf-47ef-83a7-81df5748f790 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:27.073489 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-96938c60-68bf-47ef-83a7-81df5748f790 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:27.088764 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96938c60-68bf-47ef-83a7-81df5748f790 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:27.151212 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:27.158534 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8804c2-4f4f-4a89-aaae-882035185ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:27.160963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8804c2-4f4f-4a89-aaae-882035185ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:27.160963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8804c2-4f4f-4a89-aaae-882035185ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:27.160963 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8804c2-4f4f-4a89-aaae-882035185ad6 admin admin] PATH_INFO: `/v3/projects/560983639baf4f3b869d4c0c62027fa5` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:27.161421 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8804c2-4f4f-4a89-aaae-882035185ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=560983639baf4f3b869d4c0c62027fa5)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:27.163398 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8804c2-4f4f-4a89-aaae-882035185ad6 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:27.294384 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5f8804c2-4f4f-4a89-aaae-882035185ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '560983639baf4f3b869d4c0c62027fa5', 'request_id': 'req-5f8804c2-4f4f-4a89-aaae-882035185ad6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:27.301023 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5f8804c2-4f4f-4a89-aaae-882035185ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '560983639baf4f3b869d4c0c62027fa5', 'request_id': 'req-5f8804c2-4f4f-4a89-aaae-882035185ad6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:27.306805 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5f8804c2-4f4f-4a89-aaae-882035185ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '560983639baf4f3b869d4c0c62027fa5', 'request_id': 'req-5f8804c2-4f4f-4a89-aaae-882035185ad6'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:27.382551 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5f8804c2-4f4f-4a89-aaae-882035185ad6 admin admin] The token cache is being invalidate because project 560983639baf4f3b869d4c0c62027fa5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:47:27.382791 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5f8804c2-4f4f-4a89-aaae-882035185ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:27.383438 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-5f8804c2-4f4f-4a89-aaae-882035185ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:27.385102 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1443/2876] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:47:27 2022] DELETE /identity/v3/projects/560983639baf4f3b869d4c0c62027fa5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:27.390623 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e01ff-0274-4c2d-9d37-8408191e2882 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:27.391164 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e01ff-0274-4c2d-9d37-8408191e2882 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:27.391318 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02e01ff-0274-4c2d-9d37-8408191e2882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:27.410524 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-a02e01ff-0274-4c2d-9d37-8408191e2882 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:27.411939 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-a02e01ff-0274-4c2d-9d37-8408191e2882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:27.475032 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1434/2877] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:47:27.483137 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2c61b-4946-4b08-bc7c-16ac7b276dbb None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:27.483427 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2c61b-4946-4b08-bc7c-16ac7b276dbb None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:27.483758 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d2c61b-4946-4b08-bc7c-16ac7b276dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:27.502634 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-52d2c61b-4946-4b08-bc7c-16ac7b276dbb None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:27.503877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-52d2c61b-4946-4b08-bc7c-16ac7b276dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:27.511724 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1444/2878] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:47:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:27.516958 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e01ff-0274-4c2d-9d37-8408191e2882 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:27.527222 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02e01ff-0274-4c2d-9d37-8408191e2882 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:27.532888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b08b11-80e8-4a09-b9c2-f30fa827852c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:27.533544 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b08b11-80e8-4a09-b9c2-f30fa827852c admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:27.533855 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b08b11-80e8-4a09-b9c2-f30fa827852c admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:27.534135 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b08b11-80e8-4a09-b9c2-f30fa827852c admin admin] PATH_INFO: `/v3/domains` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:27.534906 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b08b11-80e8-4a09-b9c2-f30fa827852c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80361) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 15 19:47:27.535219 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b08b11-80e8-4a09-b9c2-f30fa827852c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:27.536853 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b08b11-80e8-4a09-b9c2-f30fa827852c admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:27.549672 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1435/2879] 10.222.0.40 () {58 vars in 1152 bytes} [Fri Jul 15 19:47:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 15 19:47:27.554317 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2c61b-4946-4b08-bc7c-16ac7b276dbb None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:27.564363 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d2c61b-4946-4b08-bc7c-16ac7b276dbb None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:27.569928 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1c388-d8de-4733-a2b7-6b186c899407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:27.573030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1c388-d8de-4733-a2b7-6b186c899407 admin admin] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:27.573030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1c388-d8de-4733-a2b7-6b186c899407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:27.573030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e1c388-d8de-4733-a2b7-6b186c899407 admin admin] PATH_INFO: `/v3/projects` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:27.573030 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1c388-d8de-4733-a2b7-6b186c899407 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:27.573790 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e1c388-d8de-4733-a2b7-6b186c899407 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:27.640622 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1445/2880] 10.222.0.40 () {60 vars in 1152 bytes} [Fri Jul 15 19:47:27 2022] POST /identity/v3/projects => generated 397 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 15 19:47:27.641929 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b08b11-80e8-4a09-b9c2-f30fa827852c admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:27.653075 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b08b11-80e8-4a09-b9c2-f30fa827852c admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:27.711433 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d6532-15b2-489b-aeca-7827708e404f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:27.712107 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d6532-15b2-489b-aeca-7827708e404f admin admin] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:27.712396 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d6532-15b2-489b-aeca-7827708e404f admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:27.712769 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179d6532-15b2-489b-aeca-7827708e404f admin admin] PATH_INFO: `/v3/users` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:27.713436 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d6532-15b2-489b-aeca-7827708e404f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:27.715463 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179d6532-15b2-489b-aeca-7827708e404f admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:27.739008 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1c388-d8de-4733-a2b7-6b186c899407 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:27.740728 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-81e1c388-d8de-4733-a2b7-6b186c899407 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:27.798000 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e1c388-d8de-4733-a2b7-6b186c899407 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:27.801683 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909a4f3-580b-476b-9f91-8e9dbf96aee7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:27.802325 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909a4f3-580b-476b-9f91-8e9dbf96aee7 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:27.802645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909a4f3-580b-476b-9f91-8e9dbf96aee7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:27.802966 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e909a4f3-580b-476b-9f91-8e9dbf96aee7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:27.804723 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-e909a4f3-580b-476b-9f91-8e9dbf96aee7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:27.806071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1436/2881] 10.222.0.40 () {60 vars in 1143 bytes} [Fri Jul 15 19:47:27 2022] POST /identity/v3/users => generated 299 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 15 19:47:27.811243 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d6532-15b2-489b-aeca-7827708e404f admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:27.816008 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909a4f3-580b-476b-9f91-8e9dbf96aee7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:27.817968 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e909a4f3-580b-476b-9f91-8e9dbf96aee7 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:27.821956 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179d6532-15b2-489b-aeca-7827708e404f admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:27.827745 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc1c4a-f61a-4fe6-b9b0-b747b4eae533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:27.828412 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc1c4a-f61a-4fe6-b9b0-b747b4eae533 admin admin] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:27.828592 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1446/2882] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:27 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 15 19:47:27.828995 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc1c4a-f61a-4fe6-b9b0-b747b4eae533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:27.829274 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adc1c4a-f61a-4fe6-b9b0-b747b4eae533 admin admin] PATH_INFO: `/v3/roles` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:27.830100 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc1c4a-f61a-4fe6-b9b0-b747b4eae533 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:27.831755 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adc1c4a-f61a-4fe6-b9b0-b747b4eae533 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:27.845662 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1437/2883] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 15 19:47:27.846861 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909a4f3-580b-476b-9f91-8e9dbf96aee7 service neutron] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:27.858787 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e909a4f3-580b-476b-9f91-8e9dbf96aee7 service neutron] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:27.863645 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce489e9-e8c0-4e73-b4d0-2779730826fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:27.864313 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce489e9-e8c0-4e73-b4d0-2779730826fc admin admin] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:27.864595 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce489e9-e8c0-4e73-b4d0-2779730826fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:27.864871 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce489e9-e8c0-4e73-b4d0-2779730826fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:27.865609 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce489e9-e8c0-4e73-b4d0-2779730826fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:27.867351 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce489e9-e8c0-4e73-b4d0-2779730826fc admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:27.883453 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1447/2884] 10.222.0.40 () {58 vars in 1121 bytes} [Fri Jul 15 19:47:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 15 19:47:27.884748 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc1c4a-f61a-4fe6-b9b0-b747b4eae533 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:27.896036 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adc1c4a-f61a-4fe6-b9b0-b747b4eae533 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:27.901106 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bf676-a8b4-46e2-ac8b-18436fe0f3b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:27.902008 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bf676-a8b4-46e2-ac8b-18436fe0f3b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:27.902291 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bf676-a8b4-46e2-ac8b-18436fe0f3b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:27.902605 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-304bf676-a8b4-46e2-ac8b-18436fe0f3b3 admin admin] PATH_INFO: `/v3/projects/2aa1ca873bd84c8a8edec95c6b89adeb/users/450a4e141c3342258d9056796d4d86c4/roles/5d20b549441d429db11d5e91f3825e86` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:27.919001 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304bf676-a8b4-46e2-ac8b-18436fe0f3b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2aa1ca873bd84c8a8edec95c6b89adeb, user_id=450a4e141c3342258d9056796d4d86c4, role_id=5d20b549441d429db11d5e91f3825e86)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:27.921708 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-304bf676-a8b4-46e2-ac8b-18436fe0f3b3 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:28.057781 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1438/2885] 10.222.0.40 () {60 vars in 1482 bytes} [Fri Jul 15 19:47:27 2022] PUT /identity/v3/projects/2aa1ca873bd84c8a8edec95c6b89adeb/users/450a4e141c3342258d9056796d4d86c4/roles/5d20b549441d429db11d5e91f3825e86 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:28.069492 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a912d7-4409-462c-9864-f538037d5417 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:28.070639 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a912d7-4409-462c-9864-f538037d5417 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:28.070639 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a912d7-4409-462c-9864-f538037d5417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:28.101053 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-90a912d7-4409-462c-9864-f538037d5417 None None] MFA Rules not processed for user `450a4e141c3342258d9056796d4d86c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:28.102317 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-90a912d7-4409-462c-9864-f538037d5417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:28.145260 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:28.172306 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1448/2886] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:47:28 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:28.185280 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bf676-a8b4-46e2-ac8b-18436fe0f3b3 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:28.187191 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-304bf676-a8b4-46e2-ac8b-18436fe0f3b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:28.228192 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:DELETE=1,keystone:SELECT=95,keystone:INSERT=4 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:28.257847 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-304bf676-a8b4-46e2-ac8b-18436fe0f3b3 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:28.262659 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea565ed-4a19-4221-9376-6d4f256d9c43 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4776b70a88a04be7bfe6729e16c16647', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:28.267188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea565ed-4a19-4221-9376-6d4f256d9c43 service cinder] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:28.267188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea565ed-4a19-4221-9376-6d4f256d9c43 service cinder] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:28.267188 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea565ed-4a19-4221-9376-6d4f256d9c43 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:28.273071 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea565ed-4a19-4221-9376-6d4f256d9c43 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:28.274539 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea565ed-4a19-4221-9376-6d4f256d9c43 service cinder] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:28.284139 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1439/2887] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:28 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:34.224535 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a912d7-4409-462c-9864-f538037d5417 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:34.292620 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a912d7-4409-462c-9864-f538037d5417 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:34.297590 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b4351-eb8d-4ae6-96f3-0eec2e797768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:34.299910 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b4351-eb8d-4ae6-96f3-0eec2e797768 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:34.299910 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b4351-eb8d-4ae6-96f3-0eec2e797768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:34.300228 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5b4351-eb8d-4ae6-96f3-0eec2e797768 admin admin] PATH_INFO: `/v3/users/450a4e141c3342258d9056796d4d86c4` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:34.301370 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b4351-eb8d-4ae6-96f3-0eec2e797768 admin admin] RBAC: Authorizing `identity:delete_user(user_id=450a4e141c3342258d9056796d4d86c4)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:34.303374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf5b4351-eb8d-4ae6-96f3-0eec2e797768 admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:34.485978 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bf5b4351-eb8d-4ae6-96f3-0eec2e797768 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '450a4e141c3342258d9056796d4d86c4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:34.506042 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bf5b4351-eb8d-4ae6-96f3-0eec2e797768 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '450a4e141c3342258d9056796d4d86c4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:34.506863 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bf5b4351-eb8d-4ae6-96f3-0eec2e797768 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '450a4e141c3342258d9056796d4d86c4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:34.507522 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bf5b4351-eb8d-4ae6-96f3-0eec2e797768 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '450a4e141c3342258d9056796d4d86c4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:34.516092 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-bf5b4351-eb8d-4ae6-96f3-0eec2e797768 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '450a4e141c3342258d9056796d4d86c4'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:34.577924 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1449/2888] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:47:34 2022] DELETE /identity/v3/users/450a4e141c3342258d9056796d4d86c4 => generated 0 bytes in 354 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:34.582506 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b151648-e6f2-4f7a-804b-8dda607f72e5 None None] REQUEST_METHOD: `POST` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:34.583033 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b151648-e6f2-4f7a-804b-8dda607f72e5 None None] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:34.583141 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b151648-e6f2-4f7a-804b-8dda607f72e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:34.600818 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.auth.core [None req-6b151648-e6f2-4f7a-804b-8dda607f72e5 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80361) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:34.602732 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6b151648-e6f2-4f7a-804b-8dda607f72e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:34.667433 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1440/2889] 10.222.0.40 () {58 vars in 957 bytes} [Fri Jul 15 19:47:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:34.679118 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b4351-eb8d-4ae6-96f3-0eec2e797768 admin admin] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:34.680684 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-bf5b4351-eb8d-4ae6-96f3-0eec2e797768 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:34.742707 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf5b4351-eb8d-4ae6-96f3-0eec2e797768 admin admin] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:34.748041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eaacd8b-43fb-4a0e-8cb7-4516fc7d27c1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c99418232a0848a1b7a1a73966928769', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:34.748041 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaacd8b-43fb-4a0e-8cb7-4516fc7d27c1 service neutron] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:34.748300 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaacd8b-43fb-4a0e-8cb7-4516fc7d27c1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:34.748418 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eaacd8b-43fb-4a0e-8cb7-4516fc7d27c1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:34.757992 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaacd8b-43fb-4a0e-8cb7-4516fc7d27c1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:34.759465 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eaacd8b-43fb-4a0e-8cb7-4516fc7d27c1 service neutron] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:34.769877 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1450/2890] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:35.195970 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b151648-e6f2-4f7a-804b-8dda607f72e5 None None] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:35.197466 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-6b151648-e6f2-4f7a-804b-8dda607f72e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:35.209931 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b151648-e6f2-4f7a-804b-8dda607f72e5 None None] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:35.216797 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e582afa-806d-45a5-aa4f-77fb682147b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:35.218914 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e582afa-806d-45a5-aa4f-77fb682147b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:35.219308 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e582afa-806d-45a5-aa4f-77fb682147b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:35.219687 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e582afa-806d-45a5-aa4f-77fb682147b7 admin admin] PATH_INFO: `/v3/projects/2aa1ca873bd84c8a8edec95c6b89adeb` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:35.221101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e582afa-806d-45a5-aa4f-77fb682147b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2aa1ca873bd84c8a8edec95c6b89adeb)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:35.223269 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e582afa-806d-45a5-aa4f-77fb682147b7 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:35.311582 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2e582afa-806d-45a5-aa4f-77fb682147b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2aa1ca873bd84c8a8edec95c6b89adeb', 'request_id': 'req-2e582afa-806d-45a5-aa4f-77fb682147b7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:35.394322 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2e582afa-806d-45a5-aa4f-77fb682147b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2aa1ca873bd84c8a8edec95c6b89adeb', 'request_id': 'req-2e582afa-806d-45a5-aa4f-77fb682147b7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:35.401216 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2e582afa-806d-45a5-aa4f-77fb682147b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2aa1ca873bd84c8a8edec95c6b89adeb', 'request_id': 'req-2e582afa-806d-45a5-aa4f-77fb682147b7'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:35.412184 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2e582afa-806d-45a5-aa4f-77fb682147b7 admin admin] The token cache is being invalidate because project 2aa1ca873bd84c8a8edec95c6b89adeb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80361) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:47:35.412471 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2e582afa-806d-45a5-aa4f-77fb682147b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:35.413102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-2e582afa-806d-45a5-aa4f-77fb682147b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:47:35.414628 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1441/2891] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:47:35 2022] DELETE /identity/v3/projects/2aa1ca873bd84c8a8edec95c6b89adeb => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:47:40.301958 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718816c-25a2-4092-a494-82b704cc9b72 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:40.303066 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718816c-25a2-4092-a494-82b704cc9b72 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:40.303066 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3718816c-25a2-4092-a494-82b704cc9b72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:40.309611 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:40.321745 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-3718816c-25a2-4092-a494-82b704cc9b72 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:40.322998 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-3718816c-25a2-4092-a494-82b704cc9b72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:40.386161 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1451/2892] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 15 19:47:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:40.399837 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e582afa-806d-45a5-aa4f-77fb682147b7 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:40.401341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-2e582afa-806d-45a5-aa4f-77fb682147b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:40.454770 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:47:40.477833 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e582afa-806d-45a5-aa4f-77fb682147b7 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:40.483580 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970797c9-b961-4bd1-a6be-874637c7a8a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:40.484231 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970797c9-b961-4bd1-a6be-874637c7a8a8 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:40.484512 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970797c9-b961-4bd1-a6be-874637c7a8a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:40.484786 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970797c9-b961-4bd1-a6be-874637c7a8a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:40.493458 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970797c9-b961-4bd1-a6be-874637c7a8a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:40.495065 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970797c9-b961-4bd1-a6be-874637c7a8a8 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:40.505361 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1442/2893] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:43.873929 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca338f-89f2-4dbc-ab95-08df9fa503a3 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:43.874471 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca338f-89f2-4dbc-ab95-08df9fa503a3 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:43.874471 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfca338f-89f2-4dbc-ab95-08df9fa503a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:43.894540 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-dfca338f-89f2-4dbc-ab95-08df9fa503a3 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:43.895821 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-dfca338f-89f2-4dbc-ab95-08df9fa503a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:43.904797 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1452/2894] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 15 19:47:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 15 19:47:43.919341 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970797c9-b961-4bd1-a6be-874637c7a8a8 service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:43.920777 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-970797c9-b961-4bd1-a6be-874637c7a8a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:43.938229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970797c9-b961-4bd1-a6be-874637c7a8a8 service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:43.943877 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd5550-f449-4aa8-96ad-6e775d4db290 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:43.944529 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd5550-f449-4aa8-96ad-6e775d4db290 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:43.944840 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd5550-f449-4aa8-96ad-6e775d4db290 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:43.945088 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94fd5550-f449-4aa8-96ad-6e775d4db290 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:43.954465 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd5550-f449-4aa8-96ad-6e775d4db290 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:43.956082 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94fd5550-f449-4aa8-96ad-6e775d4db290 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:43.966518 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1443/2895] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:46.875200 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06062831-e932-424f-93e5-91c6285676a1 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:46.875763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06062831-e932-424f-93e5-91c6285676a1 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:46.875763 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06062831-e932-424f-93e5-91c6285676a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:46.896119 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-06062831-e932-424f-93e5-91c6285676a1 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:46.897324 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-06062831-e932-424f-93e5-91c6285676a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:46.906044 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1453/2896] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 15 19:47:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:46.922420 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd5550-f449-4aa8-96ad-6e775d4db290 service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:46.935038 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94fd5550-f449-4aa8-96ad-6e775d4db290 service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:46.941101 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5b95d-eae9-4f54-9671-3a632ece00c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:46.941762 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5b95d-eae9-4f54-9671-3a632ece00c0 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:46.942051 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5b95d-eae9-4f54-9671-3a632ece00c0 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:46.947181 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de5b95d-eae9-4f54-9671-3a632ece00c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:46.953463 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5b95d-eae9-4f54-9671-3a632ece00c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:46.955112 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3de5b95d-eae9-4f54-9671-3a632ece00c0 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:46.965641 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1444/2897] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:50.089601 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbd169-fcdb-4024-9780-273d2e3f4a5c None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:50.090128 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbd169-fcdb-4024-9780-273d2e3f4a5c None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:50.090403 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cbd169-fcdb-4024-9780-273d2e3f4a5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:50.109755 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-48cbd169-fcdb-4024-9780-273d2e3f4a5c None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:50.111193 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-48cbd169-fcdb-4024-9780-273d2e3f4a5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:50.119490 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1454/2898] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 15 19:47:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:50.135848 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5b95d-eae9-4f54-9671-3a632ece00c0 service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:50.147792 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de5b95d-eae9-4f54-9671-3a632ece00c0 service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:50.153888 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c444299-8a2d-48df-9eb4-19185151c890 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:50.154508 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c444299-8a2d-48df-9eb4-19185151c890 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:50.154815 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c444299-8a2d-48df-9eb4-19185151c890 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:50.155089 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c444299-8a2d-48df-9eb4-19185151c890 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:50.163305 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c444299-8a2d-48df-9eb4-19185151c890 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:50.164921 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c444299-8a2d-48df-9eb4-19185151c890 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:50.174556 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1445/2899] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:47:53.339859 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8520a07-df9a-4f7d-9b64-48523cfe7de7 None None] REQUEST_METHOD: `POST` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:53.340887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8520a07-df9a-4f7d-9b64-48523cfe7de7 None None] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:53.340887 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8520a07-df9a-4f7d-9b64-48523cfe7de7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:53.359989 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.auth.core [None req-a8520a07-df9a-4f7d-9b64-48523cfe7de7 None None] MFA Rules not processed for user `62e1112a8ecc4f798b846400813fbbe0`. Rule list: `[]` (Enabled: `True`). {{(pid=80362) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 15 19:47:53.361331 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-a8520a07-df9a-4f7d-9b64-48523cfe7de7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:47:53.369121 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1455/2900] 10.222.0.58 () {58 vars in 1016 bytes} [Fri Jul 15 19:47:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 15 19:47:53.385092 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c444299-8a2d-48df-9eb4-19185151c890 service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:47:53.396603 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c444299-8a2d-48df-9eb4-19185151c890 service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:47:53.402412 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb85974-286d-4e77-ba9f-63ba858272b3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:47:53.403599 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb85974-286d-4e77-ba9f-63ba858272b3 service nova] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:47:53.404102 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb85974-286d-4e77-ba9f-63ba858272b3 service nova] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:47:53.404385 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb85974-286d-4e77-ba9f-63ba858272b3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:47:53.413156 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb85974-286d-4e77-ba9f-63ba858272b3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:47:53.414771 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb85974-286d-4e77-ba9f-63ba858272b3 service nova] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:47:53.425438 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1446/2901] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:47:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:48:03.123570 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8520a07-df9a-4f7d-9b64-48523cfe7de7 None None] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:48:03.136710 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8520a07-df9a-4f7d-9b64-48523cfe7de7 None None] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:48:03.142138 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37d7eb-4697-4bb9-bd05-82e4703231bf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '850a32e590154968bfbbfc404450b70a', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:48:03.142806 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37d7eb-4697-4bb9-bd05-82e4703231bf service nova] REQUEST_METHOD: `GET` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:48:03.143097 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37d7eb-4697-4bb9-bd05-82e4703231bf service nova] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:48:03.143374 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df37d7eb-4697-4bb9-bd05-82e4703231bf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:48:03.145176 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.fernet_utils [None req-df37d7eb-4697-4bb9-bd05-82e4703231bf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80362) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:48:03.158447 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37d7eb-4697-4bb9-bd05-82e4703231bf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:48:03.160089 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df37d7eb-4697-4bb9-bd05-82e4703231bf service nova] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:48:03.170985 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1456/2902] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:48:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:48:03.420938 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=34 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:48:13.166275 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=44 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:48:24.851754 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb85974-286d-4e77-ba9f-63ba858272b3 service nova] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:48:24.853435 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-4fb85974-286d-4e77-ba9f-63ba858272b3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:48:24.869097 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb85974-286d-4e77-ba9f-63ba858272b3 service nova] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:48:24.874052 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbffcb-64e0-4ce1-b467-fd6abbeb5150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:48:24.874950 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbffcb-64e0-4ce1-b467-fd6abbeb5150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:48:24.875229 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbffcb-64e0-4ce1-b467-fd6abbeb5150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:48:24.875525 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6cbffcb-64e0-4ce1-b467-fd6abbeb5150 admin admin] PATH_INFO: `/v3/users/3274e7f7b6014f08916342dca7b3c365` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:48:24.876707 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbffcb-64e0-4ce1-b467-fd6abbeb5150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3274e7f7b6014f08916342dca7b3c365)` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:48:24.878635 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6cbffcb-64e0-4ce1-b467-fd6abbeb5150 admin admin] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:48:25.048000 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d6cbffcb-64e0-4ce1-b467-fd6abbeb5150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3274e7f7b6014f08916342dca7b3c365'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:25.048677 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d6cbffcb-64e0-4ce1-b467-fd6abbeb5150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3274e7f7b6014f08916342dca7b3c365'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:25.136425 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d6cbffcb-64e0-4ce1-b467-fd6abbeb5150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3274e7f7b6014f08916342dca7b3c365'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:25.137070 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d6cbffcb-64e0-4ce1-b467-fd6abbeb5150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3274e7f7b6014f08916342dca7b3c365'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:25.149553 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.notifications [None req-d6cbffcb-64e0-4ce1-b467-fd6abbeb5150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3274e7f7b6014f08916342dca7b3c365'} {{(pid=80361) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:25.162405 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1447/2903] 10.222.0.40 () {58 vars in 1223 bytes} [Fri Jul 15 19:48:24 2022] DELETE /identity/v3/users/3274e7f7b6014f08916342dca7b3c365 => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 15 19:48:25.405660 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37d7eb-4697-4bb9-bd05-82e4703231bf service nova] Authenticating user token {{(pid=80362) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:48:25.419890 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df37d7eb-4697-4bb9-bd05-82e4703231bf service nova] Validating token access rules against request {{(pid=80362) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:48:25.479844 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fdb081-3d84-4de2-8fda-94d3d067af9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62e1112a8ecc4f798b846400813fbbe0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '236a9e48f4d940ef9a994f185adc8b9d', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80362) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:48:25.480706 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdb081-3d84-4de2-8fda-94d3d067af9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:48:25.480989 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdb081-3d84-4de2-8fda-94d3d067af9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:48:25.481263 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fdb081-3d84-4de2-8fda-94d3d067af9f admin admin] PATH_INFO: `/v3/projects/68bd7c9b8773450b8cf2af734ef2c846` {{(pid=80362) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:48:25.482442 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdb081-3d84-4de2-8fda-94d3d067af9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=68bd7c9b8773450b8cf2af734ef2c846)` {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:48:25.484390 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fdb081-3d84-4de2-8fda-94d3d067af9f admin admin] RBAC: Authorization granted {{(pid=80362) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:48:25.616536 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-85fdb081-3d84-4de2-8fda-94d3d067af9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68bd7c9b8773450b8cf2af734ef2c846', 'request_id': 'req-85fdb081-3d84-4de2-8fda-94d3d067af9f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:25.622892 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-85fdb081-3d84-4de2-8fda-94d3d067af9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68bd7c9b8773450b8cf2af734ef2c846', 'request_id': 'req-85fdb081-3d84-4de2-8fda-94d3d067af9f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:25.628371 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-85fdb081-3d84-4de2-8fda-94d3d067af9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68bd7c9b8773450b8cf2af734ef2c846', 'request_id': 'req-85fdb081-3d84-4de2-8fda-94d3d067af9f'} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:25.718456 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-85fdb081-3d84-4de2-8fda-94d3d067af9f admin admin] The token cache is being invalidate because project 68bd7c9b8773450b8cf2af734ef2c846 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80362) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 15 19:48:25.718731 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-85fdb081-3d84-4de2-8fda-94d3d067af9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:25.719376 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG keystone.notifications [None req-85fdb081-3d84-4de2-8fda-94d3d067af9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80362) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 15 19:48:25.720956 dv-cinder-799871-34-smb devstack@keystone.service[80362]: [pid: 80362|app: 0|req: 1457/2904] 10.222.0.40 () {58 vars in 1232 bytes} [Fri Jul 15 19:48:25 2022] DELETE /identity/v3/projects/68bd7c9b8773450b8cf2af734ef2c846 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 15 19:48:35.158203 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:48:35.715341 dv-cinder-799871-34-smb devstack@keystone.service[80362]: DEBUG dbcounter [-] [80362] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80362) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 15 19:50:10.718928 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbffcb-64e0-4ce1-b467-fd6abbeb5150 admin admin] Authenticating user token {{(pid=80361) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 15 19:50:10.720370 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-d6cbffcb-64e0-4ce1-b467-fd6abbeb5150 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:50:10.792998 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6cbffcb-64e0-4ce1-b467-fd6abbeb5150 admin admin] Validating token access rules against request {{(pid=80361) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 15 19:50:10.853274 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb1ed3-a9b6-4daa-a8d3-711530b5ad27 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ad68d871464f4b5588c22070205f159e', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '861de78bbfe84bd991c3ab54e85573a7', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80361) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 15 19:50:10.853923 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb1ed3-a9b6-4daa-a8d3-711530b5ad27 service placement] REQUEST_METHOD: `GET` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 15 19:50:10.854209 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb1ed3-a9b6-4daa-a8d3-711530b5ad27 service placement] SCRIPT_NAME: `/identity` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 15 19:50:10.854489 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb1ed3-a9b6-4daa-a8d3-711530b5ad27 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80361) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 15 19:50:10.856333 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.fernet_utils [None req-5ceb1ed3-a9b6-4daa-a8d3-711530b5ad27 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80361) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 15 19:50:10.867779 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb1ed3-a9b6-4daa-a8d3-711530b5ad27 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 15 19:50:10.869351 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb1ed3-a9b6-4daa-a8d3-711530b5ad27 service placement] RBAC: Authorization granted {{(pid=80361) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 15 19:50:10.879605 dv-cinder-799871-34-smb devstack@keystone.service[80361]: [pid: 80361|app: 0|req: 1448/2905] 10.222.0.40 () {60 vars in 1365 bytes} [Fri Jul 15 19:50:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 15 19:50:20.875246 dv-cinder-799871-34-smb devstack@keystone.service[80361]: DEBUG dbcounter [-] [80361] Writing DB stats keystone:SELECT=58 {{(pid=80361) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}